Maybe we are late in the universe, perhaps universe used to be a lively and vibrant place homing millions of civilizations. Now, we stand as the last remnants, hence, possibly the most advanced.

We don't really know anything about life in the universe. As for life in our galaxy, its entirely plausible that we are early.