I don't consider Impulse Drive early-tech, though. By the time that arrives, most of my planets should well under way to being self-sufficient, or at least self-justifying.
The difference between our conclusions is that I don't only consider Super Breeder, which shortens the turnaround time for planet viability considerably, and I also don't assume Abundant Anomalies, which can allow you to deficit spend much longer with BC pickups.
Let's posit, for isntance, that you're playing as the Drath, specifically for the purpose of the pop growth hit. Doesn't make much sense to play a pop hit Civ, and then make it up with pop growth bonuses, right? You want that play experience.
As the Drath, your planet turnaround is much, much slower. You gotta pick the best planet clumps that all share upgrade paths. Aside from that, you're more incentivized to seek out Resources and Asteroids, which are not affected by pop growth hits.
Of course, in the long term, a colony is a much more valuable asset, which is why the point of getting Asteroids early is specifically to leverage the advantage into getting more colonies. I highly value a location with a decent planet and as asteroid field, for instance. If I acquire the planet and develop the asteroid field with the native miner I have (replace the native miner with another), I could have an extra +13 prod on that planet within 17 turns of its founding, assuming the miner and colony went at the same time- and that's maintenance-free!
Particularly in the case of a clump of low PQ planets, a sizable asteroid field in the system (and a miner to work it) are invaluable at getting them up to speed i infrastructure ASAP, whether those be factories or Merchant Trade Complexes. That is, of course, because you can shift around that production from planet to planet, allowing point production boosts without spending from your treasury.
Best of all, it all costs nothing to build and maintain, and you only spend for the miner 1/asteroid field (I tend to build miners where appropriate), which is why I don't believe that you only spend for it once, and why I don't have miners trundling halfway across the galaxy.
For Breeder games, the colony ships is worth that much more, and I don't doubt that it can be exccedingly advantageous just to have everything have colony modules.