When you launch a Colony Ship, simply right-click on the planet you want it to colonize (the class has to be above 0, though).
For Constructors, simply send them to the square you want them to build something, then in the small menu in the ship description portion (center bottom), click 'Construct' and choose the type of Starbase you want.
