Highlight/Left click to select ship (use shift key to select multiple ships) you want to remove from fleet. Then go to map and click any hex other than hex the fleet is on & they'll eject. I agree it'd be nice to simply have an eject key similar to shipyards & starbases.
