1. Left click on area below Governor picture to bring up Icon Bar on right. (see Kristin Safeit below)

2. Left click 3rd icon (orange) to fire Governor and send them back to your leader pool.  note - This will reduce their loyalty by 10.

3. If you really want to be evil you can execute them (red icon), but this will cause a loyalty drop in all the remaining Governors.

4. Leaders with bad loyalty are still useful.  Just assign them to a Faction to gain a small benefit.  You can also improve any Leaders loyalty by 10 points by using the 2nd icon (green) if you have a Harmony Crystal.  There is a significant cooldown period (50 turns I believe) before you can use this again on the same leader.

Gypsy - I agree, but he might have picked a leader with really bad base loyalty (<50) not knowing any better, so if he now finds one with 85 loyalty, the swap would be worth it.  Also that -20 loyalty penalty for "I have to manage things" isn't a given after the 1st one you assign.  I have one with a -8 penalty.

Great info scifi1950! Thank you!