When I play I do not like it because many buildings are immortal, although it does not have a big impact on the gameplay

There are a lot of buildings that I have had to leave and there are also many more inviolable buildings than normal buildings.

For example, command buildings give you a general who can be immortal to prevent you from building and destroying more generals, but if there is another solution to stop a person From the generals of agriculture, you will use it because buildings are inviolable. If I want to build a house that is not disturbed, what should I do?