The changes I'd like would be to introduce more siege troops of different varieties in the earlier ages (when you first get walls) & these should be the only units to destroy buildings (except raiders burning farms & caravans of course).
The current soldiers & ranged infantry should only fight...