Attackers would be out at major disadvantage if this was to happens. The change you ask for would allow defenders to hide towers. Cause if you allow walls to do it then building can rotate that way also.
As a defender I would welcome this lol but not many O players would. Just saying not being able to target tower would suck for them .