Perhaps your village is too weak at the moment? I know for sure that I attack those villages that appear the weakest and also those that are in Classical Age but very weak, like not defended at all and such.
I'm still in Iron Age but I plan to max everything before I go for Classical Age, just my personal tip.