Why not? If you don't give him a peace treaty by doing a raider attack, and your are lucky enough, you can, for sure, end up on the same player...multiple times
I've had that happen before. The second time was fun, because I had tripped all the traps along my path the first time. Slightly less oil available the second time though.