Yes I don't find it odd either for mares and geldings to fight. But this is very different then the usual fighting to establish pecking order. That is why it's so odd!
They are NOT fighting him back and being very submissive. He is acting like a stud mounting them and being way more vicious...