You could give them a good anti-cav bonus, for them to be dominant there... really depends on where you want them to excel.
A good idea to balance them could be to give them horrible stamina, to make them a hit-or-fail weapon. If you use them for too long, their stamina would drop so low that it would make them a lot less useful in the battle.