Ya, I have a lot more males than females so I have been cycling them through and try to make sure they get a day off.
However, I have had males in the same tank w/ a female for more than a day who periodically got off and later got back on. So it doesn't necessarily take them that long to recharge. But, just because they remounted doesn't mean they are actually able to fertilize.