Just install some kind of blocking on your firewall (fail2ban is a good one), and let it take care of the worst of it...
Thanks, researching it now....Looks like an RPM might be available for CentOS 5. There's a HOWTO here for configuring it with iptables:
<http://www.the-art-of-web.com/system/fail2ban/>
