Shawn McKisson wrote:
>
> If you could determine which IP addresses the search engines are comming from,
> then you could just not answer answer any requests from those addresses.
we ended up having to go this route. we basically only
allowed a percentage of the active sessions to originate
from the same ip address in order to minimize one (or a
collection of) client from saturating the site.
>
> There is also some file that robots will (are supposed to) look for when they
> enter your domain. With this file you can ask that the robot not look through
> and index your site. This will at least keep some of the bots away.
/robots.txt
that said, we got hit ruthlessly by a search engine that
completely ignored this file. your milage may vary.
>
> --shawn
>
hope this helps,
- james
___________________________________________________________________________
To unsubscribe, send email to [EMAIL PROTECTED] and include in the body
of the message "signoff SERVLET-INTEREST".
Archives: http://archives.java.sun.com/archives/servlet-interest.html
Resources: http://java.sun.com/products/servlet/external-resources.html
LISTSERV Help: http://www.lsoft.com/manuals/user/user.html
