Place a robots meta tag in the head tag of your html.
-Tim Eric J. Pastoor wrote:
The msn bot has been hammering one of my webapps for about 2 weeks now. I have a calendar style transaction page that is not password protected. Essentially this calendar goes on forever. This means that the msn bot is basically going on forever. It is making my log files insanely large. Is there a way to create a robots.txt file for basically one servlet instead of everything?
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
