[EMAIL PROTECTED] (Russell Coker) wrote in message news:<[EMAIL PROTECTED]>... > I wasn't aware that there was any format to robots.txt, I thought that the > mere presense of such a file would prevent robots from visiting.
Nope; see: http://www.robotstxt.org/wc/robots.html
