I think /0 means research the subject of robots.txt There's a good FAQ on Robot Exclusion and related topics here: http://www.robotstxt.org/wc/faq.html
carl morris Plug Two t +442920190151 Michel Rijnders wrote:
On Mon, Oct 18, 2004 at 09:48:35AM -0400, /0 wrote:do a google search for "robots.txt" thats the way to avoid the bots.I'm afraid it's not; there's no way to prevent a bot from ignoring 'robots.txt'. Cheers, Michel
