Here's a site that should answer all of your /robots.txt questions.

http://info.webcrawler.com/mak/projects/robots/robots.html

-- 
Jeffrey Hundstad


-
To unsubscribe from this list: send the line "unsubscribe linux-net" in
the body of a message to [EMAIL PROTECTED]

Reply via email to