What is the status of the robots.txt file? I tried looking at the Internet Engineering Task Force (IETF) and I didn't notice robots.txt in the Internet-Drafts. The last draft I could find was the one that is posted in robotstxt.org website. I'm wondering will there be any further improvements to this like the last draft, I saw, suggests "Allow:"?
Thanks. Sijis Aviles _______________________________________________ Robots mailing list [EMAIL PROTECTED] http://www.mccmedia.com/mailman/listinfo/robots
