Peter,
In trying to find info in robotsxx.txt, it is obvious to see you are not alone. This missing file (404) can be found in logs all over the place. It's possible there is an errant search engine out there. Is client info logged on 404 errors? If not, you might consider putting a 0- or 1-byte file out there and gather the info when the file is served. Maybe then you will have a clue as to "who" is looking for it.
-Jeff
-----Original Message-----
From: Peter [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 06, 2002 11:33 AM
To: [EMAIL PROTECTED]
Subject: [sambar] New robot file? {01}
I hate to ask but does anyone know what a robotsxx.txt file is? I see a couple 404's for it in my logs.
Peter
------------------------------------------------------- To unsubscribe please go to http://www.sambar.ch/list/
