[htdig] what robots.txt actually does

[Kari Suomela]

Friday December 10 1999 11:16, Gilles Detillieux wrote to Daniel 
MacKay:

 GD> I think the key sentence that Kari is looking for is this:

 GD>   The presence of an empty "/robots.txt" file has no explicit

That's the one! Thx for good responses! :)

 KS



------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.