Re: OT: robots.txt

2000-10-09 Thread Wjreichard
It is a file that gives instructions to search engines. You can specify whick files/directories should be searched by a visiting spider. However, Not all spiders are nice. -- Archives: http://www.mail-archive.com/cf-talk

OT: robots.txt

2000-10-09 Thread Chad Gray
Anyone know what robots.txt is? thanks -- Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ To Unsubscribe visit http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf_talk or send a message t