[EMAIL PROTECTED] Stoping bots from sucking files

2008-10-24 Thread Mário Gamito
Hi, I have this site that has a directory with some files. A few weeks ago, two web bots started sucking those files at an impressive rate. I've put a .htaccess file like this in the directory: AuthType Basic AuthName files AuthUserFile /home/foobar/public_html/files/.htpasswd require

Re: [EMAIL PROTECTED] Stoping bots from sucking files

2008-10-24 Thread Joseph S D Yao
On Fri, Oct 24, 2008 at 08:29:43PM +0100, Mário Gamito wrote: Hi, I have this site that has a directory with some files. A few weeks ago, two web bots started sucking those files at an impressive rate. Use a robots.txt file in your home directory. http://www.robotstxt.org/