if i make the tracklisting an image file rather than a text/html file will
that stop bots from searching it?
james
www.jbucknell.com
D B
do a google search for "robots.txt"
thats the way to avoid the bots.
- Original Message -
From: <[EMAIL PROTECTED]>
To: "D B" <[EMAIL PROTECTED]>
Cc: "313 Org" <313@hyperreal.org>
Sent: Sunday, October 17, 2004 8:24 PM
Subject: Re:
On Mon, Oct 18, 2004 at 09:48:35AM -0400, /0 wrote:
> do a google search for "robots.txt"
>
> thats the way to avoid the bots.
I'm afraid it's not; there's no way to prevent a bot from ignoring
'robots.txt'.
Cheers,
Michel
I think /0 means research the subject of robots.txt
There's a good FAQ on Robot Exclusion and related topics here:
http://www.robotstxt.org/wc/faq.html
carl morris
Plug Two
t +442920190151
Michel Rijnders wrote:
On Mon, Oct 18, 2004 at 09:48:35AM -0400, /0 wrote:
do a google search for "rob
On Mon, Oct 18, 2004 at 06:33:50PM +0100, carl plugtwo wrote:
> I think /0 means research the subject of robots.txt
>
> There's a good FAQ on Robot Exclusion and related topics here:
> http://www.robotstxt.org/wc/faq.html
The following article ('No Bots Allowed!'):
http://www.eweek.com/article2/0
At 02:09 PM 10/18/2004, Michel Rijnders wrote:
The following article ('No Bots Allowed!'):
http://www.eweek.com/article2/0,1759,1248105,00.asp
might be of interest as well; it also states the point I was trying to
get across:
However, the standard relies entirely on the courtesy of the visitin
