Randal> Yes, it's possible to configure it so that it works correctly,
Randal> but if I recall, I also saw it fetch /cgi/whatever, even though
Randal> that was in /robots.txt. I *must* block anything that doesn't
Randal> respect /robots.txt. Once they fix that, I might let it loose.
Teleport Pro obeys robots.txt by default, but unfortunately, it can be
set to ignore robot exclusion rules.
Michael> Just because one user configures the program to be
Michael> evil doesn't mean you should stop other people who
Michael> are trying to play nice.
Yes, it does. The actions of wrong dooers affect the innocent, here and
everywhere.
ELB
--
Eric L. Brine | Chicken: The egg's way of making more eggs.
[EMAIL PROTECTED] | Do you always hit the nail on the thumb?
ICQ# 4629314 | An optimist thinks thorn bushes have roses.
