On 14 Dec 1999, Randal L. Schwartz wrote:
Sounds to me like they are precisely at odds with anyone doing the
kind of blocking that I want to do.
That seems like a weird policy, though. nmap, for example, helps people
do dastardly things, but that doesn't mean nmap is a bad program; it's how
"Michael" == Michael Plump [EMAIL PROTECTED] writes:
Michael Teleport Pro, by default, is setup to be a nice little web
Michael robot. Just because one user configures the program to be
Michael evil doesn't mean you should stop other people who are trying
Michael to play nice. And since you
Randal Yes, it's possible to configure it so that it works correctly,
Randal but if I recall, I also saw it fetch /cgi/whatever, even though
Randal that was in /robots.txt. I *must* block anything that doesn't
Randal respect /robots.txt. Once they fix that, I might let it loose.
Teleport
"Doug" == Doug MacEachern [EMAIL PROTECTED] writes:
My CPU-based limiter is working quite nicely. It lets oodles of
static pages be served, but if someone starts doing CPU intensive
stuff, they get booted for hogging my server machine. The nice thing
is that I return a standard "503"
It's also been very successful at catching a whole slew of user-agents
that believe in sucking senselessly. Here's my current block-list:
[...]
or m{Teleport Pro} # bad robot!
[...]
Teleport Pro does have options to control how it behaves:
1. "Obey the Robot Exclusion
"Eric" == Eric L Brine [EMAIL PROTECTED] writes:
Eric Because of #2, Teleport Pro only has one active thread at a time, and it
Eric is idle at least 50% of the time (when downloading image archives). In
Eric other words, it's possible for a user can configure Teleport Pro to
Eric hammer a
My CPU-based limiter is working quite nicely. It lets oodles of
static pages be served, but if someone starts doing CPU intensive
stuff, they get booted for hogging my server machine. The nice thing
is that I return a standard "503" error including a "retry-after", so
if it is a legitimate
"Barry" == Barry Robison [EMAIL PROTECTED] writes:
Barry On Wed, Nov 24, 1999 at 07:31:36AM -0800, Randal L. Schwartz wrote:
I also added a DBILogger that logs CPU times, so I can see which pages
on my system are burning the most CPU, and even tell which hosts suck
down the most CPU in a
