Randal,
this is definitely Internet Explorer 5. I've seen the same several times on
my site and here's how it works: In IE5 you can make web pages available
for offline reading, you just need to go to Favorites/Add to Favorites ...
and select the number of levels you want to download. IE5 will ha
Randal,
This is IE5. It has to do with the offline reading feature, it will try and
download as much of your site as it can depending on what the user has specified
in number of levels to download. It totaly ignores robots.txt.
Frank
"Randal L. Schwartz" wrote:
> In the past week or so, I've
- Original Message -
From: Randal L. Schwartz <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>
Sent: Thursday, October 28, 1999 9:50 AM
Subject: "DigExt" in user-agent hammering my site
>
> In the past week or so, I've been seeing many many portions of my site
> sucked do
Randal L. Schwartz ([EMAIL PROTECTED]) said, on [991028 10:52]:
>
> The only thing in common with these rude intrusions is a windows-IE
> user agent, along with a new string "DigExt".
>
> Is it a new version of IE that permits heavy rapid download?
>
Yup. Microsoft have had problems before with
> "Jay" == Jay J <[EMAIL PROTECTED]> writes:
Jay> I just tried it using IE5 for NT4 ..
Jay> What you're seeing is when someone has used "Make available
Jay> offline" followed by:
Jay> "If this favorite links to other pages, would you like to make
Jay> those pages available offline too? [y/n
Randal,
This is a nice package, but I have some questions:
> my $host = $r->get_remote_host;
> return DECLINED if $host =~ /\.(holdit|stonehenge)\.com$/;
You have host name lookups turned on? That's not very performance friendly.
And you've just published how to get around your thro
