On Wednesday 12 January 2005 19:58, Dan Jacobson wrote:
> With such ease it is one can just tap the "delete" button on various
> sub indexes pages or AddCacheInfo to bid files adieu.
>
> And so it is with any spidering program running on any page with
> AddCacheInfo attached, to any depth.

What exactly is the problem? Probably the spider also found the refresh 
link, i.e. the page will be back next time you are online. And yes, I do 
understand, the extended online time is not what you appreciate.

But you could always disable the enable-modify-html or add-cache-info 
option before you let a spider access your WWWOFFLE cache. I don't think 
it is a fault of WWWOFFLE because it can't know there is a spider 
running.


Best regards,
Nils
-- 
Don't Panic


Reply via email to