After running rundig with a -v, I noticed this in the output:

Deleted, no excerpt: 5/http://unixathome.org/adsl/archives/2001_05
Deleted, no excerpt: 6/http://unixathome.org/adsl/archives/2001_06
Deleted, no excerpt: 7/http://unixathome.org/adsl/archives/2001_07
Deleted, no excerpt: 8/http://unixathome.org/adsl/archives/2001_08
Deleted, no excerpt: 9/http://unixathome.org/adsl/archives/2001_09

The above URLs actually exist.  I then searched for a message ID as found in the above 
URLs 
and failed to find the messages.  I checked for one message IDs outside the above 
pages and 
found it.

I found this in the logs

   "GET /adsl/archives/2001_05 HTTP/1.0" 301 341

AFAIK, 301 is a permanent redirect?  I have no idea why that occured.  Fetching the 
URL works 
via my broswer.  Clues please?

I figure I can easily run htdig over just the above pages and merge them in without 
rerunning the 
entire htdig.  I'm planning to do that on a daily basis for those mailing list 
archives anyway.
-- 
Dan Langille
The FreeBSD Diary - http://freebsddiary.org/ - practical examples


_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a 
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to