At 10:10 PM -0400 9/12/99, Patrick wrote:
>The document counter is being incremented even when a document
>is not found or is a redirect. I believe the document counter
>is in Server.cc (about line 274, reads: "_documents++;")
You're correct. The problem is that the Server class and the
Retriever class don't talk to each other much (if at all).
For another example, take the documents forbidden by robots.txt
files. The Server class blocks retrieval, but the Retriver class
doesn't have it in the limits and blindly adds it.
The result is an empty document--it wasn't retrieved since it was
forbidden, but a DocumentRef was added to the database for it.
I guess Server/Retriever code needs to be on the rewrite list...
-Geoff
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
