On Tue, 17 Aug 1999 [EMAIL PROTECTED] wrote:

> updating a large amount of URLs. At present an update tries again *all*
> URLs. It should have some heuristics to say something like : try this URL

This isn't quite true. The 3.2 code makes a provision to specify a list of
URLs to htdig to only add or update as the case may be.

> only 15 days after a successfull loading, arrange URL updates so that a 
> maximum of N URLs is checked every day to prevent saturating the bandwidth
> etc..

Very true. The indexer stores the date accessed, but makes no provision in
this regard. However, people have asked for some sort of daemon mode,
where the indexer runs continuously. All good ideas, but they need people
interested in taking up implementation. ;-)

-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/


------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.

Reply via email to