Geoff Hutchison wrote:
>
> On Fri, 2 Mar 2001, T.J. Yang wrote:
>
> > It is possible to configure htdig to scan only the file
> > being modified since last scan ?
> >
> > Regularly scannig the same old doucuments seems to me is a waste of
> > time.
>
> Ah, but here's the catch. How do you know which documents have been
> modified without querying the server? For the most part, htdig uses the
> efficient If-Modified-Since header, which requires the server to only send
> the document if it has changed.
I am using htdig to index a large amount of PDF/PS files under a
direcotry.
There PDF/ps files don't change much but there are big files. I was
hoping
perhaps some I can configure the htdig to do a file date comparsion
against
a local database contains the records of all the web pages/files last
visited
before parsing the contents of PDF/PS files.
Perhaps this should be a wish feature for the future release of htdig.
Thanks for your reply
tj
>
> --
> -Geoff Hutchison
> Williams Students Online
> http://wso.williams.edu/
>
> _______________________________________________
> htdig-general mailing list <[EMAIL PROTECTED]>
> To unsubscribe, send a message to <[EMAIL PROTECTED]> with
>a subject of unsubscribe
> FAQ: http://htdig.sourceforge.net/FAQ.html
--
TJ Yang
_______________________________________________
htdig-dev mailing list
[EMAIL PROTECTED]
http://lists.sourceforge.net/lists/listinfo/htdig-dev
