>1. Can htdig handle such vast information.
Easily. I have over 76,000 URLs on my site <http://wso.williams.edu/>
and there's no problem whatsoever. I'm not really sure why it's
taking so long on your machine, could you give us a little more
information?
>2. Will it dig each time from the beginning and it will take a weak for him
>or after the first time it will take only minutes or few hours to check for
>new or updated information ?
That depends on how you call it. I'm obviously a bit biased, but I'd
suggest that you use the rundig-type script I contributed:
<http://www.htdig.org/files/contrib/scripts/rundig.sh>
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.