Hi !
I am from bar-ilan university, Israel. We installed htdig few month ago
but in the past few weeks we enlarge the server contents and now its more
than 63,000 html pages and it took him for more than a weak to dig the web
until and error occur and its stopped (our fault but . . . a weak ?).
We afraid that if it will finish one day (we started it again today), each
time we will run it, it will take another weak or more and so on.
1. Can htdig handle such vast information.
2. Will it dig each time from the beginning and it will take a weak for him
or after the first time it will take only minutes or few hours to check for
new or updated information ?
Thanks a lot.
Udi Heller
Web Admin.
winmail.dat
