Hello, I've read the caveats that HTDig is not for creating your own
AltaVista. But how about your own mini-altavista? I'd like to index just
the default.html page from a couple hundred thousand web sites. I did see
references in the HTDig online docs in the effect that 'some sites have
100,000 pages". However, I don't want to embark on this endeavor if it's
really a poor use of a good tool. (Like, my first question would be can
the config file handle 100,000 starting points?)
Am I barking up the wrong tree? If so, what would ya'll recommend. My
goal is to run this on a Linux box (Redtel) and not spend much of
anything on the software. Am I nuts?
Frank
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.
