Geoff,
Thanks for the (almost) encouraging eMail. I think I'm gonna start
small... maybe a few hundred URLs then grow from there. The main thing is
that the skills I learn in HTDig _could_ at least get us part way to our
goal. It does sound like a beefy dedicated machine is in order.
When you wrote:
>You should also understand that if you include a lot of URLs up
>front, it has to make up the list of them all in memory, so it'll
>probably grab a ton right when it starts up.
Does this apply only for the first pass indexing of new sites?
Frank
Frank Martini Voice: 713/621-1917
Cadence Development FAX: 713/621-1960
5075 Westheimer, Ste. 1266 eMail: [EMAIL PROTECTED]
Houston, Texas 77056 WWW: http://www.caddev.com/
4th Dimension & Internet Database Development
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.
