I'm looking to use htdig to index about 120 sites in various size
clumps and I'd like to make my configuration easier to manage by
putting all of the related urls in the same config file.
I was wondering if someone could tell me what would happen in this
case:
start_url: http://a.com http://b.com
limit_urls_to: ${start_url} ##The default
and if a.com had a link somewhere deep inside to b.com would I end up
indexing b.com twice?
Thanks,
Colin
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
