> Given (b), I'd just say you should reindex, being careful to stay away
> from nasty CGIs. A dig of 950 URLs should not take very long at all.

I have added in several exclude_urls: and I'll give re-indexing a try.

It's not actually 950 urls it is 950 different sites that have asked to
be in our search engine so there are thousands and thousands of
individual URLS

Thanks for the help
Clint

-- 
Clint Gilders
Servermaster Onlinehobbyist Inc.
[EMAIL PROTECTED]

_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
Information: http://lists.sourceforge.net/lists/listinfo/htdig-general
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to