I was wondering if people could suggest solutions:

I am trying to index about 2,500 sites going 3 deep per site.  These sites
need to be searched on a twice-a-day basis.  I have a keyword list of
potentially 2000 words.  Is there a way to filter htdig based on the keyword
list?  ie. only save the pages that match the words?  I'm running into a lot
of problems with space (duh) and time.

Also, is it typical for commericial search engines to provide this type of
custom service?

What do people think?  I really have no background info on the subject so
please pardon me if I sound stupid...

-kevin


------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.

Reply via email to