I've got two "trees" of content that I'm "digging" each night for a search engine:
http://www.sunmanagers.org/archives (old archives, from 1989-2000, never changes, is static) http://www.sunmanagers.org/pipermail/sunmanagers/ (current list archives, changes) Is there any way to set things up so that *only* the second URL gets "scanned" every night, but the information from *both* stays in the db? I dont want to have to re-scan the static content every night if I can avoid it (20K files or so..) Bill -- Bill Bradford [EMAIL PROTECTED] Austin, TX _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html

