> We're running a few crawlers in parallel (different seed lists & > topN parameters, using different crawl dirs) and we'd like to set > the regex-urlfilter separate per fetch/seed list. As of now the > urlfilter is global per access of bin/nutch. Is there anything you > can besides making two instances of the nutch dir structure?
I just want to make sure I'm not missing anything before I write code to get this done -- any ideas? ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
