Tools for merging and filtering CrawlDb-s and LinkDb-s
------------------------------------------------------
Key: NUTCH-264
URL: http://issues.apache.org/jira/browse/NUTCH-264
Project: Nutch
Type: New Feature
Versions: 0.8-dev
Reporter: Andrzej Bialecki
Attachments: patch.txt
This patch contains implementations and unit tests for two new commands:
* mergedb: merges one or more CrawlDb-s, optionally filtering urls through the
current URLFilters.
* mergelinkdb: as above, only for LinkDb-s. Optional filtering is applied both
to toUrls and fromUrls in Inlinks.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira