[
https://issues.apache.org/jira/browse/NUTCH-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093184#comment-17093184
]
ASF GitHub Bot commented on NUTCH-2495:
---------------------------------------
sebastian-nagel opened a new pull request #517:
URL: https://github.com/apache/nutch/pull/517
Note: this PR includes PR #513 to avoid merge conflicts.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Use -deleteGone instead of clean job in crawler script while indexing
> ---------------------------------------------------------------------
>
> Key: NUTCH-2495
> URL: https://issues.apache.org/jira/browse/NUTCH-2495
> Project: Nutch
> Issue Type: Improvement
> Components: bin
> Affects Versions: 1.15
> Reporter: Moreno Feltscher
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.17
>
>
> Instead of running {{bin/nutch clean}} after indexing the documents run
> {{bin/nutch index}} with the {{-deleteGone}} flag which instead of just
> deleting gone and duplicated documents also deletes redirects from the index.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
