[
https://issues.apache.org/jira/browse/SOLR-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12639470#action_12639470
]
Yonik Seeley commented on SOLR-799:
-----------------------------------
"overwriting" is implemented and supported in Lucene now (and we gain a number
of benefits from using that). Conditionally adding a document, or testing if a
document already exists, is not supported.
Since we can't currently determine if something is a duplicate, it seems like
this issue should go ahead with just a single option: whether to remove older
documents with the same signature or not.
> Add support for hash based exact/near duplicate document handling
> -----------------------------------------------------------------
>
> Key: SOLR-799
> URL: https://issues.apache.org/jira/browse/SOLR-799
> Project: Solr
> Issue Type: New Feature
> Components: update
> Reporter: Mark Miller
> Priority: Minor
> Attachments: SOLR-799.patch
>
>
> Hash based duplicate document detection is efficient and allows for blocking
> as well as field collapsing. Lets put it into solr.
> http://wiki.apache.org/solr/Deduplication
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
