[
https://issues.apache.org/jira/browse/SOLR-18189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18076270#comment-18076270
]
ASF subversion and git services commented on SOLR-18189:
--------------------------------------------------------
Commit c80586e492aebab22c950adb060b54c190cea886 in solr's branch
refs/heads/branch_10x from Francois Huaulme
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=c80586e492a ]
SOLR-18189: Skip indexing duplicate docs via a content hash URP (#4263)
Co-authored-by: fhuaulme <[email protected]>
Co-authored-by: David Smiley <[email protected]>
> Improve tracking of duplicate Solr docs with content hash
> ---------------------------------------------------------
>
> Key: SOLR-18189
> URL: https://issues.apache.org/jira/browse/SOLR-18189
> Project: Solr
> Issue Type: New Feature
> Reporter: Francois Huaulme
> Priority: Major
> Labels: pull-request-available
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> Content hash detection aims to improve update efficiency by identifying and
> bypassing redundant document updates. By detecting instances where content
> remains unchanged, the URP chain skips unnecessary write operations to reduce
> CPU and I/O overhead on nodes by skipping operations done in downstream URPs.
> The implementation offers flexibility through a "monitor-only" mode, where
> duplicate occurrences are tracked via metrics without triggering immediate
> update discards. This approach provides detailed insights into document
> duplication levels within Solr data.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
