[
https://issues.apache.org/jira/browse/SOLR-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107604#comment-15107604
]
ASF subversion and git services commented on SOLR-8559:
-------------------------------------------------------
Commit 1725638 from dpg...@apache.org in branch 'dev/trunk'
[ https://svn.apache.org/r1725638 ]
SOLR-8559: FCS facet performance optimization
Significantly speeds up processing when terms are high cardinality and the
matching docset is small.
When facet minCount > 0 and the number of matching documents is small (or 0)
this enhancement
prevents considering terms which have a 0 count. Also includes change to move
to the next non-zero
term value when selecting a segment position.
> FCS facet performance optimization
> ----------------------------------
>
> Key: SOLR-8559
> URL: https://issues.apache.org/jira/browse/SOLR-8559
> Project: Solr
> Issue Type: Improvement
> Components: faceting
> Reporter: Keith Laban
> Assignee: Dennis Gove
> Labels: optimization, performance
> Attachments: SOLR-8559-trunk.patch, solr-8559.patch
>
>
> While profiling a large collection (multi-sharded billions of documents), I
> found that a fast (5-10ms query) which had no matches would take 20-30
> seconds when doing facets even when {{facet.mincount=1}}
> Profiling made it apparent that with {{facet.method=fcs}} 99% of the time was
> [spent
> here|https://github.com/apache/lucene-solr/blob/trunk/solr/core/src/java/org/apache/solr/request/PerSegmentSingleValuedFaceting.java#L212].
> {{queue.udpateTop}} gets called {{numOfSegments*numTerms}}, the worst case
> when every term is in every segment. This formula doesn't take into account
> whether or not any of the terms have a positive count with respect to the
> docset.
> These optimizations are aimed to do two things:
> # When mincount>0 don't include segments which all terms have zero counts.
> This should significantly speed up processing when terms are high cardinality
> and the matching docset is small
> # FIXED TODO optimization: when mincount>0 move segment position the next non
> zero term value.
> both of these changes will minimize the number of called needed to the slow
> {{updateTop}} call.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
