[ https://issues.apache.org/jira/browse/LUCENE-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714051#comment-16714051 ]
Simon Willnauer edited comment on LUCENE-8598 at 12/9/18 6:28 PM: ------------------------------------------------------------------ I ran a benchmark to update 10000 values on a single segment 100 times: ||setup||patch time in ms||master time in ms|| |shared single value|10131|38430| |random values|30985|69600| the reason I looked into it is that I wrote the benchmark to test another change that I made and saw the sorting showing up in a profiler spending 99% in the finish method. I also tested other acceptable overhead rations but they didn't show any speedups ie. FAST and FASTEST. was (Author: simonw): I ran a benchmark to update 10000 values on a single segment 100 times: ||setup||patch time in ms||master time in ms|| |shared single value|10131|38430| |random values|30985|69600| > Improve field updates packed values > ----------------------------------- > > Key: LUCENE-8598 > URL: https://issues.apache.org/jira/browse/LUCENE-8598 > Project: Lucene - Core > Issue Type: Improvement > Reporter: Simon Willnauer > Priority: Major > Fix For: master (8.0), 7.7 > > Time Spent: 20m > Remaining Estimate: 0h > > DocValuesFieldUpdats are using compact settings for packet ints that causes > dramatic slowdowns when the updates are finished and sorted. Moving to > the default > accepted overhead ratio yields up to 4x improvements in applying updates. > This change > also improves the packing of numeric values since we know the value range > in advance and > can choose a different packing scheme in such a case. > Overall this change yields a good performance improvement since 99% of > the times of applying > DV field updates are spend in the sort method which essentially makes > applying the updates > 4x faster. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org