gsmiller commented on pull request #718: URL: https://github.com/apache/lucene/pull/718#issuecomment-1066998156
Even though I ran benchmarks on the backport version of this change (#719), I figured it would be good to run benchmarks here as well. Below compares this patch against `main` using `wikimedium10m`: ``` TaskQPS baseline StdDevQPS candidate StdDev Pct diff p-value BrowseDayOfYearTaxoFacets 21.65 (22.8%) 20.61 (22.9%) -4.8% ( -41% - 52%) 0.507 BrowseDateTaxoFacets 21.61 (22.6%) 20.61 (22.8%) -4.6% ( -40% - 52%) 0.519 Prefix3 362.81 (10.5%) 349.00 (11.4%) -3.8% ( -23% - 20%) 0.273 BrowseRandomLabelTaxoFacets 17.76 (18.5%) 17.15 (20.0%) -3.4% ( -35% - 43%) 0.577 BrowseMonthTaxoFacets 27.32 (27.1%) 26.45 (29.2%) -3.2% ( -46% - 72%) 0.721 Wildcard 64.61 (5.6%) 63.58 (6.0%) -1.6% ( -12% - 10%) 0.381 OrNotHighMed 887.00 (3.3%) 874.66 (3.4%) -1.4% ( -7% - 5%) 0.191 LowTerm 2661.07 (2.9%) 2630.67 (3.2%) -1.1% ( -7% - 5%) 0.240 OrNotHighHigh 1523.01 (3.8%) 1506.01 (4.2%) -1.1% ( -8% - 7%) 0.379 AndHighMedDayTaxoFacets 124.82 (1.4%) 123.59 (1.5%) -1.0% ( -3% - 1%) 0.032 HighSpanNear 21.47 (4.9%) 21.27 (4.9%) -0.9% ( -10% - 9%) 0.558 MedPhrase 342.22 (2.8%) 339.35 (3.2%) -0.8% ( -6% - 5%) 0.373 HighPhrase 453.21 (2.2%) 449.61 (2.6%) -0.8% ( -5% - 4%) 0.291 MedSpanNear 74.03 (4.3%) 73.45 (4.2%) -0.8% ( -8% - 8%) 0.559 BrowseMonthSSDVFacets 13.79 (19.1%) 13.69 (19.7%) -0.7% ( -33% - 47%) 0.910 LowPhrase 85.89 (1.9%) 85.33 (2.0%) -0.7% ( -4% - 3%) 0.294 PKLookup 169.25 (3.2%) 168.19 (2.3%) -0.6% ( -5% - 5%) 0.481 OrNotHighLow 962.38 (3.0%) 956.47 (2.9%) -0.6% ( -6% - 5%) 0.511 BrowseDayOfYearSSDVFacets 12.23 (14.4%) 12.15 (14.5%) -0.6% ( -25% - 33%) 0.897 BrowseDateSSDVFacets 2.34 (6.1%) 2.32 (7.8%) -0.6% ( -13% - 14%) 0.802 OrHighMed 134.10 (5.0%) 133.49 (4.6%) -0.5% ( -9% - 9%) 0.766 Fuzzy1 91.09 (1.2%) 90.71 (1.8%) -0.4% ( -3% - 2%) 0.373 HighTerm 1690.39 (4.6%) 1684.21 (5.3%) -0.4% ( -9% - 10%) 0.816 OrHighNotHigh 1592.87 (2.4%) 1587.86 (3.7%) -0.3% ( -6% - 5%) 0.751 AndHighHighDayTaxoFacets 12.34 (2.4%) 12.31 (2.4%) -0.3% ( -4% - 4%) 0.696 AndHighLow 927.42 (3.2%) 924.95 (3.1%) -0.3% ( -6% - 6%) 0.790 MedSloppyPhrase 107.35 (2.5%) 107.06 (2.5%) -0.3% ( -5% - 4%) 0.736 IntNRQ 83.16 (1.2%) 82.95 (1.0%) -0.2% ( -2% - 1%) 0.469 MedTerm 1935.87 (4.3%) 1934.77 (4.8%) -0.1% ( -8% - 9%) 0.969 OrHighNotLow 1109.87 (4.1%) 1109.25 (4.7%) -0.1% ( -8% - 9%) 0.968 HighSloppyPhrase 28.62 (1.8%) 28.61 (2.6%) -0.0% ( -4% - 4%) 0.981 Respell 57.41 (1.1%) 57.40 (1.6%) -0.0% ( -2% - 2%) 0.968 LowSpanNear 193.79 (3.4%) 193.81 (3.8%) 0.0% ( -6% - 7%) 0.992 LowSloppyPhrase 30.88 (1.5%) 30.90 (1.8%) 0.1% ( -3% - 3%) 0.885 OrHighHigh 38.71 (4.3%) 38.74 (4.2%) 0.1% ( -8% - 8%) 0.954 OrHighLow 606.33 (2.8%) 606.93 (2.5%) 0.1% ( -5% - 5%) 0.907 OrHighNotMed 985.50 (4.3%) 986.95 (4.6%) 0.1% ( -8% - 9%) 0.917 Fuzzy2 38.38 (1.5%) 38.45 (1.8%) 0.2% ( -3% - 3%) 0.698 OrHighMedDayTaxoFacets 5.37 (4.8%) 5.39 (4.9%) 0.4% ( -8% - 10%) 0.801 MedTermDayTaxoFacets 27.22 (3.9%) 27.41 (4.6%) 0.7% ( -7% - 9%) 0.606 LowIntervalsOrdered 38.55 (3.8%) 38.89 (3.2%) 0.9% ( -5% - 8%) 0.415 BrowseRandomLabelSSDVFacets 9.42 (7.4%) 9.53 (9.7%) 1.1% ( -14% - 19%) 0.677 MedIntervalsOrdered 33.92 (4.9%) 34.32 (4.2%) 1.2% ( -7% - 10%) 0.412 AndHighMed 132.91 (5.1%) 135.21 (7.0%) 1.7% ( -9% - 14%) 0.375 HighIntervalsOrdered 25.36 (8.5%) 25.81 (7.0%) 1.7% ( -12% - 18%) 0.478 HighTermTitleBDVSort 82.25 (17.7%) 83.75 (12.8%) 1.8% ( -24% - 39%) 0.710 HighTermMonthSort 133.31 (13.6%) 135.96 (13.2%) 2.0% ( -21% - 33%) 0.638 AndHighHigh 65.89 (5.0%) 67.30 (7.3%) 2.1% ( -9% - 15%) 0.282 TermDTSort 69.38 (14.1%) 73.72 (12.3%) 6.3% ( -17% - 38%) 0.135 HighTermDayOfYearSort 43.49 (15.0%) 46.25 (18.9%) 6.3% ( -23% - 47%) 0.239 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org