jpountz commented on PR #14064:
URL: https://github.com/apache/lucene/pull/14064#issuecomment-2541411484
Here are results on wikibigall for exhaustive evaluation (totalHitsThreshold
= Integer.MAX_VALUE) on both the baseline and the candidate:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
DismaxOrHighMed 11.07 (2.7%) 10.74
(7.2%) -3.1% ( -12% - 7%) 0.490
DismaxOrHighHigh 7.07 (2.3%) 6.87
(6.3%) -2.8% ( -11% - 5%) 0.473
TermDayOfYearSort 61.96 (1.2%) 60.35
(5.9%) -2.6% ( -9% - 4%) 0.457
CountTerm 9104.25 (1.8%) 8981.86
(5.8%) -1.3% ( -8% - 6%) 0.702
FilteredOr3Terms 49.73 (0.1%) 49.26
(0.6%) -0.9% ( -1% - 0%) 0.004
TermMonthSort 82.39 (2.6%) 81.69
(0.7%) -0.9% ( -3% - 2%) 0.580
AndMedOrHighHigh 38.01 (1.1%) 37.69
(1.4%) -0.8% ( -3% - 1%) 0.415
FilteredAndHighHigh 59.18 (1.0%) 58.70
(1.3%) -0.8% ( -3% - 1%) 0.383
TermDTSort 68.59 (0.2%) 68.10
(2.8%) -0.7% ( -3% - 2%) 0.661
FilteredOrHighMed 51.06 (1.2%) 50.70
(0.4%) -0.7% ( -2% - 0%) 0.355
TermTitleSort 72.64 (3.1%) 72.14
(1.2%) -0.7% ( -4% - 3%) 0.716
FilteredOrHighHigh 40.35 (1.5%) 40.07
(0.9%) -0.7% ( -3% - 1%) 0.496
CountPhrase 4.38 (2.5%) 4.36
(2.0%) -0.6% ( -4% - 3%) 0.745
FilteredTerm 102.23 (1.1%) 101.64
(0.9%) -0.6% ( -2% - 1%) 0.496
AndStopWords 15.41 (1.3%) 15.32
(1.2%) -0.5% ( -2% - 1%) 0.587
PKLookup 280.04 (4.0%) 278.60
(1.1%) -0.5% ( -5% - 4%) 0.831
AndHighMed 87.81 (0.7%) 87.38
(0.6%) -0.5% ( -1% - 0%) 0.379
CombinedAndHighMed 39.73 (1.5%) 39.56
(1.3%) -0.4% ( -3% - 2%) 0.723
Phrase 3.17 (2.1%) 3.16
(2.0%) -0.4% ( -4% - 3%) 0.812
FilteredAndStopWords 38.77 (1.1%) 38.63
(2.0%) -0.4% ( -3% - 2%) 0.775
AndHighHigh 26.39 (0.8%) 26.31
(0.3%) -0.3% ( -1% - 0%) 0.527
FilteredAndHighMed 128.37 (1.7%) 128.00
(1.1%) -0.3% ( -3% - 2%) 0.805
FilteredOrStopWords 19.92 (1.6%) 19.88
(1.1%) -0.2% ( -2% - 2%) 0.846
AndHighOrMedMed 32.18 (0.8%) 32.13
(1.7%) -0.2% ( -2% - 2%) 0.888
CombinedAndHighHigh 13.05 (1.5%) 13.05
(1.3%) -0.1% ( -2% - 2%) 0.956
CombinedTerm 33.12 (2.1%) 33.13
(2.5%) 0.0% ( -4% - 4%) 0.990
And2Terms2StopWords 74.18 (3.3%) 74.25
(4.2%) 0.1% ( -7% - 7%) 0.976
And3Terms 138.82 (0.2%) 139.00
(1.1%) 0.1% ( -1% - 1%) 0.847
FilteredAnd2Terms2StopWords 181.09 (1.3%) 181.36
(1.9%) 0.2% ( -3% - 3%) 0.910
DismaxTerm 49.84 (3.7%) 49.93
(6.5%) 0.2% ( -9% - 10%) 0.964
FilteredPhrase 22.64 (1.6%) 22.70
(0.7%) 0.3% ( -2% - 2%) 0.797
FilteredAnd3Terms 215.20 (2.3%) 215.92
(0.3%) 0.3% ( -2% - 3%) 0.807
IntNRQ 23.75 (1.7%) 23.83
(1.8%) 0.3% ( -3% - 3%) 0.819
Wildcard 17.54 (6.8%) 17.59
(2.9%) 0.3% ( -8% - 10%) 0.937
CountFilteredPhrase 25.56 (1.9%) 25.69
(0.7%) 0.5% ( -2% - 3%) 0.668
FilteredOr2Terms2StopWords 20.10 (2.0%) 20.24
(2.6%) 0.7% ( -3% - 5%) 0.715
FilteredIntNRQ 75.69 (1.6%) 76.26
(2.1%) 0.8% ( -2% - 4%) 0.619
CountFilteredOrHighHigh 56.18 (0.9%) 56.64
(1.6%) 0.8% ( -1% - 3%) 0.453
CountFilteredOrHighMed 66.38 (0.7%) 66.97
(0.8%) 0.9% ( 0% - 2%) 0.128
Term 83.10 (1.1%) 83.86
(1.2%) 0.9% ( -1% - 3%) 0.336
CountAndHighHigh 44.94 (0.5%) 45.37
(0.8%) 1.0% ( 0% - 2%) 0.080
CountAndHighMed 134.45 (1.6%) 135.79
(1.1%) 1.0% ( -1% - 3%) 0.367
Prefix3 14.57 (6.2%) 14.73
(3.0%) 1.1% ( -7% - 10%) 0.781
Fuzzy2 76.35 (3.0%) 77.41
(1.1%) 1.4% ( -2% - 5%) 0.449
FilteredOrMany 2.89 (3.3%) 2.94
(2.2%) 1.8% ( -3% - 7%) 0.432
CountFilteredOrMany 3.67 (3.5%) 3.74
(2.4%) 2.1% ( -3% - 8%) 0.399
Fuzzy1 74.54 (3.1%) 76.74
(1.1%) 3.0% ( -1% - 7%) 0.119
FilteredPrefix3 23.15 (2.3%) 23.86
(1.5%) 3.1% ( 0% - 7%) 0.055
CombinedOrHighMed 9.22 (4.4%) 9.96
(3.8%) 8.0% ( 0% - 16%) 0.017
CombinedOrHighHigh 6.01 (4.6%) 6.49
(3.8%) 8.0% ( 0% - 17%) 0.020
OrHighRare 23.21 (1.0%) 26.31
(2.3%) 13.3% ( 9% - 16%) 0.000
CountOrHighMed 110.01 (15.7%) 155.23
(5.0%) 41.1% ( 17% - 73%) 0.000
OrHighMed 20.78 (1.7%) 32.00
(5.0%) 54.0% ( 46% - 61%) 0.000
Or3Terms 27.82 (2.1%) 43.10
(3.5%) 54.9% ( 48% - 61%) 0.000
OrHighHigh 14.00 (1.5%) 22.67
(5.4%) 61.9% ( 54% - 69%) 0.000
CountOrMany 5.70 (21.8%) 9.25
(8.5%) 62.3% ( 26% - 118%) 0.000
CountOrHighHigh 57.35 (23.4%) 98.21
(9.0%) 71.2% ( 31% - 135%) 0.000
OrStopWords 6.86 (0.6%) 11.92
(6.7%) 73.8% ( 66% - 81%) 0.000
Or2Terms2StopWords 5.91 (1.1%) 10.33
(7.6%) 74.8% ( 65% - 84%) 0.000
OrMany 1.85 (1.0%) 3.40
(13.6%) 84.3% ( 68% - 99%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
