jpountz commented on PR #14293:
URL: https://github.com/apache/lucene/pull/14293#issuecomment-2683464574
Same dataset but with 5% docs deleted this time and #14294 applied on both
the baseline and the candidate:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
TermMonthSort 3275.67 (2.5%) 2974.27
(2.2%) -9.2% ( -13% - -4%) 0.000
IntNRQ 302.63 (1.5%) 292.99
(1.0%) -3.2% ( -5% - 0%) 0.000
FilteredIntNRQ 294.31 (1.6%) 285.28
(1.2%) -3.1% ( -5% - 0%) 0.000
Prefix3 134.96 (2.8%) 133.43
(3.7%) -1.1% ( -7% - 5%) 0.438
FilteredPrefix3 128.98 (2.9%) 127.64
(3.3%) -1.0% ( -6% - 5%) 0.449
CountFilteredPhrase 27.07 (1.9%) 26.87
(2.8%) -0.7% ( -5% - 4%) 0.504
AndHighOrMedMed 45.77 (0.7%) 45.46
(1.5%) -0.7% ( -2% - 1%) 0.193
CountPhrase 4.35 (2.2%) 4.32
(2.8%) -0.7% ( -5% - 4%) 0.550
FilteredOrHighHigh 67.56 (1.9%) 67.17
(2.0%) -0.6% ( -4% - 3%) 0.509
FilteredPhrase 33.43 (1.5%) 33.27
(1.8%) -0.5% ( -3% - 2%) 0.509
AndHighHigh 41.58 (1.3%) 41.39
(2.5%) -0.4% ( -4% - 3%) 0.622
FilteredOrStopWords 46.53 (2.4%) 46.35
(2.5%) -0.4% ( -5% - 4%) 0.717
AndHighMed 122.26 (1.0%) 121.85
(2.6%) -0.3% ( -3% - 3%) 0.705
Fuzzy1 80.15 (1.3%) 79.88
(2.9%) -0.3% ( -4% - 3%) 0.739
FilteredOr3Terms 161.01 (0.8%) 160.49
(1.4%) -0.3% ( -2% - 1%) 0.529
Fuzzy2 75.56 (1.4%) 75.35
(2.6%) -0.3% ( -4% - 3%) 0.764
FilteredOr2Terms2StopWords 146.81 (1.1%) 146.50
(1.7%) -0.2% ( -2% - 2%) 0.741
CountAndHighHigh 307.68 (1.7%) 307.05
(1.6%) -0.2% ( -3% - 3%) 0.778
Wildcard 74.61 (2.2%) 74.48
(2.8%) -0.2% ( -5% - 4%) 0.879
CountOrMany 29.88 (2.0%) 29.84
(1.9%) -0.1% ( -3% - 3%) 0.863
FilteredOrHighMed 155.01 (0.9%) 154.82
(1.2%) -0.1% ( -2% - 2%) 0.791
AndMedOrHighHigh 64.70 (2.1%) 64.63
(2.1%) -0.1% ( -4% - 4%) 0.914
CountOrHighMed 418.10 (1.6%) 417.85
(1.7%) -0.1% ( -3% - 3%) 0.935
CountAndHighMed 287.90 (1.6%) 287.77
(1.3%) -0.0% ( -2% - 2%) 0.946
CountFilteredOrHighMed 118.11 (0.5%) 118.08
(0.5%) -0.0% ( -1% - 1%) 0.908
OrHighHigh 48.49 (2.1%) 48.49
(3.5%) -0.0% ( -5% - 5%) 0.997
CountFilteredOrHighHigh 106.97 (0.7%) 106.99
(0.7%) 0.0% ( -1% - 1%) 0.962
FilteredOrMany 17.52 (1.6%) 17.54
(1.3%) 0.1% ( -2% - 3%) 0.855
CombinedOrHighHigh 19.32 (2.1%) 19.36
(1.2%) 0.2% ( -2% - 3%) 0.764
CombinedAndHighHigh 15.56 (1.8%) 15.60
(2.2%) 0.3% ( -3% - 4%) 0.774
CombinedTerm 31.62 (2.0%) 31.71
(1.0%) 0.3% ( -2% - 3%) 0.681
CountOrHighHigh 304.90 (1.7%) 305.77
(2.1%) 0.3% ( -3% - 4%) 0.739
CombinedAndHighMed 57.31 (1.6%) 57.48
(2.1%) 0.3% ( -3% - 4%) 0.725
OrHighMed 182.65 (2.0%) 183.40
(3.4%) 0.4% ( -4% - 5%) 0.743
DismaxOrHighMed 164.06 (1.3%) 164.74
(1.9%) 0.4% ( -2% - 3%) 0.577
CombinedOrHighMed 73.24 (1.6%) 73.65
(1.0%) 0.6% ( -1% - 3%) 0.338
FilteredAnd3Terms 191.89 (2.5%) 193.07
(1.7%) 0.6% ( -3% - 4%) 0.519
CountFilteredOrMany 25.99 (1.3%) 26.17
(1.3%) 0.7% ( -1% - 3%) 0.230
FilteredTerm 155.92 (2.0%) 157.02
(2.5%) 0.7% ( -3% - 5%) 0.493
PKLookup 264.18 (1.3%) 266.20
(2.1%) 0.8% ( -2% - 4%) 0.325
Term 442.84 (3.4%) 446.23
(3.5%) 0.8% ( -5% - 7%) 0.619
FilteredAnd2Terms2StopWords 198.39 (2.1%) 200.23
(0.8%) 0.9% ( -1% - 3%) 0.189
OrMany 18.89 (4.1%) 19.08
(3.7%) 1.0% ( -6% - 9%) 0.557
Phrase 14.87 (6.4%) 15.05
(6.0%) 1.2% ( -10% - 14%) 0.661
DismaxOrHighHigh 112.13 (2.6%) 113.73
(2.0%) 1.4% ( -3% - 6%) 0.165
FilteredAndHighHigh 68.35 (4.0%) 69.41
(0.7%) 1.5% ( -3% - 6%) 0.231
FilteredAndHighMed 127.69 (3.4%) 129.82
(1.6%) 1.7% ( -3% - 6%) 0.165
FilteredAndStopWords 54.67 (4.4%) 55.60
(1.0%) 1.7% ( -3% - 7%) 0.231
Or2Terms2StopWords 153.15 (4.1%) 155.83
(2.0%) 1.8% ( -4% - 8%) 0.222
And2Terms2StopWords 156.52 (3.4%) 159.34
(1.6%) 1.8% ( -3% - 7%) 0.128
And3Terms 168.24 (3.2%) 171.55
(2.1%) 2.0% ( -3% - 7%) 0.104
Or3Terms 161.16 (3.5%) 164.43
(2.0%) 2.0% ( -3% - 7%) 0.117
DismaxTerm 531.13 (2.2%) 542.04
(3.0%) 2.1% ( -3% - 7%) 0.078
TermTitleSort 142.97 (1.5%) 145.96
(1.9%) 2.1% ( -1% - 5%) 0.006
AndStopWords 30.17 (5.6%) 30.85
(2.4%) 2.3% ( -5% - 10%) 0.240
OrStopWords 30.90 (5.9%) 31.68
(3.1%) 2.5% ( -6% - 12%) 0.237
OrHighRare 256.93 (8.3%) 266.71
(7.1%) 3.8% ( -10% - 20%) 0.270
TermDayOfYearSort 584.17 (2.2%) 655.16
(1.8%) 12.2% ( 8% - 16%) 0.000
TermDTSort 263.14 (8.5%) 494.06
(3.5%) 87.8% ( 69% - 109%) 0.000
CountTerm 156.94 (1.2%) 673.10
(9.2%) 328.9% ( 314% - 343%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
