zacharymorn commented on PR #1018:
URL: https://github.com/apache/lucene/pull/1018#issuecomment-1188708144
Latest `wikinightly` results:
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelTaxoFacets 33.93 (45.8%) 31.30
(42.6%) -7.8% ( -65% - 148%) 0.579
BrowseDayOfYearTaxoFacets 32.16 (32.2%) 30.75
(30.4%) -4.4% ( -50% - 86%) 0.659
BrowseDateTaxoFacets 32.06 (32.3%) 30.70
(30.5%) -4.2% ( -50% - 86%) 0.670
BrowseMonthTaxoFacets 30.50 (35.5%) 29.61
(32.4%) -2.9% ( -52% - 100%) 0.785
BrowseDayOfYearSSDVFacets 28.74 (12.2%) 28.22
(9.4%) -1.8% ( -20% - 22%) 0.598
TermDateFacets 74.31 (3.6%) 73.08
(2.6%) -1.7% ( -7% - 4%) 0.098
Wildcard 118.54 (4.7%) 116.74
(5.3%) -1.5% ( -10% - 8%) 0.338
MedTermDayTaxoFacets 83.35 (3.6%) 82.16
(2.7%) -1.4% ( -7% - 5%) 0.159
TermDayOfYearSort 143.35 (6.9%) 141.77
(5.4%) -1.1% ( -12% - 11%) 0.571
TermBGroup1M1P 55.30 (8.4%) 54.71
(7.6%) -1.1% ( -15% - 16%) 0.674
OrHighMedDayTaxoFacets 7.55 (4.0%) 7.47
(3.7%) -1.0% ( -8% - 7%) 0.397
TermDTSort 336.04 (4.7%) 332.86
(2.3%) -0.9% ( -7% - 6%) 0.418
SloppyPhrase 96.28 (6.5%) 95.51
(5.9%) -0.8% ( -12% - 12%) 0.686
PKLookup 332.42 (4.9%) 330.67
(5.9%) -0.5% ( -10% - 10%) 0.760
Prefix3 470.45 (5.4%) 468.31
(7.1%) -0.5% ( -12% - 12%) 0.820
AndHighHighDayTaxoFacets 7.07 (3.4%) 7.04
(3.2%) -0.4% ( -6% - 6%) 0.691
Respell 113.24 (2.4%) 112.80
(2.9%) -0.4% ( -5% - 4%) 0.641
Term 2898.31 (3.3%) 2888.15
(3.5%) -0.4% ( -6% - 6%) 0.744
TermTitleSort 356.75 (6.3%) 355.58
(5.7%) -0.3% ( -11% - 12%) 0.863
TermMonthSort 273.22 (6.3%) 272.54
(5.7%) -0.2% ( -11% - 12%) 0.896
TermGroup100 66.60 (4.2%) 66.45
(3.5%) -0.2% ( -7% - 7%) 0.850
Fuzzy2 101.30 (1.8%) 101.17
(2.5%) -0.1% ( -4% - 4%) 0.851
TermGroup10K 43.34 (3.7%) 43.28
(3.2%) -0.1% ( -6% - 7%) 0.908
AndHighMedDayTaxoFacets 39.86 (2.3%) 39.82
(2.5%) -0.1% ( -4% - 4%) 0.897
AndHighOrMedMed 74.95 (4.6%) 75.07
(4.3%) 0.2% ( -8% - 9%) 0.910
TermGroup1M 41.04 (3.4%) 41.12
(3.1%) 0.2% ( -6% - 6%) 0.840
TermBGroup1M 52.88 (3.7%) 53.00
(3.3%) 0.2% ( -6% - 7%) 0.837
AndHighHigh 43.55 (2.8%) 43.68
(2.9%) 0.3% ( -5% - 6%) 0.752
Fuzzy1 134.20 (1.5%) 134.59
(2.5%) 0.3% ( -3% - 4%) 0.657
Phrase 54.51 (3.5%) 54.72
(3.4%) 0.4% ( -6% - 7%) 0.722
AndHighMed 187.17 (3.2%) 188.13
(4.0%) 0.5% ( -6% - 7%) 0.658
AndMedOrHighHigh 90.65 (3.2%) 91.14
(4.2%) 0.5% ( -6% - 8%) 0.649
SpanNear 13.83 (1.3%) 13.92
(1.4%) 0.6% ( -2% - 3%) 0.140
IntervalsOrdered 4.75 (3.7%) 4.82
(3.6%) 1.4% ( -5% - 9%) 0.232
BrowseMonthSSDVFacets 28.45 (12.4%) 29.09
(11.1%) 2.2% ( -18% - 29%) 0.547
BrowseRandomLabelSSDVFacets 19.87 (8.0%) 20.32
(7.2%) 2.2% ( -11% - 18%) 0.351
IntNRQ 86.49 (11.5%) 89.75
(8.0%) 3.8% ( -14% - 26%) 0.230
BrowseDateSSDVFacets 4.10 (29.7%) 4.43
(31.0%) 8.1% ( -40% - 97%) 0.400
OrHighHigh 25.47 (4.5%) 37.72
(7.7%) 48.1% ( 34% - 63%) 0.000
OrHighMed 123.39 (4.2%) 238.58
(8.2%) 93.4% ( 77% - 110%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseDateSSDVFacets 4.01 (32.1%) 3.54
(27.6%) -11.7% ( -54% - 70%) 0.218
BrowseRandomLabelSSDVFacets 20.51 (5.6%) 20.03
(8.3%) -2.3% ( -15% - 12%) 0.298
BrowseDayOfYearSSDVFacets 27.79 (7.9%) 27.28
(12.5%) -1.8% ( -20% - 20%) 0.586
AndMedOrHighHigh 97.89 (3.4%) 96.34
(4.2%) -1.6% ( -8% - 6%) 0.193
Term 2973.05 (3.4%) 2928.04
(3.9%) -1.5% ( -8% - 5%) 0.192
AndHighOrMedMed 116.31 (4.6%) 114.84
(5.3%) -1.3% ( -10% - 9%) 0.420
TermDTSort 181.49 (6.4%) 179.67
(2.7%) -1.0% ( -9% - 8%) 0.516
IntNRQ 86.10 (11.0%) 85.26
(11.3%) -1.0% ( -20% - 23%) 0.784
AndHighMedDayTaxoFacets 97.10 (3.4%) 96.41
(3.8%) -0.7% ( -7% - 6%) 0.536
AndHighHigh 45.25 (3.2%) 44.95
(3.0%) -0.7% ( -6% - 5%) 0.482
Phrase 235.12 (1.6%) 233.52
(1.6%) -0.7% ( -3% - 2%) 0.185
BrowseMonthTaxoFacets 31.18 (33.7%) 30.98
(32.7%) -0.6% ( -50% - 99%) 0.951
AndHighMed 151.64 (3.5%) 150.76
(4.2%) -0.6% ( -7% - 7%) 0.635
PKLookup 334.62 (3.2%) 332.91
(2.5%) -0.5% ( -5% - 5%) 0.569
SpanNear 169.96 (2.7%) 169.29
(3.0%) -0.4% ( -5% - 5%) 0.666
IntervalsOrdered 10.71 (3.3%) 10.67
(3.9%) -0.3% ( -7% - 7%) 0.763
TermGroup1M 30.78 (2.8%) 30.77
(3.7%) -0.1% ( -6% - 6%) 0.961
SloppyPhrase 3.08 (2.9%) 3.08
(2.9%) 0.1% ( -5% - 6%) 0.936
Fuzzy1 165.92 (3.8%) 166.12
(2.6%) 0.1% ( -6% - 6%) 0.906
Wildcard 380.45 (5.5%) 380.95
(5.1%) 0.1% ( -9% - 11%) 0.938
Fuzzy2 124.51 (3.8%) 124.67
(3.0%) 0.1% ( -6% - 7%) 0.903
AndHighHighDayTaxoFacets 48.61 (1.9%) 48.69
(2.7%) 0.2% ( -4% - 4%) 0.817
TermGroup10K 41.21 (3.1%) 41.30
(3.9%) 0.2% ( -6% - 7%) 0.853
MedTermDayTaxoFacets 78.34 (3.7%) 78.53
(4.9%) 0.2% ( -8% - 9%) 0.860
TermBGroup1M 39.41 (3.2%) 39.55
(4.4%) 0.4% ( -7% - 8%) 0.760
TermDateFacets 48.53 (4.3%) 48.73
(5.6%) 0.4% ( -9% - 10%) 0.786
Prefix3 86.48 (6.9%) 87.05
(7.0%) 0.7% ( -12% - 15%) 0.765
OrHighMedDayTaxoFacets 13.63 (5.6%) 13.74
(8.8%) 0.8% ( -12% - 16%) 0.739
Respell 114.04 (3.5%) 115.01
(2.8%) 0.9% ( -5% - 7%) 0.393
BrowseMonthSSDVFacets 28.86 (8.2%) 29.13
(13.0%) 0.9% ( -18% - 24%) 0.785
TermGroup100 51.16 (3.4%) 51.87
(3.7%) 1.4% ( -5% - 8%) 0.212
TermDayOfYearSort 337.45 (4.4%) 342.73
(6.1%) 1.6% ( -8% - 12%) 0.354
TermBGroup1M1P 53.96 (6.2%) 55.14
(7.8%) 2.2% ( -11% - 17%) 0.326
TermTitleSort 274.15 (5.1%) 280.79
(8.5%) 2.4% ( -10% - 16%) 0.273
TermMonthSort 274.34 (5.2%) 281.56
(8.6%) 2.6% ( -10% - 17%) 0.244
BrowseDayOfYearTaxoFacets 28.20 (29.6%) 32.18
(38.2%) 14.1% ( -41% - 116%) 0.191
BrowseDateTaxoFacets 28.12 (29.8%) 32.09
(38.0%) 14.1% ( -41% - 116%) 0.191
BrowseRandomLabelTaxoFacets 28.70 (45.9%) 34.96
(57.5%) 21.8% ( -55% - 231%) 0.184
OrHighHigh 23.71 (5.6%) 29.52
(8.4%) 24.5% ( 9% - 40%) 0.000
OrHighMed 94.94 (5.7%) 202.03
(12.4%) 112.8% ( 89% - 138%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseMonthTaxoFacets 30.37 (34.3%) 27.82
(28.7%) -8.4% ( -53% - 83%) 0.403
BrowseDateSSDVFacets 4.43 (24.2%) 4.22
(24.5%) -4.9% ( -43% - 57%) 0.527
BrowseRandomLabelTaxoFacets 30.71 (47.3%) 30.00
(43.4%) -2.3% ( -63% - 167%) 0.872
TermTitleSort 359.13 (5.5%) 351.57
(3.0%) -2.1% ( -10% - 6%) 0.135
TermMonthSort 275.12 (5.6%) 269.40
(3.2%) -2.1% ( -10% - 7%) 0.148
TermDayOfYearSort 147.37 (8.1%) 145.09
(7.1%) -1.5% ( -15% - 14%) 0.521
OrHighMedDayTaxoFacets 17.50 (6.5%) 17.23
(7.8%) -1.5% ( -14% - 13%) 0.503
TermDTSort 342.08 (5.9%) 336.94
(3.0%) -1.5% ( -9% - 7%) 0.312
AndHighOrMedMed 124.08 (4.7%) 122.67
(4.9%) -1.1% ( -10% - 8%) 0.456
TermDateFacets 57.55 (3.3%) 57.01
(4.0%) -0.9% ( -7% - 6%) 0.418
MedTermDayTaxoFacets 76.93 (3.0%) 76.33
(3.9%) -0.8% ( -7% - 6%) 0.478
AndHighHighDayTaxoFacets 12.40 (2.6%) 12.31
(2.7%) -0.7% ( -5% - 4%) 0.417
TermGroup100 67.52 (3.5%) 67.10
(4.0%) -0.6% ( -7% - 7%) 0.600
AndHighHigh 102.82 (3.2%) 102.22
(4.5%) -0.6% ( -8% - 7%) 0.637
TermBGroup1M1P 63.36 (5.1%) 63.01
(6.1%) -0.5% ( -11% - 11%) 0.758
AndMedOrHighHigh 93.90 (4.9%) 93.40
(4.2%) -0.5% ( -9% - 8%) 0.710
IntervalsOrdered 23.51 (3.8%) 23.39
(4.1%) -0.5% ( -8% - 7%) 0.691
Fuzzy1 144.65 (2.6%) 144.10
(1.9%) -0.4% ( -4% - 4%) 0.607
PKLookup 333.86 (4.2%) 332.67
(4.5%) -0.4% ( -8% - 8%) 0.798
TermGroup10K 29.40 (2.8%) 29.30
(3.5%) -0.3% ( -6% - 6%) 0.727
Fuzzy2 101.53 (2.7%) 101.21
(1.6%) -0.3% ( -4% - 4%) 0.644
SpanNear 169.28 (2.5%) 168.87
(1.7%) -0.2% ( -4% - 4%) 0.726
TermBGroup1M 48.12 (3.0%) 48.01
(3.9%) -0.2% ( -6% - 6%) 0.837
Respell 97.43 (2.4%) 97.25
(1.8%) -0.2% ( -4% - 4%) 0.780
TermGroup1M 28.53 (2.8%) 28.49
(3.4%) -0.2% ( -6% - 6%) 0.878
AndHighMed 147.85 (4.3%) 147.86
(5.4%) 0.0% ( -9% - 10%) 0.996
IntNRQ 109.94 (0.4%) 109.99
(0.3%) 0.1% ( 0% - 0%) 0.670
BrowseRandomLabelSSDVFacets 21.13 (8.8%) 21.14
(6.0%) 0.1% ( -13% - 16%) 0.980
Term 3064.11 (3.3%) 3070.26
(3.4%) 0.2% ( -6% - 7%) 0.851
BrowseDayOfYearTaxoFacets 29.84 (32.2%) 29.90
(30.1%) 0.2% ( -46% - 92%) 0.983
BrowseDateTaxoFacets 29.74 (32.2%) 29.81
(30.2%) 0.2% ( -47% - 92%) 0.981
Phrase 38.99 (2.3%) 39.24
(2.3%) 0.6% ( -3% - 5%) 0.366
SloppyPhrase 7.47 (3.3%) 7.54
(2.6%) 0.9% ( -4% - 7%) 0.323
Prefix3 88.11 (6.5%) 89.06
(5.3%) 1.1% ( -10% - 13%) 0.569
AndHighMedDayTaxoFacets 207.09 (1.4%) 209.48
(1.9%) 1.2% ( -2% - 4%) 0.029
BrowseDayOfYearSSDVFacets 26.84 (9.0%) 27.25
(7.5%) 1.6% ( -13% - 19%) 0.551
BrowseMonthSSDVFacets 28.82 (11.4%) 29.29
(10.0%) 1.6% ( -17% - 25%) 0.636
Wildcard 382.86 (5.8%) 389.05
(4.4%) 1.6% ( -8% - 12%) 0.321
OrHighHigh 23.47 (6.4%) 28.73
(4.3%) 22.4% ( 11% - 35%) 0.000
OrHighMed 123.52 (6.6%) 237.11
(4.7%) 92.0% ( 75% - 110%) 0.000
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
