zacharymorn commented on PR #1018:
URL: https://github.com/apache/lucene/pull/1018#issuecomment-1188612201
Here are the latest benchmark results:
`wikinightly`
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
TermBGroup1M1P 55.21 (7.3%) 53.75
(5.5%) -2.6% ( -14% - 11%) 0.200
PKLookup 330.25 (4.3%) 326.53
(3.9%) -1.1% ( -8% - 7%) 0.387
TermDateFacets 71.88 (4.7%) 71.13
(4.8%) -1.0% ( -10% - 8%) 0.487
MedTermDayTaxoFacets 77.44 (4.5%) 76.67
(4.8%) -1.0% ( -9% - 8%) 0.502
IntNRQ 1216.26 (2.5%) 1207.48
(2.8%) -0.7% ( -5% - 4%) 0.387
AndHighHighDayTaxoFacets 13.63 (2.2%) 13.55
(2.6%) -0.5% ( -5% - 4%) 0.471
SpanNear 28.99 (3.4%) 28.86
(2.6%) -0.5% ( -6% - 5%) 0.621
Fuzzy1 142.65 (1.4%) 142.01
(1.5%) -0.4% ( -3% - 2%) 0.333
TermDTSort 142.65 (3.1%) 142.02
(2.9%) -0.4% ( -6% - 5%) 0.644
Respell 96.15 (1.5%) 95.76
(2.0%) -0.4% ( -3% - 3%) 0.483
TermBGroup1M 52.81 (3.0%) 52.60
(4.1%) -0.4% ( -7% - 6%) 0.731
TermDayOfYearSort 259.79 (3.1%) 258.78
(2.8%) -0.4% ( -6% - 5%) 0.681
TermMonthSort 275.05 (6.2%) 274.05
(7.0%) -0.4% ( -12% - 13%) 0.861
TermGroup10K 43.13 (2.8%) 42.98
(3.8%) -0.4% ( -6% - 6%) 0.731
Term 2665.46 (4.2%) 2656.78
(4.1%) -0.3% ( -8% - 8%) 0.803
TermGroup100 66.52 (3.4%) 66.35
(4.2%) -0.3% ( -7% - 7%) 0.834
TermGroup1M 30.69 (2.5%) 30.62
(3.5%) -0.3% ( -6% - 5%) 0.792
TermTitleSort 190.21 (6.2%) 189.75
(7.0%) -0.2% ( -12% - 13%) 0.908
Fuzzy2 83.28 (1.7%) 83.17
(1.9%) -0.1% ( -3% - 3%) 0.809
AndHighOrMedMed 73.32 (5.9%) 73.41
(5.7%) 0.1% ( -10% - 12%) 0.946
IntervalsOrdered 4.63 (4.0%) 4.64
(4.0%) 0.2% ( -7% - 8%) 0.877
AndHighMedDayTaxoFacets 48.94 (2.1%) 49.06
(2.6%) 0.2% ( -4% - 5%) 0.743
AndMedOrHighHigh 72.55 (5.1%) 72.74
(4.7%) 0.3% ( -9% - 10%) 0.863
BrowseDayOfYearSSDVFacets 26.43 (5.6%) 26.51
(4.2%) 0.3% ( -9% - 10%) 0.837
Phrase 53.31 (4.7%) 53.49
(4.9%) 0.3% ( -8% - 10%) 0.820
Prefix3 416.08 (9.2%) 417.57
(9.1%) 0.4% ( -16% - 20%) 0.901
BrowseMonthSSDVFacets 30.34 (11.6%) 30.58
(12.5%) 0.8% ( -20% - 28%) 0.836
SloppyPhrase 4.71 (3.7%) 4.75
(3.6%) 0.9% ( -6% - 8%) 0.427
BrowseRandomLabelSSDVFacets 20.64 (6.6%) 20.83
(5.7%) 0.9% ( -10% - 14%) 0.630
AndHighMed 111.69 (3.5%) 113.66
(3.3%) 1.8% ( -4% - 8%) 0.101
AndHighHigh 102.15 (3.4%) 104.05
(3.3%) 1.9% ( -4% - 8%) 0.079
Wildcard 162.58 (7.6%) 165.88
(5.6%) 2.0% ( -10% - 16%) 0.337
OrHighMedDayTaxoFacets 22.45 (5.7%) 22.96
(4.7%) 2.3% ( -7% - 13%) 0.174
BrowseDateSSDVFacets 4.24 (32.2%) 4.44
(30.1%) 4.7% ( -43% - 98%) 0.630
BrowseDayOfYearTaxoFacets 27.90 (31.8%) 29.47
(33.8%) 5.6% ( -45% - 104%) 0.586
BrowseDateTaxoFacets 27.82 (31.8%) 29.39
(33.9%) 5.7% ( -45% - 104%) 0.587
OrHighHigh 21.30 (5.9%) 22.64
(5.3%) 6.3% ( -4% - 18%) 0.000
BrowseRandomLabelTaxoFacets 28.61 (48.5%) 30.61
(50.4%) 7.0% ( -61% - 205%) 0.656
BrowseMonthTaxoFacets 27.81 (33.3%) 30.05
(38.0%) 8.1% ( -47% - 118%) 0.475
OrHighMed 122.60 (6.1%) 234.50
(7.2%) 91.3% ( 73% - 111%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
Term 2669.38 (2.9%) 2616.83
(3.4%) -2.0% ( -8% - 4%) 0.052
Respell 92.34 (1.9%) 91.09
(4.3%) -1.4% ( -7% - 4%) 0.193
TermBGroup1M1P 54.70 (6.9%) 53.97
(5.5%) -1.3% ( -12% - 11%) 0.504
AndMedOrHighHigh 94.36 (4.8%) 93.33
(3.5%) -1.1% ( -8% - 7%) 0.412
TermDayOfYearSort 144.09 (7.0%) 142.80
(6.2%) -0.9% ( -13% - 13%) 0.671
TermDateFacets 73.65 (5.5%) 73.07
(4.5%) -0.8% ( -10% - 9%) 0.623
BrowseRandomLabelTaxoFacets 35.63 (43.4%) 35.40
(39.9%) -0.6% ( -58% - 145%) 0.962
BrowseMonthSSDVFacets 29.40 (16.0%) 29.21
(14.3%) -0.6% ( -26% - 35%) 0.895
MedTermDayTaxoFacets 76.37 (5.1%) 75.90
(4.1%) -0.6% ( -9% - 9%) 0.677
Fuzzy1 79.86 (1.9%) 79.43
(2.5%) -0.5% ( -4% - 3%) 0.452
Fuzzy2 83.54 (1.6%) 83.11
(2.9%) -0.5% ( -4% - 4%) 0.481
TermBGroup1M 52.98 (3.3%) 52.73
(2.9%) -0.5% ( -6% - 5%) 0.625
IntNRQ 108.80 (3.5%) 108.38
(4.5%) -0.4% ( -8% - 7%) 0.762
TermGroup10K 41.18 (3.1%) 41.02
(2.6%) -0.4% ( -5% - 5%) 0.670
AndHighMed 152.45 (4.7%) 151.90
(3.9%) -0.4% ( -8% - 8%) 0.791
TermGroup1M 30.72 (3.0%) 30.62
(2.7%) -0.3% ( -5% - 5%) 0.705
Wildcard 376.05 (5.6%) 374.87
(5.1%) -0.3% ( -10% - 10%) 0.853
AndHighHighDayTaxoFacets 13.80 (3.1%) 13.75
(2.9%) -0.3% ( -6% - 5%) 0.746
AndHighHigh 58.98 (3.4%) 58.81
(2.8%) -0.3% ( -6% - 6%) 0.769
TermGroup100 28.40 (4.0%) 28.34
(3.6%) -0.2% ( -7% - 7%) 0.859
Phrase 116.22 (5.8%) 115.97
(4.4%) -0.2% ( -9% - 10%) 0.898
BrowseDayOfYearSSDVFacets 28.12 (14.0%) 28.07
(12.1%) -0.2% ( -23% - 30%) 0.969
AndHighMedDayTaxoFacets 48.87 (3.7%) 48.86
(3.2%) -0.0% ( -6% - 7%) 0.985
TermMonthSort 151.67 (6.4%) 151.88
(7.1%) 0.1% ( -12% - 14%) 0.949
BrowseDateSSDVFacets 4.32 (27.8%) 4.33
(30.4%) 0.1% ( -45% - 80%) 0.987
TermDTSort 179.58 (7.1%) 179.85
(6.2%) 0.2% ( -12% - 14%) 0.943
SpanNear 28.81 (3.1%) 28.89
(2.9%) 0.3% ( -5% - 6%) 0.773
TermTitleSort 151.58 (6.5%) 152.05
(7.2%) 0.3% ( -12% - 14%) 0.885
PKLookup 330.34 (3.2%) 331.57
(4.0%) 0.4% ( -6% - 7%) 0.747
IntervalsOrdered 13.18 (3.1%) 13.24
(2.7%) 0.5% ( -5% - 6%) 0.622
AndHighOrMedMed 93.13 (5.6%) 93.72
(4.2%) 0.6% ( -8% - 11%) 0.683
Prefix3 310.09 (7.7%) 312.54
(6.4%) 0.8% ( -12% - 16%) 0.723
OrHighMedDayTaxoFacets 16.36 (5.8%) 16.49
(3.8%) 0.8% ( -8% - 11%) 0.611
SloppyPhrase 3.03 (3.9%) 3.07
(4.6%) 1.1% ( -7% - 10%) 0.399
BrowseRandomLabelSSDVFacets 19.56 (8.6%) 19.86
(6.7%) 1.5% ( -12% - 18%) 0.537
BrowseDateTaxoFacets 33.74 (31.5%) 34.42
(29.7%) 2.0% ( -44% - 92%) 0.833
BrowseDayOfYearTaxoFacets 33.86 (31.4%) 34.57
(29.6%) 2.1% ( -44% - 91%) 0.827
BrowseMonthTaxoFacets 29.99 (35.1%) 31.87
(36.1%) 6.3% ( -48% - 119%) 0.577
OrHighHigh 117.79 (4.4%) 159.21
(7.4%) 35.2% ( 22% - 49%) 0.000
OrHighMed 92.34 (4.9%) 202.28
(4.6%) 119.1% ( 104% - 135%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelTaxoFacets 33.74 (47.0%) 31.68
(45.2%) -6.1% ( -66% - 162%) 0.676
BrowseDayOfYearTaxoFacets 31.93 (32.8%) 30.33
(29.1%) -5.0% ( -50% - 84%) 0.609
BrowseDateTaxoFacets 31.86 (32.8%) 30.28
(29.2%) -5.0% ( -50% - 84%) 0.612
OrHighMedDayTaxoFacets 15.55 (5.2%) 15.03
(8.5%) -3.3% ( -16% - 10%) 0.137
TermBGroup1M1P 86.03 (7.1%) 83.43
(6.6%) -3.0% ( -15% - 11%) 0.163
TermDateFacets 74.21 (5.2%) 72.42
(4.2%) -2.4% ( -11% - 7%) 0.103
MedTermDayTaxoFacets 77.74 (4.9%) 76.01
(4.0%) -2.2% ( -10% - 6%) 0.116
AndMedOrHighHigh 94.98 (4.3%) 93.03
(4.3%) -2.1% ( -10% - 6%) 0.131
Wildcard 114.27 (5.6%) 112.61
(6.1%) -1.4% ( -12% - 10%) 0.437
Prefix3 446.55 (9.5%) 440.60
(9.9%) -1.3% ( -18% - 19%) 0.664
TermGroup100 36.29 (3.6%) 35.82
(3.3%) -1.3% ( -7% - 5%) 0.235
AndHighHighDayTaxoFacets 13.85 (2.7%) 13.68
(2.5%) -1.2% ( -6% - 4%) 0.158
TermGroup10K 29.40 (3.4%) 29.07
(3.5%) -1.1% ( -7% - 5%) 0.297
BrowseMonthSSDVFacets 28.03 (6.9%) 27.74
(7.7%) -1.0% ( -14% - 14%) 0.651
AndHighMedDayTaxoFacets 126.53 (1.8%) 125.24
(1.6%) -1.0% ( -4% - 2%) 0.054
TermBGroup1M 48.03 (3.8%) 47.54
(3.9%) -1.0% ( -8% - 6%) 0.402
PKLookup 332.31 (4.3%) 329.17
(4.5%) -0.9% ( -9% - 8%) 0.499
Fuzzy2 83.69 (1.7%) 82.90
(1.3%) -0.9% ( -3% - 2%) 0.051
Respell 92.13 (2.2%) 91.32
(2.2%) -0.9% ( -5% - 3%) 0.204
TermGroup1M 30.90 (3.3%) 30.69
(3.6%) -0.7% ( -7% - 6%) 0.531
Fuzzy1 79.86 (2.0%) 79.34
(1.6%) -0.7% ( -4% - 2%) 0.247
Term 2990.17 (3.1%) 2970.74
(3.8%) -0.6% ( -7% - 6%) 0.555
AndHighOrMedMed 115.42 (5.3%) 114.79
(5.1%) -0.5% ( -10% - 10%) 0.743
BrowseRandomLabelSSDVFacets 20.49 (7.9%) 20.40
(6.1%) -0.4% ( -13% - 14%) 0.840
SpanNear 13.81 (1.6%) 13.75
(2.0%) -0.4% ( -3% - 3%) 0.502
IntNRQ 86.13 (10.7%) 85.82
(10.6%) -0.4% ( -19% - 23%) 0.915
BrowseDateSSDVFacets 4.09 (28.7%) 4.08
(35.0%) -0.1% ( -49% - 89%) 0.990
SloppyPhrase 7.40 (4.1%) 7.40
(5.0%) 0.0% ( -8% - 9%) 0.990
Phrase 233.57 (1.8%) 233.64
(2.5%) 0.0% ( -4% - 4%) 0.969
TermMonthSort 358.08 (6.7%) 358.32
(6.6%) 0.1% ( -12% - 14%) 0.975
TermTitleSort 150.28 (6.8%) 150.47
(6.7%) 0.1% ( -12% - 14%) 0.953
AndHighMed 147.66 (4.7%) 147.95
(4.8%) 0.2% ( -8% - 10%) 0.896
IntervalsOrdered 13.32 (2.7%) 13.36
(3.0%) 0.3% ( -5% - 6%) 0.700
AndHighHigh 103.39 (3.0%) 104.13
(3.8%) 0.7% ( -5% - 7%) 0.507
TermDTSort 258.56 (2.7%) 262.00
(4.4%) 1.3% ( -5% - 8%) 0.252
BrowseDayOfYearSSDVFacets 27.36 (10.7%) 27.79
(12.0%) 1.5% ( -19% - 27%) 0.667
TermDayOfYearSort 179.29 (2.7%) 183.28
(6.5%) 2.2% ( -6% - 11%) 0.155
BrowseMonthTaxoFacets 29.51 (34.8%) 30.53
(36.6%) 3.5% ( -50% - 114%) 0.759
OrHighHigh 21.24 (5.5%) 23.29
(4.4%) 9.6% ( 0% - 20%) 0.000
OrHighMed 104.45 (4.5%) 179.87
(6.2%) 72.2% ( 58% - 86%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseDateSSDVFacets 4.17 (34.3%) 3.84
(28.0%) -7.7% ( -52% - 82%) 0.434
OrHighMedDayTaxoFacets 14.02 (6.8%) 13.43
(8.4%) -4.2% ( -18% - 11%) 0.083
TermBGroup1M1P 55.17 (5.8%) 53.96
(5.7%) -2.2% ( -12% - 9%) 0.228
TermDTSort 145.63 (6.5%) 142.48
(4.9%) -2.2% ( -12% - 9%) 0.235
TermDateFacets 42.01 (5.0%) 41.29
(4.2%) -1.7% ( -10% - 7%) 0.242
MedTermDayTaxoFacets 80.14 (4.6%) 79.08
(3.8%) -1.3% ( -9% - 7%) 0.321
AndHighOrMedMed 71.35 (4.6%) 70.62
(4.2%) -1.0% ( -9% - 8%) 0.461
TermGroup100 66.73 (3.7%) 66.10
(2.8%) -0.9% ( -7% - 5%) 0.360
AndHighMed 180.25 (4.2%) 178.84
(4.0%) -0.8% ( -8% - 7%) 0.547
AndHighHighDayTaxoFacets 12.43 (2.7%) 12.34
(3.0%) -0.7% ( -6% - 5%) 0.427
AndHighHigh 56.34 (2.9%) 55.95
(3.3%) -0.7% ( -6% - 5%) 0.471
IntervalsOrdered 13.41 (2.8%) 13.33
(2.9%) -0.6% ( -6% - 5%) 0.526
SpanNear 16.50 (3.9%) 16.44
(3.7%) -0.4% ( -7% - 7%) 0.763
AndHighMedDayTaxoFacets 202.68 (3.4%) 202.03
(2.9%) -0.3% ( -6% - 6%) 0.748
AndMedOrHighHigh 34.43 (4.0%) 34.33
(3.3%) -0.3% ( -7% - 7%) 0.802
TermTitleSort 192.31 (8.2%) 192.06
(7.8%) -0.1% ( -14% - 17%) 0.959
SloppyPhrase 3.05 (4.9%) 3.05
(4.8%) -0.1% ( -9% - 10%) 0.966
Fuzzy2 82.49 (2.1%) 82.45
(2.5%) -0.0% ( -4% - 4%) 0.945
TermGroup10K 28.82 (3.2%) 28.85
(3.3%) 0.1% ( -6% - 6%) 0.916
Fuzzy1 132.62 (2.6%) 132.85
(3.2%) 0.2% ( -5% - 6%) 0.850
TermMonthSort 277.44 (8.5%) 278.02
(7.8%) 0.2% ( -14% - 18%) 0.936
TermBGroup1M 52.20 (3.8%) 52.35
(3.8%) 0.3% ( -7% - 8%) 0.810
TermGroup1M 30.38 (3.3%) 30.49
(3.2%) 0.3% ( -5% - 7%) 0.737
Phrase 38.94 (2.3%) 39.12
(2.4%) 0.5% ( -4% - 5%) 0.537
Wildcard 115.40 (5.4%) 115.96
(4.6%) 0.5% ( -9% - 11%) 0.759
BrowseMonthSSDVFacets 28.92 (11.0%) 29.15
(10.4%) 0.8% ( -18% - 24%) 0.816
Prefix3 85.45 (7.2%) 86.13
(6.3%) 0.8% ( -11% - 15%) 0.708
Respell 110.22 (2.8%) 111.23
(3.4%) 0.9% ( -5% - 7%) 0.352
IntNRQ 262.90 (3.5%) 265.31
(1.0%) 0.9% ( -3% - 5%) 0.265
PKLookup 320.06 (5.5%) 323.50
(4.0%) 1.1% ( -8% - 11%) 0.483
TermDayOfYearSort 179.37 (2.7%) 181.62
(6.8%) 1.3% ( -8% - 11%) 0.444
BrowseDayOfYearSSDVFacets 26.62 (9.4%) 27.06
(7.5%) 1.7% ( -13% - 20%) 0.532
Term 2968.74 (3.9%) 3023.70
(4.8%) 1.9% ( -6% - 10%) 0.181
BrowseRandomLabelSSDVFacets 20.13 (8.1%) 20.54
(5.3%) 2.0% ( -10% - 16%) 0.351
BrowseMonthTaxoFacets 31.83 (35.1%) 35.00
(34.9%) 10.0% ( -44% - 123%) 0.367
BrowseDayOfYearTaxoFacets 31.92 (32.2%) 35.50
(33.2%) 11.2% ( -41% - 113%) 0.279
BrowseDateTaxoFacets 31.66 (32.1%) 35.33
(33.5%) 11.6% ( -40% - 113%) 0.265
BrowseRandomLabelTaxoFacets 33.49 (47.5%) 39.38
(49.7%) 17.6% ( -53% - 218%) 0.253
OrHighHigh 22.47 (5.2%) 28.61
(6.6%) 27.3% ( 14% - 41%) 0.000
OrHighMed 101.24 (4.5%) 177.10
(7.9%) 74.9% ( 59% - 91%) 0.000
```
`wikimedium.10M.nostopwords.tasks`
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
OrNotHighLow 2404.13 (4.6%) 2299.23
(5.1%) -4.4% ( -13% - 5%) 0.005
BrowseDateSSDVFacets 4.46 (28.1%) 4.27
(31.3%) -4.2% ( -49% - 76%) 0.652
OrHighNotHigh 1446.94 (4.2%) 1386.64
(5.1%) -4.2% ( -12% - 5%) 0.005
OrHighNotMed 1877.72 (4.6%) 1805.21
(5.2%) -3.9% ( -13% - 6%) 0.013
OrHighNotLow 2076.24 (4.2%) 2001.55
(4.8%) -3.6% ( -12% - 5%) 0.012
OrNotHighHigh 1699.54 (4.3%) 1644.55
(5.3%) -3.2% ( -12% - 6%) 0.034
OrNotHighMed 1954.82 (3.4%) 1892.58
(5.0%) -3.2% ( -11% - 5%) 0.018
PKLookup 328.78 (3.3%) 322.32
(3.4%) -2.0% ( -8% - 4%) 0.063
HighTerm 3905.19 (5.7%) 3853.68
(5.2%) -1.3% ( -11% - 10%) 0.444
HighPhrase 207.95 (1.5%) 205.38
(3.0%) -1.2% ( -5% - 3%) 0.105
BrowseDayOfYearSSDVFacets 27.87 (12.6%) 27.53
(11.8%) -1.2% ( -22% - 26%) 0.753
MedTerm 3822.96 (4.9%) 3776.97
(4.9%) -1.2% ( -10% - 9%) 0.438
Respell 102.98 (2.9%) 101.77
(2.3%) -1.2% ( -6% - 4%) 0.149
AndHighLow 1571.52 (4.7%) 1553.47
(5.5%) -1.1% ( -10% - 9%) 0.478
AndHighMed 227.66 (5.7%) 225.31
(5.4%) -1.0% ( -11% - 10%) 0.557
LowPhrase 428.47 (1.8%) 424.84
(2.6%) -0.8% ( -5% - 3%) 0.228
OrHighLow 849.69 (3.8%) 842.60
(5.2%) -0.8% ( -9% - 8%) 0.562
MedPhrase 576.49 (2.0%) 571.79
(3.1%) -0.8% ( -5% - 4%) 0.323
HighSloppyPhrase 33.43 (2.6%) 33.17
(3.2%) -0.8% ( -6% - 5%) 0.405
AndHighHigh 187.93 (3.8%) 186.51
(4.0%) -0.8% ( -8% - 7%) 0.539
AndHighMedDayTaxoFacets 285.75 (1.9%) 283.72
(2.8%) -0.7% ( -5% - 4%) 0.351
MedSloppyPhrase 47.37 (3.3%) 47.09
(3.8%) -0.6% ( -7% - 6%) 0.601
AndHighHighDayTaxoFacets 18.77 (2.4%) 18.67
(2.7%) -0.5% ( -5% - 4%) 0.506
Fuzzy1 142.64 (2.0%) 142.02
(2.1%) -0.4% ( -4% - 3%) 0.509
LowSloppyPhrase 43.92 (2.4%) 43.75
(2.8%) -0.4% ( -5% - 4%) 0.636
HighTermMonthSort 281.77 (8.3%) 280.80
(7.0%) -0.3% ( -14% - 16%) 0.888
IntNRQ 165.10 (0.6%) 164.79
(1.1%) -0.2% ( -1% - 1%) 0.519
MedIntervalsOrdered 10.38 (2.6%) 10.36
(3.4%) -0.2% ( -6% - 5%) 0.853
LowSpanNear 54.15 (2.5%) 54.13
(3.1%) -0.0% ( -5% - 5%) 0.973
Fuzzy2 92.62 (1.6%) 92.62
(2.3%) -0.0% ( -3% - 3%) 0.997
LowIntervalsOrdered 118.97 (2.9%) 118.99
(4.1%) 0.0% ( -6% - 7%) 0.990
MedTermDayTaxoFacets 32.39 (4.9%) 32.43
(4.6%) 0.1% ( -8% - 10%) 0.934
Wildcard 233.39 (4.6%) 233.76
(4.0%) 0.2% ( -8% - 9%) 0.907
LowTerm 3211.79 (4.7%) 3223.51
(6.5%) 0.4% ( -10% - 12%) 0.839
MedSpanNear 12.89 (3.4%) 12.94
(3.5%) 0.4% ( -6% - 7%) 0.738
Prefix3 307.89 (9.1%) 309.73
(6.8%) 0.6% ( -13% - 18%) 0.814
BrowseRandomLabelSSDVFacets 20.03 (10.4%) 20.17
(8.0%) 0.7% ( -16% - 21%) 0.808
HighTermDayOfYearSort 238.75 (10.4%) 241.59
(8.9%) 1.2% ( -16% - 22%) 0.697
HighIntervalsOrdered 2.60 (9.0%) 2.64
(11.0%) 1.4% ( -17% - 23%) 0.664
TermDTSort 263.12 (7.1%) 266.86
(9.3%) 1.4% ( -14% - 19%) 0.587
BrowseMonthSSDVFacets 29.11 (15.3%) 29.53
(14.0%) 1.5% ( -24% - 36%) 0.753
HighSpanNear 1.96 (6.7%) 2.00
(7.1%) 1.6% ( -11% - 16%) 0.449
BrowseMonthTaxoFacets 32.60 (33.4%) 33.31
(33.4%) 2.2% ( -48% - 103%) 0.838
OrHighMedDayTaxoFacets 23.06 (10.7%) 23.68
(6.7%) 2.7% ( -13% - 22%) 0.338
HighTermTitleBDVSort 132.63 (7.9%) 136.49
(11.2%) 2.9% ( -14% - 23%) 0.342
OrHighHigh 36.66 (4.3%) 37.89
(5.0%) 3.4% ( -5% - 13%) 0.024
BrowseDayOfYearTaxoFacets 30.08 (35.3%) 32.20
(36.3%) 7.1% ( -47% - 121%) 0.533
BrowseDateTaxoFacets 29.97 (35.3%) 32.11
(36.4%) 7.1% ( -47% - 121%) 0.529
BrowseRandomLabelTaxoFacets 33.87 (55.4%) 36.44
(55.6%) 7.6% ( -66% - 266%) 0.665
OrHighMed 59.43 (4.4%) 73.60
(6.1%) 23.8% ( 12% - 35%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseMonthTaxoFacets 29.67 (35.9%) 26.63
(30.3%) -10.2% ( -56% - 87%) 0.330
BrowseRandomLabelTaxoFacets 32.36 (49.1%) 29.36
(44.0%) -9.3% ( -68% - 164%) 0.530
BrowseDateTaxoFacets 30.55 (32.1%) 28.48
(29.5%) -6.8% ( -51% - 80%) 0.488
BrowseDayOfYearTaxoFacets 30.62 (32.1%) 28.56
(29.4%) -6.7% ( -51% - 80%) 0.490
OrHighNotLow 2000.65 (4.5%) 1895.41
(4.0%) -5.3% ( -13% - 3%) 0.000
OrHighNotMed 1620.74 (3.8%) 1548.14
(3.6%) -4.5% ( -11% - 3%) 0.000
OrHighNotHigh 1893.27 (4.3%) 1813.55
(4.6%) -4.2% ( -12% - 4%) 0.003
OrNotHighHigh 1618.28 (2.9%) 1552.39
(3.3%) -4.1% ( -10% - 2%) 0.000
OrNotHighMed 1875.84 (2.9%) 1808.01
(3.0%) -3.6% ( -9% - 2%) 0.000
Prefix3 540.69 (7.6%) 523.50
(7.3%) -3.2% ( -16% - 12%) 0.178
OrNotHighLow 3778.86 (4.4%) 3679.45
(4.9%) -2.6% ( -11% - 6%) 0.074
MedTerm 3251.04 (3.8%) 3187.70
(3.8%) -1.9% ( -9% - 5%) 0.105
HighTerm 5042.01 (3.7%) 4948.92
(3.9%) -1.8% ( -9% - 5%) 0.125
Wildcard 206.72 (5.4%) 203.08
(5.4%) -1.8% ( -11% - 9%) 0.305
LowTerm 3923.37 (3.8%) 3867.22
(5.1%) -1.4% ( -9% - 7%) 0.316
BrowseMonthSSDVFacets 29.89 (9.8%) 29.59
(10.4%) -1.0% ( -19% - 21%) 0.755
BrowseDayOfYearSSDVFacets 27.14 (7.7%) 26.91
(8.4%) -0.9% ( -15% - 16%) 0.738
HighIntervalsOrdered 2.97 (6.5%) 2.95
(5.8%) -0.8% ( -12% - 12%) 0.687
AndHighLow 2171.32 (3.5%) 2156.36
(2.9%) -0.7% ( -6% - 5%) 0.501
AndHighMedDayTaxoFacets 137.76 (1.8%) 136.92
(1.4%) -0.6% ( -3% - 2%) 0.236
MedTermDayTaxoFacets 47.10 (3.1%) 46.86
(2.9%) -0.5% ( -6% - 5%) 0.588
LowIntervalsOrdered 130.34 (4.5%) 129.84
(4.0%) -0.4% ( -8% - 8%) 0.772
MedSpanNear 47.38 (2.5%) 47.20
(2.4%) -0.4% ( -5% - 4%) 0.621
AndHighHighDayTaxoFacets 39.66 (1.7%) 39.53
(1.0%) -0.3% ( -2% - 2%) 0.470
HighSpanNear 16.29 (3.7%) 16.24
(3.4%) -0.3% ( -7% - 7%) 0.787
MedPhrase 254.77 (2.2%) 254.00
(1.9%) -0.3% ( -4% - 3%) 0.640
LowSpanNear 86.34 (4.3%) 86.08
(4.0%) -0.3% ( -8% - 8%) 0.821
MedSloppyPhrase 16.35 (3.2%) 16.31
(2.9%) -0.3% ( -6% - 5%) 0.793
AndHighHigh 82.69 (3.2%) 82.50
(3.9%) -0.2% ( -7% - 7%) 0.837
HighSloppyPhrase 42.39 (3.4%) 42.31
(3.2%) -0.2% ( -6% - 6%) 0.856
HighTermDayOfYearSort 269.36 (9.8%) 268.97
(8.6%) -0.1% ( -16% - 20%) 0.961
Fuzzy1 148.89 (2.4%) 148.74
(2.7%) -0.1% ( -5% - 5%) 0.901
LowSloppyPhrase 18.20 (3.0%) 18.18
(2.4%) -0.1% ( -5% - 5%) 0.926
HighTermMonthSort 293.73 (8.4%) 293.57
(8.3%) -0.1% ( -15% - 18%) 0.984
LowPhrase 35.24 (2.6%) 35.23
(2.8%) -0.1% ( -5% - 5%) 0.954
HighPhrase 135.32 (2.7%) 135.39
(2.7%) 0.0% ( -5% - 5%) 0.953
AndHighMed 431.17 (4.0%) 431.40
(3.5%) 0.1% ( -7% - 7%) 0.965
IntNRQ 151.77 (0.4%) 152.06
(0.4%) 0.2% ( 0% - 0%) 0.136
BrowseRandomLabelSSDVFacets 20.68 (5.4%) 20.72
(7.3%) 0.2% ( -11% - 13%) 0.915
MedIntervalsOrdered 55.15 (5.9%) 55.28
(5.1%) 0.2% ( -10% - 11%) 0.893
PKLookup 323.66 (5.3%) 324.64
(5.2%) 0.3% ( -9% - 11%) 0.855
Fuzzy2 104.69 (2.1%) 105.03
(2.8%) 0.3% ( -4% - 5%) 0.680
Respell 117.94 (2.5%) 118.67
(3.3%) 0.6% ( -5% - 6%) 0.510
OrHighMedDayTaxoFacets 21.39 (7.1%) 21.72
(5.3%) 1.5% ( -10% - 14%) 0.437
BrowseDateSSDVFacets 4.50 (34.5%) 4.58
(32.6%) 1.8% ( -48% - 105%) 0.868
TermDTSort 147.90 (8.7%) 151.02
(9.1%) 2.1% ( -14% - 21%) 0.454
HighTermTitleBDVSort 209.37 (8.6%) 214.00
(10.2%) 2.2% ( -15% - 23%) 0.459
OrHighLow 613.03 (6.4%) 643.95
(8.1%) 5.0% ( -8% - 20%) 0.029
OrHighHigh 34.86 (5.9%) 42.92
(8.7%) 23.1% ( 8% - 40%) 0.000
OrHighMed 228.50 (4.7%) 339.92
(7.6%) 48.8% ( 34% - 64%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
OrHighNotLow 1910.62 (5.2%) 1834.57
(4.0%) -4.0% ( -12% - 5%) 0.007
OrNotHighMed 1930.95 (4.3%) 1859.27
(3.4%) -3.7% ( -10% - 4%) 0.002
OrHighNotHigh 1547.82 (4.5%) 1491.21
(3.8%) -3.7% ( -11% - 4%) 0.005
OrNotHighLow 1904.34 (3.8%) 1836.39
(4.0%) -3.6% ( -10% - 4%) 0.004
OrHighNotMed 1841.59 (3.8%) 1778.33
(3.3%) -3.4% ( -10% - 3%) 0.002
OrHighMed 468.71 (4.3%) 455.39
(6.0%) -2.8% ( -12% - 7%) 0.086
OrHighMedDayTaxoFacets 19.06 (5.2%) 18.64
(5.2%) -2.2% ( -11% - 8%) 0.182
Prefix3 194.53 (7.6%) 190.38
(8.5%) -2.1% ( -16% - 15%) 0.401
OrNotHighHigh 1218.01 (3.9%) 1194.20
(3.4%) -2.0% ( -8% - 5%) 0.092
MedTermDayTaxoFacets 73.83 (3.9%) 72.53
(5.2%) -1.8% ( -10% - 7%) 0.226
IntNRQ 95.60 (5.6%) 93.98
(7.5%) -1.7% ( -14% - 12%) 0.418
AndHighHighDayTaxoFacets 12.42 (4.2%) 12.23
(2.9%) -1.6% ( -8% - 5%) 0.170
Wildcard 99.34 (5.4%) 97.88
(5.7%) -1.5% ( -11% - 10%) 0.402
LowPhrase 163.91 (2.9%) 161.78
(1.9%) -1.3% ( -5% - 3%) 0.089
BrowseRandomLabelSSDVFacets 20.32 (8.4%) 20.06
(8.6%) -1.3% ( -16% - 17%) 0.632
BrowseMonthSSDVFacets 29.23 (12.9%) 28.88
(13.1%) -1.2% ( -24% - 28%) 0.771
BrowseDayOfYearSSDVFacets 27.50 (12.6%) 27.18
(13.3%) -1.2% ( -23% - 28%) 0.775
PKLookup 325.48 (3.3%) 321.76
(3.8%) -1.1% ( -7% - 6%) 0.308
AndHighLow 1399.92 (5.7%) 1385.77
(4.0%) -1.0% ( -10% - 9%) 0.518
HighSloppyPhrase 77.82 (4.5%) 77.26
(3.4%) -0.7% ( -8% - 7%) 0.570
AndHighMedDayTaxoFacets 100.34 (3.0%) 99.71
(2.4%) -0.6% ( -5% - 4%) 0.468
MedSloppyPhrase 15.49 (2.9%) 15.43
(2.3%) -0.4% ( -5% - 4%) 0.655
Respell 100.24 (1.0%) 99.89
(2.2%) -0.3% ( -3% - 2%) 0.517
HighSpanNear 11.03 (5.0%) 11.00
(5.0%) -0.3% ( -9% - 10%) 0.834
MedPhrase 25.58 (2.7%) 25.50
(1.9%) -0.3% ( -4% - 4%) 0.663
MedSpanNear 9.46 (4.0%) 9.44
(3.8%) -0.2% ( -7% - 7%) 0.891
LowSpanNear 45.24 (2.9%) 45.16
(2.5%) -0.2% ( -5% - 5%) 0.851
AndHighMed 172.29 (4.0%) 172.03
(4.4%) -0.2% ( -8% - 8%) 0.907
HighTerm 3559.92 (3.5%) 3554.88
(4.4%) -0.1% ( -7% - 8%) 0.910
Fuzzy1 140.34 (1.1%) 140.15
(1.5%) -0.1% ( -2% - 2%) 0.747
MedTerm 2737.67 (4.0%) 2739.26
(4.8%) 0.1% ( -8% - 9%) 0.967
Fuzzy2 103.03 (1.3%) 103.25
(1.6%) 0.2% ( -2% - 3%) 0.642
AndHighHigh 153.37 (4.3%) 153.90
(4.3%) 0.3% ( -7% - 9%) 0.799
HighPhrase 245.46 (2.2%) 246.96
(1.9%) 0.6% ( -3% - 4%) 0.340
LowSloppyPhrase 160.72 (4.9%) 162.01
(5.5%) 0.8% ( -9% - 11%) 0.628
LowTerm 3476.45 (5.1%) 3514.16
(4.2%) 1.1% ( -7% - 10%) 0.463
LowIntervalsOrdered 206.89 (9.1%) 209.20
(9.2%) 1.1% ( -15% - 21%) 0.700
MedIntervalsOrdered 122.86 (5.1%) 124.24
(4.9%) 1.1% ( -8% - 11%) 0.479
HighIntervalsOrdered 7.06 (5.1%) 7.16
(5.2%) 1.3% ( -8% - 12%) 0.426
HighTermMonthSort 150.35 (9.1%) 153.91
(10.3%) 2.4% ( -15% - 23%) 0.441
TermDTSort 339.63 (5.1%) 348.20
(8.1%) 2.5% ( -10% - 16%) 0.238
HighTermTitleBDVSort 222.02 (8.0%) 229.38
(12.8%) 3.3% ( -16% - 26%) 0.325
HighTermDayOfYearSort 125.24 (7.6%) 129.96
(10.6%) 3.8% ( -13% - 23%) 0.197
BrowseDayOfYearTaxoFacets 29.94 (34.1%) 31.45
(36.7%) 5.0% ( -48% - 114%) 0.653
BrowseDateTaxoFacets 29.86 (34.2%) 31.38
(36.9%) 5.1% ( -49% - 115%) 0.652
BrowseMonthTaxoFacets 28.21 (36.0%) 30.33
(39.6%) 7.5% ( -50% - 129%) 0.530
OrHighLow 1167.40 (3.3%) 1270.69
(5.0%) 8.8% ( 0% - 17%) 0.000
BrowseDateSSDVFacets 3.96 (36.7%) 4.33
(38.8%) 9.4% ( -48% - 134%) 0.429
BrowseRandomLabelTaxoFacets 32.46 (52.6%) 35.65
(58.6%) 9.8% ( -66% - 255%) 0.576
OrHighHigh 44.52 (5.2%) 77.19
(13.2%) 73.4% ( 52% - 96%) 0.000
```
```
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
OrNotHighHigh 2582.82 (5.0%) 2422.92
(4.1%) -6.2% ( -14% - 2%) 0.000
OrHighNotLow 1824.30 (4.0%) 1723.99
(4.4%) -5.5% ( -13% - 2%) 0.000
OrHighNotMed 1887.09 (3.6%) 1791.22
(3.8%) -5.1% ( -12% - 2%) 0.000
OrHighNotHigh 1595.90 (3.7%) 1518.30
(3.4%) -4.9% ( -11% - 2%) 0.000
BrowseDayOfYearSSDVFacets 27.93 (10.6%) 26.62
(11.7%) -4.7% ( -24% - 19%) 0.184
OrNotHighMed 1870.56 (4.3%) 1802.13
(4.0%) -3.7% ( -11% - 4%) 0.006
HighTerm 4189.00 (5.0%) 4046.35
(5.2%) -3.4% ( -12% - 7%) 0.034
LowTerm 4064.46 (5.6%) 3960.30
(5.9%) -2.6% ( -13% - 9%) 0.161
MedTerm 3216.56 (3.0%) 3137.93
(3.6%) -2.4% ( -8% - 4%) 0.018
OrNotHighLow 1736.25 (4.3%) 1697.00
(4.5%) -2.3% ( -10% - 6%) 0.102
Respell 125.82 (1.7%) 123.46
(2.6%) -1.9% ( -6% - 2%) 0.007
PKLookup 327.57 (4.3%) 321.48
(6.0%) -1.9% ( -11% - 8%) 0.260
TermDTSort 188.79 (9.1%) 185.37
(7.5%) -1.8% ( -16% - 16%) 0.492
MedSpanNear 86.69 (6.5%) 85.26
(6.0%) -1.7% ( -13% - 11%) 0.404
MedTermDayTaxoFacets 92.56 (3.7%) 91.11
(4.5%) -1.6% ( -9% - 6%) 0.229
AndHighLow 2061.69 (5.0%) 2031.71
(5.6%) -1.5% ( -11% - 9%) 0.387
MedIntervalsOrdered 85.82 (4.5%) 84.67
(4.0%) -1.3% ( -9% - 7%) 0.321
LowSpanNear 87.98 (1.6%) 86.87
(2.2%) -1.3% ( -4% - 2%) 0.039
LowIntervalsOrdered 166.70 (4.5%) 164.63
(3.8%) -1.2% ( -9% - 7%) 0.347
AndHighMed 370.30 (5.9%) 366.51
(4.5%) -1.0% ( -10% - 9%) 0.535
AndHighMedDayTaxoFacets 151.37 (2.2%) 149.86
(2.2%) -1.0% ( -5% - 3%) 0.154
BrowseDateSSDVFacets 4.25 (33.7%) 4.22
(33.3%) -0.9% ( -50% - 99%) 0.935
Fuzzy1 155.00 (1.9%) 153.73
(1.2%) -0.8% ( -3% - 2%) 0.100
HighSpanNear 55.22 (3.3%) 54.78
(2.3%) -0.8% ( -6% - 5%) 0.378
AndHighHigh 239.75 (4.3%) 237.88
(4.2%) -0.8% ( -8% - 8%) 0.564
AndHighHighDayTaxoFacets 38.99 (1.6%) 38.72
(1.7%) -0.7% ( -3% - 2%) 0.173
MedPhrase 518.45 (1.5%) 515.34
(2.2%) -0.6% ( -4% - 3%) 0.314
LowPhrase 362.11 (1.7%) 359.95
(2.6%) -0.6% ( -4% - 3%) 0.390
BrowseMonthSSDVFacets 28.61 (9.0%) 28.47
(11.8%) -0.5% ( -19% - 22%) 0.885
Prefix3 155.71 (9.5%) 154.99
(9.3%) -0.5% ( -17% - 20%) 0.876
HighPhrase 244.45 (1.7%) 243.35
(2.0%) -0.5% ( -4% - 3%) 0.445
Wildcard 108.83 (5.1%) 108.81
(4.4%) -0.0% ( -9% - 10%) 0.991
IntNRQ 860.00 (1.9%) 861.19
(1.4%) 0.1% ( -3% - 3%) 0.792
Fuzzy2 118.03 (1.8%) 118.25
(1.6%) 0.2% ( -3% - 3%) 0.733
BrowseMonthTaxoFacets 28.07 (36.3%) 28.17
(36.4%) 0.4% ( -53% - 114%) 0.975
MedSloppyPhrase 256.13 (2.5%) 257.19
(3.2%) 0.4% ( -5% - 6%) 0.645
HighSloppyPhrase 33.15 (5.1%) 33.30
(5.9%) 0.4% ( -9% - 12%) 0.797
LowSloppyPhrase 22.96 (2.3%) 23.07
(2.5%) 0.5% ( -4% - 5%) 0.537
HighIntervalsOrdered 2.52 (13.1%) 2.53
(12.9%) 0.5% ( -22% - 30%) 0.894
HighTermTitleBDVSort 225.53 (9.1%) 227.07
(12.3%) 0.7% ( -18% - 24%) 0.842
HighTermMonthSort 71.24 (8.3%) 72.02
(12.5%) 1.1% ( -18% - 23%) 0.745
BrowseRandomLabelTaxoFacets 32.75 (52.5%) 33.25
(51.9%) 1.5% ( -67% - 222%) 0.927
OrHighMedDayTaxoFacets 17.40 (9.7%) 17.67
(3.2%) 1.5% ( -10% - 15%) 0.502
HighTermDayOfYearSort 90.52 (7.8%) 92.85
(10.5%) 2.6% ( -14% - 22%) 0.379
BrowseRandomLabelSSDVFacets 20.34 (6.1%) 20.90
(10.1%) 2.7% ( -12% - 20%) 0.299
BrowseDateTaxoFacets 29.99 (33.6%) 30.87
(34.1%) 2.9% ( -48% - 106%) 0.783
BrowseDayOfYearTaxoFacets 30.09 (33.5%) 31.02
(34.1%) 3.1% ( -48% - 106%) 0.772
OrHighHigh 49.58 (5.5%) 52.95
(6.2%) 6.8% ( -4% - 19%) 0.000
OrHighLow 1157.99 (3.8%) 1278.02
(4.4%) 10.4% ( 2% - 19%) 0.000
OrHighMed 148.53 (5.5%) 309.01
(8.7%) 108.0% ( 88% - 129%) 0.000
```
It appears this implementation would bring a -4% performance impact to
OrXNotY tasks in general.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
