JoeHF commented on PR #1003:
URL: https://github.com/apache/lucene/pull/1003#issuecomment-1195050814
no obvious regression or perf improvement, guess there are no such cases in
benchmark
wikimedium10k:
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
BrowseRandomLabelTaxoFacets 569.65 (7.9%) 543.58
(15.4%) -4.6% ( -25% - 20%) 0.236
Prefix3 377.77 (9.1%) 368.32
(6.6%) -2.5% ( -16% - 14%) 0.321
AndHighMed 656.18 (8.2%) 648.39
(10.6%) -1.2% ( -18% - 19%) 0.691
MedIntervalsOrdered 574.68 (6.3%) 567.95
(9.7%) -1.2% ( -16% - 15%) 0.651
AndHighLow 978.77 (9.3%) 972.00
(8.5%) -0.7% ( -16% - 18%) 0.806
HighSpanNear 425.66 (8.3%) 423.78
(10.2%) -0.4% ( -17% - 19%) 0.880
OrHighMed 656.72 (8.2%) 655.28
(10.5%) -0.2% ( -17% - 20%) 0.942
LowIntervalsOrdered 481.42 (5.2%) 480.65
(10.3%) -0.2% ( -14% - 16%) 0.951
HighPhrase 500.26 (7.6%) 499.86
(11.4%) -0.1% ( -17% - 20%) 0.979
Respell 123.33 (11.8%) 123.48
(10.4%) 0.1% ( -19% - 25%) 0.973
OrHighHigh 416.58 (6.9%) 417.19
(9.4%) 0.1% ( -15% - 17%) 0.955
MedTerm 2063.41 (9.5%) 2069.51
(11.0%) 0.3% ( -18% - 23%) 0.928
LowSloppyPhrase 301.12 (7.5%) 303.12
(12.6%) 0.7% ( -18% - 22%) 0.840
HighTerm 1088.05 (9.8%) 1102.10
(14.8%) 1.3% ( -21% - 28%) 0.745
LowPhrase 896.10 (8.4%) 907.71
(9.8%) 1.3% ( -15% - 21%) 0.654
HighSloppyPhrase 309.31 (8.1%) 313.60
(10.0%) 1.4% ( -15% - 21%) 0.629
Fuzzy2 42.78 (11.1%) 43.46
(12.2%) 1.6% ( -19% - 27%) 0.665
Wildcard 315.36 (9.2%) 320.46
(7.7%) 1.6% ( -14% - 20%) 0.548
MedSpanNear 520.33 (6.6%) 530.21
(11.6%) 1.9% ( -15% - 21%) 0.524
HighIntervalsOrdered 356.49 (10.3%) 363.39
(10.1%) 1.9% ( -16% - 24%) 0.547
AndHighHigh 619.32 (5.9%) 631.54
(9.5%) 2.0% ( -12% - 18%) 0.432
HighTermMonthSort 1479.95 (6.0%) 1509.95
(11.1%) 2.0% ( -14% - 20%) 0.472
MedSloppyPhrase 230.30 (8.6%) 235.24
(10.8%) 2.1% ( -15% - 23%) 0.488
MedPhrase 567.04 (6.2%) 579.72
(11.5%) 2.2% ( -14% - 21%) 0.442
BrowseRandomLabelSSDVFacets 350.13 (10.2%) 358.12
(16.8%) 2.3% ( -22% - 32%) 0.604
HighTermDayOfYearSort 1087.80 (7.4%) 1118.61
(8.5%) 2.8% ( -12% - 20%) 0.260
LowTerm 2557.43 (9.2%) 2636.37
(8.9%) 3.1% ( -13% - 23%) 0.281
LowSpanNear 795.88 (9.0%) 828.70
(11.1%) 4.1% ( -14% - 26%) 0.195
PKLookup 26.79 (16.3%) 27.91
(19.8%) 4.2% ( -27% - 48%) 0.466
Fuzzy1 136.23 (9.7%) 142.21
(16.8%) 4.4% ( -20% - 34%) 0.312
BrowseMonthTaxoFacets 801.97 (17.7%) 840.43
(19.1%) 4.8% ( -27% - 50%) 0.410
IntNRQ 603.46 (10.0%) 636.52
(7.9%) 5.5% ( -11% - 25%) 0.054
OrHighLow 532.25 (9.0%) 562.37
(13.6%) 5.7% ( -15% - 31%) 0.121
BrowseMonthSSDVFacets 839.55 (20.9%) 894.35
(22.1%) 6.5% ( -30% - 62%) 0.337
BrowseDayOfYearTaxoFacets 784.80 (16.4%) 839.36
(25.1%) 7.0% ( -29% - 58%) 0.300
BrowseDateTaxoFacets 849.34 (17.9%) 908.75
(25.8%) 7.0% ( -31% - 61%) 0.319
BrowseDayOfYearSSDVFacets 832.41 (17.6%) 907.43
(22.9%) 9.0% ( -26% - 60%) 0.163
BrowseDateSSDVFacets 215.63 (21.1%) 241.38
(27.5%) 11.9% ( -30% - 76%) 0.123
wikimedium1m:
TaskQPS baseline StdDevQPS
my_modified_version StdDev Pct diff p-value
Respell 39.67 (11.8%) 37.57
(14.2%) -5.3% ( -27% - 23%) 0.200
BrowseDayOfYearTaxoFacets 40.80 (13.7%) 38.83
(16.9%) -4.8% ( -31% - 29%) 0.320
BrowseMonthTaxoFacets 41.19 (15.2%) 39.62
(12.4%) -3.8% ( -27% - 28%) 0.386
MedIntervalsOrdered 26.76 (11.6%) 25.91
(14.2%) -3.2% ( -25% - 25%) 0.435
BrowseRandomLabelTaxoFacets 35.70 (13.8%) 34.91
(16.4%) -2.2% ( -28% - 32%) 0.646
MedPhrase 91.94 (16.9%) 90.03
(17.3%) -2.1% ( -30% - 38%) 0.701
Wildcard 57.80 (17.3%) 56.65
(20.8%) -2.0% ( -34% - 43%) 0.740
LowPhrase 41.33 (12.6%) 40.61
(16.9%) -1.7% ( -27% - 31%) 0.713
MedSpanNear 26.42 (11.9%) 26.03
(18.8%) -1.5% ( -28% - 33%) 0.766
HighIntervalsOrdered 3.12 (12.3%) 3.07
(16.9%) -1.5% ( -27% - 31%) 0.752
Fuzzy2 14.75 (12.4%) 14.56
(18.7%) -1.3% ( -28% - 34%) 0.794
AndHighMed 145.54 (16.2%) 144.55
(19.5%) -0.7% ( -31% - 41%) 0.905
HighSpanNear 13.89 (15.5%) 13.80
(17.1%) -0.6% ( -28% - 37%) 0.901
BrowseDateTaxoFacets 40.63 (14.9%) 40.45
(14.9%) -0.4% ( -26% - 34%) 0.924
LowSpanNear 52.60 (14.6%) 52.50
(19.8%) -0.2% ( -30% - 40%) 0.972
MedSloppyPhrase 48.53 (11.1%) 48.55
(13.9%) 0.0% ( -22% - 28%) 0.992
OrHighMed 258.25 (17.6%) 258.54
(17.2%) 0.1% ( -29% - 42%) 0.984
Fuzzy1 53.31 (16.1%) 53.52
(17.8%) 0.4% ( -28% - 40%) 0.942
Prefix3 213.49 (18.3%) 214.53
(23.5%) 0.5% ( -34% - 51%) 0.942
BrowseDateSSDVFacets 7.86 (12.2%) 7.91
(19.5%) 0.7% ( -27% - 36%) 0.885
BrowseDayOfYearSSDVFacets 46.80 (17.4%) 47.16
(21.9%) 0.8% ( -32% - 48%) 0.901
HighTermDayOfYearSort 100.99 (18.4%) 101.84
(21.8%) 0.8% ( -33% - 50%) 0.895
HighTermMonthSort 187.61 (21.7%) 189.26
(29.1%) 0.9% ( -41% - 65%) 0.914
MedTerm 835.70 (19.1%) 845.19
(19.4%) 1.1% ( -31% - 49%) 0.852
AndHighLow 671.33 (13.9%) 680.61
(18.9%) 1.4% ( -27% - 39%) 0.792
BrowseMonthSSDVFacets 49.46 (12.3%) 50.22
(16.2%) 1.5% ( -24% - 34%) 0.737
HighSloppyPhrase 23.85 (14.0%) 24.33
(15.8%) 2.0% ( -24% - 36%) 0.670
LowIntervalsOrdered 97.27 (15.4%) 100.01
(18.7%) 2.8% ( -27% - 43%) 0.603
AndHighHigh 76.16 (16.7%) 78.71
(20.1%) 3.3% ( -28% - 48%) 0.567
HighPhrase 123.29 (19.9%) 127.60
(25.9%) 3.5% ( -35% - 61%) 0.632
BrowseRandomLabelSSDVFacets 30.93 (17.0%) 32.06
(19.9%) 3.7% ( -28% - 48%) 0.532
LowTerm 1102.04 (19.8%) 1144.86
(23.8%) 3.9% ( -33% - 59%) 0.575
OrHighHigh 73.88 (18.2%) 77.00
(20.0%) 4.2% ( -28% - 51%) 0.484
PKLookup 56.02 (21.7%) 58.43
(24.6%) 4.3% ( -34% - 64%) 0.557
IntNRQ 125.49 (38.1%) 131.68
(33.1%) 4.9% ( -47% - 122%) 0.662
HighTerm 487.86 (17.6%) 515.68
(21.4%) 5.7% ( -28% - 54%) 0.358
LowSloppyPhrase 178.37 (13.9%) 190.03
(18.6%) 6.5% ( -22% - 45%) 0.208
OrHighLow 245.05 (18.5%) 261.57
(20.4%) 6.7% ( -27% - 55%) 0.273
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
