kkraus14 commented on pull request #10907:
URL: https://github.com/apache/arrow/pull/10907#issuecomment-897855526
Which compiler did you use? Here are my results with gcc 9.3:
```
Non-regressions: (42)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark baseline
contender change %
counters
SumDoublesGroupedByTinyStringSet/1048576/2 21.472M items/sec
24.031M items/sec 11.918
{'family_index': 0, 'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 15, 'null_percent': 50.0}
SumDoublesGroupedByTinyStringSet/1048576/1 23.669M items/sec
26.127M items/sec 10.385
{'family_index': 0, 'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 100.0}
SumDoublesGroupedByTinyStringSet/1048576/0 23.323M items/sec
25.615M items/sec 9.827
{'family_index': 0, 'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 15, 'null_percent': 0.0}
SumDoublesGroupedByTinyStringSet/1048576/10 22.896M items/sec
25.062M items/sec 9.463
{'family_index': 0, 'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 15, 'null_percent': 10.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/10 20.471M items/sec
22.355M items/sec 9.204 {'family_index': 8, 'per_family_instance_index':
2, 'run_name': 'SumDoublesGroupedByMediumIntStringPairSet/1048576/10',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 14,
'null_percent': 10.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/1 21.490M items/sec
23.402M items/sec 8.897 {'family_index': 8, 'per_family_instance_index':
4, 'run_name': 'SumDoublesGroupedByMediumIntStringPairSet/1048576/1',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 14,
'null_percent': 100.0}
SumDoublesGroupedByTinyStringSet/1048576/100 23.493M items/sec
25.484M items/sec 8.473
{'family_index': 0, 'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 1.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/100 20.953M items/sec
22.724M items/sec 8.452 {'family_index': 8, 'per_family_instance_index':
1, 'run_name': 'SumDoublesGroupedByMediumIntStringPairSet/1048576/100',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 14,
'null_percent': 1.0}
SumDoublesGroupedByTinyStringSet/1048576/10000 22.802M items/sec
24.657M items/sec 8.135 {'family_index': 0,
'per_family_instance_index': 0, 'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/10000', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 15, 'null_percent': 0.01}
SumDoublesGroupedByMediumIntStringPairSet/1048576/10000 20.914M items/sec
22.603M items/sec 8.076 {'family_index': 8, 'per_family_instance_index': 0,
'run_name': 'SumDoublesGroupedByMediumIntStringPairSet/1048576/10000',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 10,
'null_percent': 0.01}
SumDoublesGroupedByMediumIntStringPairSet/1048576/2 19.924M items/sec
21.433M items/sec 7.571 {'family_index': 8,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 13, 'null_percent': 50.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/0 21.012M items/sec
22.595M items/sec 7.535 {'family_index': 8,
'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 13, 'null_percent': 0.0}
SumDoublesGroupedByMediumIntegerSet/1048576/10000 90.054M items/sec
93.166M items/sec 3.455 {'family_index': 5,
'per_family_instance_index': 0, 'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/10000', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 62, 'null_percent': 0.01}
SumDoublesGroupedBySmallIntegerSet/1048576/10000 121.584M items/sec
125.108M items/sec 2.899 {'family_index': 4,
'per_family_instance_index': 0, 'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/10000', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 83, 'null_percent': 0.01}
SumDoublesGroupedByTinyIntegerSet/1048576/10 110.947M items/sec
113.984M items/sec 2.738 {'family_index': 3,
'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 76, 'null_percent': 10.0}
SumDoublesGroupedBySmallIntegerSet/1048576/100 120.002M items/sec
122.770M items/sec 2.307 {'family_index': 4,
'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 80, 'null_percent': 1.0}
SumDoublesGroupedByMediumIntegerSet/1048576/10 86.845M items/sec
88.800M items/sec 2.251 {'family_index': 5,
'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 59, 'null_percent': 10.0}
SumDoublesGroupedByTinyIntegerSet/1048576/100 118.619M items/sec
121.001M items/sec 2.008 {'family_index': 3,
'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 77, 'null_percent': 1.0}
SumDoublesGroupedByTinyIntegerSet/1048576/0 122.605M items/sec
124.625M items/sec 1.648
{'family_index': 3, 'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 82, 'null_percent': 0.0}
SumDoublesGroupedByMediumIntegerSet/1048576/2 74.496M items/sec
75.665M items/sec 1.569 {'family_index': 5,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 50, 'null_percent': 50.0}
SumDoublesGroupedByTinyIntegerSet/1048576/1 142.240M items/sec
144.429M items/sec 1.540 {'family_index': 3,
'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 97, 'null_percent': 100.0}
SumDoublesGroupedByMediumIntegerSet/1048576/0 91.864M items/sec
93.182M items/sec 1.434 {'family_index': 5,
'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 62, 'null_percent': 0.0}
SumDoublesGroupedBySmallIntegerSet/1048576/0 124.082M items/sec
125.812M items/sec 1.394
{'family_index': 4, 'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 84, 'null_percent': 0.0}
SumDoublesGroupedBySmallIntegerSet/1048576/10 112.156M items/sec
113.661M items/sec 1.341 {'family_index': 4,
'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 73, 'null_percent': 10.0}
SumDoublesGroupedBySmallIntegerSet/1048576/1 140.823M items/sec
142.537M items/sec 1.217 {'family_index': 4,
'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 95, 'null_percent': 100.0}
SumDoublesGroupedByMediumIntegerSet/1048576/1 107.606M items/sec
108.845M items/sec 1.151 {'family_index': 5,
'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 72, 'null_percent': 100.0}
SumDoublesGroupedByMediumIntegerSet/1048576/100 91.009M items/sec
92.055M items/sec 1.150 {'family_index': 5,
'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 60, 'null_percent': 1.0}
SumDoublesGroupedByTinyIntegerSet/1048576/2 90.598M items/sec
91.285M items/sec 0.758
{'family_index': 3, 'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 60, 'null_percent': 50.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/1 24.295M items/sec
24.388M items/sec 0.381 {'family_index': 7,
'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 100.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/10000 23.797M items/sec
23.812M items/sec 0.062 {'family_index': 7, 'per_family_instance_index':
0, 'run_name': 'SumDoublesGroupedBySmallIntStringPairSet/1048576/10000',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 16,
'null_percent': 0.01}
SumDoublesGroupedByMediumStringSet/1048576/100 23.790M items/sec
23.788M items/sec -0.009 {'family_index': 2,
'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 1.0}
SumDoublesGroupedBySmallIntegerSet/1048576/2 91.063M items/sec
90.601M items/sec -0.508 {'family_index': 4,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 60, 'null_percent': 50.0}
SumDoublesGroupedByTinyIntegerSet/1048576/10000 121.158M items/sec
120.256M items/sec -0.745 {'family_index': 3,
'per_family_instance_index': 0, 'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/10000', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 81, 'null_percent': 0.01}
SumDoublesGroupedBySmallIntStringPairSet/1048576/2 22.388M items/sec
22.201M items/sec -0.834 {'family_index': 7,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 15, 'null_percent': 50.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/100 24.097M items/sec
23.798M items/sec -1.240 {'family_index': 7,
'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 1.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/10 23.826M items/sec
23.454M items/sec -1.558 {'family_index': 7,
'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 10.0}
SumDoublesGroupedByMediumStringSet/1048576/10 24.002M items/sec
23.604M items/sec -1.660 {'family_index': 2,
'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 10.0}
SumDoublesGroupedByMediumStringSet/1048576/10000 24.078M items/sec
23.643M items/sec -1.806 {'family_index': 2,
'per_family_instance_index': 0, 'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/10000', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 0.01}
SumDoublesGroupedBySmallIntStringPairSet/1048576/0 24.358M items/sec
23.772M items/sec -2.406 {'family_index': 7,
'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 0.0}
SumDoublesGroupedByMediumStringSet/1048576/0 24.240M items/sec
23.656M items/sec -2.411
{'family_index': 2, 'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 0.0}
SumDoublesGroupedByMediumStringSet/1048576/2 23.004M items/sec
22.374M items/sec -2.737 {'family_index': 2,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 15, 'null_percent': 50.0}
SumDoublesGroupedByMediumStringSet/1048576/1 25.479M items/sec
24.562M items/sec -3.599 {'family_index': 2,
'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 100.0}
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Regressions: (12)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark baseline
contender change %
counters
SumDoublesGroupedBySmallStringSet/1048576/1 26.487M items/sec
25.049M items/sec -5.428 {'family_index': 1,
'per_family_instance_index': 4, 'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/1', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 100.0}
SumDoublesGroupedBySmallStringSet/1048576/2 23.879M items/sec
22.564M items/sec -5.509 {'family_index': 1,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 50.0}
SumDoublesGroupedBySmallStringSet/1048576/0 25.970M items/sec
24.534M items/sec -5.528 {'family_index': 1,
'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.0}
SumDoublesGroupedBySmallStringSet/1048576/10 25.623M items/sec
23.742M items/sec -7.342 {'family_index': 1,
'per_family_instance_index': 2, 'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/10', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 10.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/0 25.636M items/sec
23.551M items/sec -8.135 {'family_index': 6,
'per_family_instance_index': 5, 'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/0', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.0}
SumDoublesGroupedBySmallStringSet/1048576/100 26.166M items/sec
23.883M items/sec -8.728 {'family_index': 1,
'per_family_instance_index': 1, 'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/100', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 1.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/100 25.563M items/sec
23.202M items/sec -9.240 {'family_index': 6, 'per_family_instance_index':
1, 'run_name': 'SumDoublesGroupedByTinyIntStringPairSet/1048576/100',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 18,
'null_percent': 1.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/2 23.832M items/sec
21.629M items/sec -9.245 {'family_index': 6,
'per_family_instance_index': 3, 'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/2', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 50.0}
SumDoublesGroupedBySmallStringSet/1048576/10000 26.147M items/sec
23.533M items/sec -9.996 {'family_index': 1,
'per_family_instance_index': 0, 'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/10000', 'repetitions': 1,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.01}
SumDoublesGroupedByTinyIntStringPairSet/1048576/1 26.647M items/sec
23.953M items/sec -10.110 {'family_index': 6, 'per_family_instance_index':
4, 'run_name': 'SumDoublesGroupedByTinyIntStringPairSet/1048576/1',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 18,
'null_percent': 100.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/10 25.708M items/sec
22.949M items/sec -10.734 {'family_index': 6, 'per_family_instance_index':
2, 'run_name': 'SumDoublesGroupedByTinyIntStringPairSet/1048576/10',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 17,
'null_percent': 10.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/10000 26.245M items/sec
23.124M items/sec -11.891 {'family_index': 6, 'per_family_instance_index': 0,
'run_name': 'SumDoublesGroupedByTinyIntStringPairSet/1048576/10000',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 17,
'null_percent': 0.01}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
