pitrou commented on pull request #10907:
URL: https://github.com/apache/arrow/pull/10907#issuecomment-897847144
Ok, I've run the following command on my local machine (a Ryzen 9 3900X
running Ubuntu 20.04):
```
$ ARROW_USER_SIMD_LEVEL=NONE archery benchmark diff
--suite-filter="^arrow-compute-aggregate" --benchmark-filter="Grouped"
```
Here are the results:
```
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Non-regressions: (53)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark baseline
contender change %
counters
SumDoublesGroupedByTinyStringSet/1048576/10 25.022M items/sec
28.001M items/sec 11.906 {'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 10.0}
SumDoublesGroupedByTinyIntegerSet/1048576/10000 125.205M items/sec
137.482M items/sec 9.806 {'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 83, 'null_percent': 0.01}
SumDoublesGroupedByMediumStringSet/1048576/1 25.801M items/sec
27.530M items/sec 6.700 {'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 100.0}
SumDoublesGroupedBySmallStringSet/1048576/1 26.238M items/sec
27.970M items/sec 6.602 {'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 100.0}
SumDoublesGroupedByMediumStringSet/1048576/10000 24.786M items/sec
26.421M items/sec 6.597 {'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.01}
SumDoublesGroupedByTinyStringSet/1048576/1 27.832M items/sec
29.636M items/sec 6.482 {'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 19, 'null_percent': 100.0}
SumDoublesGroupedByMediumStringSet/1048576/10 24.238M items/sec
25.724M items/sec 6.131 {'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 10.0}
SumDoublesGroupedByMediumStringSet/1048576/0 24.682M items/sec
26.155M items/sec 5.965 {'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.0}
SumDoublesGroupedByMediumStringSet/1048576/100 24.584M items/sec
26.024M items/sec 5.858 {'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 1.0}
SumDoublesGroupedBySmallStringSet/1048576/100 25.659M items/sec
27.123M items/sec 5.705 {'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 1.0}
SumDoublesGroupedByTinyStringSet/1048576/2 25.091M items/sec
26.402M items/sec 5.223 {'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 50.0}
SumDoublesGroupedByTinyStringSet/1048576/100 26.975M items/sec
28.360M items/sec 5.133 {'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 1.0}
SumDoublesGroupedByMediumStringSet/1048576/2 23.449M items/sec
24.599M items/sec 4.903 {'run_name':
'SumDoublesGroupedByMediumStringSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 50.0}
SumDoublesGroupedByTinyIntegerSet/1048576/100 128.822M items/sec
134.755M items/sec 4.605 {'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 84, 'null_percent': 1.0}
SumDoublesGroupedBySmallStringSet/1048576/2 23.895M items/sec
24.941M items/sec 4.379 {'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 50.0}
SumDoublesGroupedByTinyStringSet/1048576/10000 27.126M items/sec
28.095M items/sec 3.570 {'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 0.01}
SumDoublesGroupedBySmallStringSet/1048576/0 25.829M items/sec
26.427M items/sec 2.316 {'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.0}
SumDoublesGroupedBySmallStringSet/1048576/10 25.053M items/sec
25.578M items/sec 2.098 {'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 10.0}
SumDoublesGroupedByTinyStringSet/1048576/0 26.960M items/sec
27.520M items/sec 2.078 {'run_name':
'SumDoublesGroupedByTinyStringSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 0.0}
SumDoublesGroupedBySmallStringSet/1048576/10000 25.816M items/sec
26.156M items/sec 1.318 {'run_name':
'SumDoublesGroupedBySmallStringSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.01}
SumDoublesGroupedBySmallIntStringPairSet/1048576/2 23.764M items/sec
24.035M items/sec 1.140 {'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 50.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/100 27.199M items/sec
27.323M items/sec 0.458 {'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 1.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/100 24.780M items/sec
24.882M items/sec 0.415 {'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 1.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/10 24.389M items/sec
24.478M items/sec 0.365 {'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 10.0}
SumDoublesGroupedBySmallIntegerSet/1048576/2 97.522M items/sec
97.705M items/sec 0.188 {'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 64, 'null_percent': 50.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/2 25.557M items/sec
25.566M items/sec 0.037 {'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 50.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/10 25.145M items/sec
25.151M items/sec 0.024 {'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 10.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/1 25.776M items/sec
25.777M items/sec 0.006 {'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 100.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/0 24.729M items/sec
24.715M items/sec -0.056 {'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/1 28.168M items/sec
28.135M items/sec -0.116 {'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 100.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/10000 24.729M items/sec
24.683M items/sec -0.186 {'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.01}
SumDoublesGroupedBySmallIntStringPairSet/1048576/0 25.691M items/sec
25.629M items/sec -0.243 {'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.0}
SumDoublesGroupedByMediumIntStringPairSet/1048576/2 23.477M items/sec
23.407M items/sec -0.296 {'run_name':
'SumDoublesGroupedByMediumIntStringPairSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 16, 'null_percent': 50.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/100 25.738M items/sec
25.654M items/sec -0.327 {'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 1.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/1 26.418M items/sec
26.325M items/sec -0.351 {'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 100.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/0 27.381M items/sec
27.243M items/sec -0.503 {'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 0.0}
SumDoublesGroupedByTinyIntStringPairSet/1048576/10 26.889M items/sec
26.741M items/sec -0.549 {'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 10.0}
SumDoublesGroupedByTinyIntegerSet/1048576/1 156.745M items/sec
154.981M items/sec -1.126 {'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 103, 'null_percent': 100.0}
SumDoublesGroupedBySmallIntegerSet/1048576/1 156.448M items/sec
154.072M items/sec -1.519 {'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 104, 'null_percent': 100.0}
SumDoublesGroupedByTinyIntegerSet/1048576/0 131.906M items/sec
129.596M items/sec -1.751 {'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 85, 'null_percent': 0.0}
SumDoublesGroupedByMediumIntegerSet/1048576/10 99.010M items/sec
97.175M items/sec -1.853 {'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 66, 'null_percent': 10.0}
SumDoublesGroupedBySmallIntegerSet/1048576/0 131.406M items/sec
128.855M items/sec -1.941 {'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 86, 'null_percent': 0.0}
SumDoublesGroupedByMediumIntegerSet/1048576/100 105.990M items/sec
103.840M items/sec -2.028 {'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 70, 'null_percent': 1.0}
SumDoublesGroupedBySmallIntStringPairSet/1048576/10000 25.782M items/sec
25.236M items/sec -2.117 {'run_name':
'SumDoublesGroupedBySmallIntStringPairSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 17, 'null_percent': 0.01}
SumDoublesGroupedByMediumIntegerSet/1048576/2 84.781M items/sec
82.768M items/sec -2.374 {'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 56, 'null_percent': 50.0}
SumDoublesGroupedByTinyIntegerSet/1048576/2 99.846M items/sec
97.476M items/sec -2.374 {'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/2', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 66, 'null_percent': 50.0}
SumDoublesGroupedByMediumIntegerSet/1048576/10000 103.466M items/sec
100.802M items/sec -2.574 {'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 69, 'null_percent': 0.01}
SumDoublesGroupedByMediumIntegerSet/1048576/1 127.502M items/sec
124.068M items/sec -2.693 {'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 84, 'null_percent': 100.0}
SumDoublesGroupedBySmallIntegerSet/1048576/10 121.594M items/sec
117.223M items/sec -3.595 {'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 81, 'null_percent': 10.0}
SumDoublesGroupedByMediumIntegerSet/1048576/0 102.886M items/sec
98.923M items/sec -3.852 {'run_name':
'SumDoublesGroupedByMediumIntegerSet/1048576/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 68, 'null_percent': 0.0}
SumDoublesGroupedBySmallIntegerSet/1048576/100 136.201M items/sec
130.003M items/sec -4.551 {'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/100', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 89, 'null_percent': 1.0}
SumDoublesGroupedBySmallIntegerSet/1048576/10000 136.300M items/sec
129.867M items/sec -4.720 {'run_name':
'SumDoublesGroupedBySmallIntegerSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 91, 'null_percent': 0.01}
SumDoublesGroupedByTinyIntegerSet/1048576/10 124.179M items/sec
118.275M items/sec -4.754 {'run_name':
'SumDoublesGroupedByTinyIntegerSet/1048576/10', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 82, 'null_percent': 10.0}
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Regressions: (1)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark baseline
contender change %
counters
SumDoublesGroupedByTinyIntStringPairSet/1048576/10000 27.461M items/sec
25.987M items/sec -5.366 {'run_name':
'SumDoublesGroupedByTinyIntStringPairSet/1048576/10000', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 18, 'null_percent': 0.01}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
