mbutrovich commented on PR #2258:
URL:
https://github.com/apache/datafusion-comet/pull/2258#issuecomment-3315388079
CI went green on the most recent commit. I just pushed a benchmark, here are
results:
```
Running benchmark: SQL Wide (10 cols) BOOLEAN Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2230 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2432 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 3 iterations, 2945 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 4 iterations, 2684 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) BOOLEAN Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1108 1115 10 9.5 105.7 1.0X
SQL Parquet - Comet (Spark Shuffle)
1198 1216 26 8.8 114.2 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
951 982 51 11.0 90.7 1.2X
SQL Parquet - Comet (Comet Shuffle)
658 671 13 15.9 62.8 1.7X
Running benchmark: SQL Wide (10 cols) TINYINT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2360 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 3 iterations, 2320 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 3 iterations, 2703 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 5 iterations, 2404 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) TINYINT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
769 787 18 13.6 73.3 1.0X
SQL Parquet - Comet (Spark Shuffle)
748 774 29 14.0 71.3 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
873 901 27 12.0 83.2 0.9X
SQL Parquet - Comet (Comet Shuffle)
452 481 32 23.2 43.1 1.7X
Running benchmark: SQL Wide (10 cols) SMALLINT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2313 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 3 iterations, 2332 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 3 iterations, 2792 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 4 iterations, 2093 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) SMALLINT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
749 771 26 14.0 71.5 1.0X
SQL Parquet - Comet (Spark Shuffle)
751 777 25 14.0 71.7 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
922 931 14 11.4 88.0 0.8X
SQL Parquet - Comet (Comet Shuffle)
508 523 18 20.7 48.4 1.5X
Running benchmark: SQL Wide (10 cols) INT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2409 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 3 iterations, 2558 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2146 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 4 iterations, 2592 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) INT Range Partition Shuffle(5 Partition): Best Time(ms)
Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark 786
803 22 13.3 74.9 1.0X
SQL Parquet - Comet (Spark Shuffle) 830
853 25 12.6 79.1 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle) 1025
1073 68 10.2 97.8 0.8X
SQL Parquet - Comet (Comet Shuffle) 617
648 26 17.0 58.8 1.3X
Running benchmark: SQL Wide (10 cols) BIGINT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2321 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 3 iterations, 2356 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2299 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2188 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) BIGINT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
755 774 27 13.9 72.0 1.0X
SQL Parquet - Comet (Spark Shuffle)
783 785 3 13.4 74.7 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
1148 1150 2 9.1 109.5 0.7X
SQL Parquet - Comet (Comet Shuffle)
727 729 2 14.4 69.4 1.0X
Running benchmark: SQL Wide (10 cols) FLOAT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2585 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 3 iterations, 2705 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2014 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 4 iterations, 2391 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) FLOAT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark 843
862 25 12.4 80.4 1.0X
SQL Parquet - Comet (Spark Shuffle) 884
902 29 11.9 84.3 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle) 992
1007 22 10.6 94.6 0.9X
SQL Parquet - Comet (Comet Shuffle) 583
598 20 18.0 55.6 1.4X
Running benchmark: SQL Wide (10 cols) DOUBLE Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2375 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 3 iterations, 2560 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2515 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2266 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) DOUBLE Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
787 792 5 13.3 75.0 1.0X
SQL Parquet - Comet (Spark Shuffle)
843 854 17 12.4 80.4 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1176 1258 116 8.9 112.2 0.7X
SQL Parquet - Comet (Comet Shuffle)
744 756 13 14.1 71.0 1.1X
Running benchmark: SQL Wide (10 cols) STRING Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3815 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3366 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 4379 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2373 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) STRING Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1866 1908 60 5.6 177.9 1.0X
SQL Parquet - Comet (Spark Shuffle)
1676 1683 10 6.3 159.8 1.1X
SQL Parquet - Comet (Comet Arrow Shuffle)
2182 2190 11 4.8 208.1 0.9X
SQL Parquet - Comet (Comet Shuffle)
1177 1187 14 8.9 112.2 1.6X
Running benchmark: SQL Wide (10 cols) DECIMAL(10,0) Range Partition
Shuffle(5 Partition)
Running case: SQL Parquet - Spark
Stopped after 3 iterations, 2883 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2074 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 3311 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2819 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) DECIMAL(10,0) Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
959 961 4 10.9 91.4 1.0X
SQL Parquet - Comet (Spark Shuffle)
1026 1037 16 10.2 97.9 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1595 1656 86 6.6 152.1 0.6X
SQL Parquet - Comet (Comet Shuffle)
931 940 12 11.3 88.8 1.0X
Running benchmark: SQL Wide (20 cols) BOOLEAN Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3067 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3448 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2699 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2178 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) BOOLEAN Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1532 1534 3 6.8 146.1 1.0X
SQL Parquet - Comet (Spark Shuffle)
1703 1724 31 6.2 162.4 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1348 1350 3 7.8 128.5 1.1X
SQL Parquet - Comet (Comet Shuffle)
1033 1089 80 10.2 98.5 1.5X
Running benchmark: SQL Wide (20 cols) TINYINT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2280 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2282 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2555 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2217 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) TINYINT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1131 1140 13 9.3 107.9 1.0X
SQL Parquet - Comet (Spark Shuffle)
1136 1141 8 9.2 108.3 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
1271 1278 9 8.2 121.2 0.9X
SQL Parquet - Comet (Comet Shuffle)
719 739 33 14.6 68.6 1.6X
Running benchmark: SQL Wide (20 cols) SMALLINT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2261 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2427 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2819 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2611 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) SMALLINT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1127 1131 6 9.3 107.5 1.0X
SQL Parquet - Comet (Spark Shuffle)
1199 1214 21 8.7 114.3 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1408 1410 2 7.4 134.3 0.8X
SQL Parquet - Comet (Comet Shuffle)
844 870 26 12.4 80.5 1.3X
Running benchmark: SQL Wide (20 cols) INT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2577 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2567 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 3293 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2070 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) INT Range Partition Shuffle(5 Partition): Best Time(ms)
Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark 1246
1289 61 8.4 118.8 1.0X
SQL Parquet - Comet (Spark Shuffle) 1262
1284 31 8.3 120.3 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle) 1640
1647 10 6.4 156.4 0.8X
SQL Parquet - Comet (Comet Shuffle) 1033
1035 4 10.2 98.5 1.2X
Running benchmark: SQL Wide (20 cols) BIGINT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2273 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2397 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 4051 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2586 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) BIGINT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1131 1137 9 9.3 107.8 1.0X
SQL Parquet - Comet (Spark Shuffle)
1186 1199 19 8.8 113.1 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
1939 2026 123 5.4 184.9 0.6X
SQL Parquet - Comet (Comet Shuffle)
1288 1293 7 8.1 122.9 0.9X
Running benchmark: SQL Wide (20 cols) FLOAT Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2436 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2571 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 3292 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2040 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) FLOAT Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark 1208
1218 15 8.7 115.2 1.0X
SQL Parquet - Comet (Spark Shuffle) 1278
1286 12 8.2 121.8 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle) 1635
1646 15 6.4 156.0 0.7X
SQL Parquet - Comet (Comet Shuffle) 1008
1020 16 10.4 96.2 1.2X
Running benchmark: SQL Wide (20 cols) DOUBLE Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2354 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2480 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 4106 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2707 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) DOUBLE Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1124 1177 75 9.3 107.2 1.0X
SQL Parquet - Comet (Spark Shuffle)
1236 1240 6 8.5 117.8 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1966 2053 123 5.3 187.5 0.6X
SQL Parquet - Comet (Comet Shuffle)
1352 1354 2 7.8 129.0 0.8X
Running benchmark: SQL Wide (20 cols) STRING Range Partition Shuffle(5
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 6612 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 5800 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 7940 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 4594 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) STRING Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
3262 3306 63 3.2 311.0 1.0X
SQL Parquet - Comet (Spark Shuffle)
2881 2900 27 3.6 274.8 1.1X
SQL Parquet - Comet (Comet Arrow Shuffle)
3916 3970 77 2.7 373.5 0.8X
SQL Parquet - Comet (Comet Shuffle)
2228 2297 98 4.7 212.5 1.5X
Running benchmark: SQL Wide (20 cols) DECIMAL(10,0) Range Partition
Shuffle(5 Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3012 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3376 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 5342 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 3544 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) DECIMAL(10,0) Range Partition Shuffle(5 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1496 1506 14 7.0 142.7 1.0X
SQL Parquet - Comet (Spark Shuffle)
1685 1688 4 6.2 160.7 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
2647 2671 35 4.0 252.4 0.6X
SQL Parquet - Comet (Comet Shuffle)
1747 1772 36 6.0 166.6 0.9X
Running benchmark: SQL Wide (10 cols) BOOLEAN Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2652 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2886 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 2066 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2136 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) BOOLEAN Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1323 1326 5 7.9 126.1 1.0X
SQL Parquet - Comet (Spark Shuffle)
1423 1443 29 7.4 135.7 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1016 1033 24 10.3 96.9 1.3X
SQL Parquet - Comet (Comet Shuffle)
685 712 33 15.3 65.3 1.9X
Running benchmark: SQL Wide (10 cols) TINYINT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2574 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2564 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 5654 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2092 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) TINYINT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1282 1287 7 8.2 122.3 1.0X
SQL Parquet - Comet (Spark Shuffle)
1251 1282 45 8.4 119.3 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
2746 2827 115 3.8 261.8 0.5X
SQL Parquet - Comet (Comet Shuffle)
697 697 1 15.1 66.4 1.8X
Running benchmark: SQL Wide (10 cols) SMALLINT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2791 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2755 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 4528 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2441 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) SMALLINT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1296 1396 141 8.1 123.6 1.0X
SQL Parquet - Comet (Spark Shuffle)
1353 1378 35 7.7 129.1 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
2171 2264 132 4.8 207.0 0.6X
SQL Parquet - Comet (Comet Shuffle)
782 814 49 13.4 74.6 1.7X
Running benchmark: SQL Wide (10 cols) INT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2778 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2890 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 4279 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2485 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) INT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark 1383
1389 10 7.6 131.9 1.0X
SQL Parquet - Comet (Spark Shuffle) 1420
1445 36 7.4 135.4 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle) 2118
2140 31 5.0 202.0 0.7X
SQL Parquet - Comet (Comet Shuffle) 827
829 2 12.7 78.8 1.7X
Running benchmark: SQL Wide (10 cols) BIGINT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 2850 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 2738 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 7090 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 3557 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) BIGINT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1402 1425 33 7.5 133.7 1.0X
SQL Parquet - Comet (Spark Shuffle)
1338 1369 44 7.8 127.6 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
3107 3545 619 3.4 296.3 0.5X
SQL Parquet - Comet (Comet Shuffle)
1709 1779 99 6.1 162.9 0.8X
Running benchmark: SQL Wide (10 cols) FLOAT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 5465 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 5619 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 7559 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 3 iterations, 2532 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) FLOAT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
2694 2733 55 3.9 256.9 1.0X
SQL Parquet - Comet (Spark Shuffle)
2799 2810 15 3.7 266.9 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
3368 3780 583 3.1 321.2 0.8X
SQL Parquet - Comet (Comet Shuffle)
823 844 31 12.7 78.4 3.3X
Running benchmark: SQL Wide (10 cols) DOUBLE Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 5158 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 5526 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 8208 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 3232 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) DOUBLE Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
2569 2579 14 4.1 245.0 1.0X
SQL Parquet - Comet (Spark Shuffle)
2717 2763 65 3.9 259.1 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
4069 4104 51 2.6 388.0 0.6X
SQL Parquet - Comet (Comet Shuffle)
1598 1616 26 6.6 152.4 1.6X
Running benchmark: SQL Wide (10 cols) STRING Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 6434 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 9318 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 14431 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 6138 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) STRING Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
2563 3217 925 4.1 244.4 1.0X
SQL Parquet - Comet (Spark Shuffle)
4599 4659 85 2.3 438.6 0.6X
SQL Parquet - Comet (Comet Arrow Shuffle)
7193 7216 31 1.5 686.0 0.4X
SQL Parquet - Comet (Comet Shuffle)
3013 3069 80 3.5 287.3 0.9X
Running benchmark: SQL Wide (10 cols) DECIMAL(10,0) Range Partition
Shuffle(201 Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3196 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3315 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 6514 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2181 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (10 cols) DECIMAL(10,0) Range Partition Shuffle(201 Partition):
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1584 1598 21 6.6 151.0 1.0X
SQL Parquet - Comet (Spark Shuffle)
1636 1658 30 6.4 156.1 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
2679 3257 818 3.9 255.5 0.6X
SQL Parquet - Comet (Comet Shuffle)
1073 1091 26 9.8 102.3 1.5X
Running benchmark: SQL Wide (20 cols) BOOLEAN Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3919 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 4283 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 3577 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2688 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) BOOLEAN Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1904 1960 79 5.5 181.6 1.0X
SQL Parquet - Comet (Spark Shuffle)
2121 2142 30 4.9 202.2 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
1722 1789 94 6.1 164.3 1.1X
SQL Parquet - Comet (Comet Shuffle)
1313 1344 44 8.0 125.2 1.4X
Running benchmark: SQL Wide (20 cols) TINYINT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3582 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3556 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 5331 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2335 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) TINYINT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1769 1791 32 5.9 168.7 1.0X
SQL Parquet - Comet (Spark Shuffle)
1767 1778 16 5.9 168.5 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
2656 2666 14 3.9 253.3 0.7X
SQL Parquet - Comet (Comet Shuffle)
1166 1168 2 9.0 111.2 1.5X
Running benchmark: SQL Wide (20 cols) SMALLINT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3401 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3581 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 8386 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2941 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) SMALLINT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1694 1701 10 6.2 161.5 1.0X
SQL Parquet - Comet (Spark Shuffle)
1777 1791 19 5.9 169.5 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
3623 4193 807 2.9 345.5 0.5X
SQL Parquet - Comet (Comet Shuffle)
1387 1471 119 7.6 132.3 1.2X
Running benchmark: SQL Wide (20 cols) INT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3509 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3801 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 7523 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2614 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) INT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark 1747
1755 11 6.0 166.6 1.0X
SQL Parquet - Comet (Spark Shuffle) 1896
1901 6 5.5 180.9 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle) 3655
3762 150 2.9 348.6 0.5X
SQL Parquet - Comet (Comet Shuffle) 1266
1307 59 8.3 120.7 1.4X
Running benchmark: SQL Wide (20 cols) BIGINT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 4458 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 4429 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 10341 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 4792 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) BIGINT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
2208 2229 30 4.7 210.5 1.0X
SQL Parquet - Comet (Spark Shuffle)
2204 2215 16 4.8 210.2 1.0X
SQL Parquet - Comet (Comet Arrow Shuffle)
3520 5171 2335 3.0 335.7 0.6X
SQL Parquet - Comet (Comet Shuffle)
2367 2396 41 4.4 225.8 0.9X
Running benchmark: SQL Wide (20 cols) FLOAT Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 5023 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3763 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 5757 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2588 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) FLOAT Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
2137 2512 530 4.9 203.8 1.0X
SQL Parquet - Comet (Spark Shuffle)
1872 1882 13 5.6 178.5 1.1X
SQL Parquet - Comet (Comet Arrow Shuffle)
2820 2879 84 3.7 268.9 0.8X
SQL Parquet - Comet (Comet Shuffle)
1266 1294 39 8.3 120.8 1.7X
Running benchmark: SQL Wide (20 cols) DOUBLE Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 3455 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 3656 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 6597 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 2804 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) DOUBLE Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
1702 1728 37 6.2 162.3 1.0X
SQL Parquet - Comet (Spark Shuffle)
1818 1828 15 5.8 173.3 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
3086 3299 301 3.4 294.3 0.6X
SQL Parquet - Comet (Comet Shuffle)
1360 1402 60 7.7 129.7 1.3X
Running benchmark: SQL Wide (20 cols) STRING Range Partition Shuffle(201
Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 7663 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 6688 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 20231 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 6006 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) STRING Range Partition Shuffle(201 Partition): Best
Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
3717 3832 162 2.8 354.5 1.0X
SQL Parquet - Comet (Spark Shuffle)
3333 3344 16 3.1 317.9 1.1X
SQL Parquet - Comet (Comet Arrow Shuffle)
9871 10116 346 1.1 941.4 0.4X
SQL Parquet - Comet (Comet Shuffle)
2985 3003 25 3.5 284.7 1.2X
Running benchmark: SQL Wide (20 cols) DECIMAL(10,0) Range Partition
Shuffle(201 Partition)
Running case: SQL Parquet - Spark
Stopped after 2 iterations, 4262 ms
Running case: SQL Parquet - Comet (Spark Shuffle)
Stopped after 2 iterations, 4635 ms
Running case: SQL Parquet - Comet (Comet Arrow Shuffle)
Stopped after 2 iterations, 10236 ms
Running case: SQL Parquet - Comet (Comet Shuffle)
Stopped after 2 iterations, 3876 ms
OpenJDK 64-Bit Server VM 11.0.28+6-LTS on Mac OS X 26.0
Apple M3 Max
SQL Wide (20 cols) DECIMAL(10,0) Range Partition Shuffle(201 Partition):
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------
SQL Parquet - Spark
2109 2131 32 5.0 201.1 1.0X
SQL Parquet - Comet (Spark Shuffle)
2312 2318 8 4.5 220.5 0.9X
SQL Parquet - Comet (Comet Arrow Shuffle)
4223 5118 1267 2.5 402.7 0.5X
SQL Parquet - Comet (Comet Shuffle)
1918 1938 29 5.5 182.9 1.1X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
