HippoBaro commented on PR #9830: URL: https://github.com/apache/arrow-rs/pull/9830#issuecomment-4330926651
> 🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9830#issuecomment-4330457485) > > **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) > > CPU Details (lscpu) > ``` > Architecture: aarch64 > CPU op-mode(s): 64-bit > Byte Order: Little Endian > CPU(s): 16 > On-line CPU(s) list: 0-15 > Vendor ID: ARM > Model name: Neoverse-V2 > Model: 1 > Thread(s) per core: 1 > Core(s) per cluster: 16 > Socket(s): - > Cluster(s): 1 > Stepping: r0p1 > BogoMIPS: 2000.00 > Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti > L1d cache: 1 MiB (16 instances) > L1i cache: 1 MiB (16 instances) > L2 cache: 32 MiB (16 instances) > L3 cache: 80 MiB (1 instance) > NUMA node(s): 1 > NUMA node0 CPU(s): 0-15 > Vulnerability Gather data sampling: Not affected > Vulnerability Indirect target selection: Not affected > Vulnerability Itlb multihit: Not affected > Vulnerability L1tf: Not affected > Vulnerability Mds: Not affected > Vulnerability Meltdown: Not affected > Vulnerability Mmio stale data: Not affected > Vulnerability Reg file data sampling: Not affected > Vulnerability Retbleed: Not affected > Vulnerability Spec rstack overflow: Not affected > Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl > Vulnerability Spectre v1: Mitigation; __user pointer sanitization > Vulnerability Spectre v2: Mitigation; CSV2, BHB > Vulnerability Srbds: Not affected > Vulnerability Tsa: Not affected > Vulnerability Tsx async abort: Not affected > Vulnerability Vmscape: Not affected > ``` > > Details > > ``` > group batch_rle_run main > ----- ------------- ---- > bool/bloom_filter 1.04 13.0±0.09ms 19.2 MB/sec 1.00 12.6±0.04ms 19.9 MB/sec > bool/cdc 1.03 15.6±0.10ms 16.0 MB/sec 1.00 15.2±0.05ms 16.5 MB/sec > bool/default 1.05 11.0±0.08ms 22.7 MB/sec 1.00 10.5±0.05ms 23.8 MB/sec > bool/parquet_2 1.03 14.7±0.10ms 17.0 MB/sec 1.00 14.2±0.05ms 17.6 MB/sec > bool/zstd 1.04 11.5±0.08ms 21.8 MB/sec 1.00 11.0±0.05ms 22.7 MB/sec > bool/zstd_parquet_2 1.03 15.0±0.09ms 16.7 MB/sec 1.00 14.6±0.05ms 17.1 MB/sec > bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.8 MB/sec 1.00 7.0±0.03ms 17.9 MB/sec > bool_non_null/cdc 1.02 6.8±0.03ms 18.3 MB/sec 1.00 6.7±0.02ms 18.6 MB/sec > bool_non_null/default 1.01 4.2±0.02ms 29.4 MB/sec 1.00 4.2±0.02ms 29.7 MB/sec > bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.00 9.0±0.03ms 13.9 MB/sec > bool_non_null/zstd 1.01 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.4 MB/sec > bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.3 MB/sec 1.00 9.4±0.03ms 13.3 MB/sec > float_with_nans/bloom_filter 1.02 94.0±0.44ms 149.0 MB/sec 1.00 92.4±0.36ms 151.5 MB/sec > float_with_nans/cdc 1.00 81.5±0.17ms 171.8 MB/sec 1.00 81.5±0.22ms 171.7 MB/sec > float_with_nans/default 1.01 75.1±0.86ms 186.4 MB/sec 1.00 74.0±0.24ms 189.1 MB/sec > float_with_nans/parquet_2 1.01 95.3±0.27ms 146.9 MB/sec 1.00 94.4±0.22ms 148.3 MB/sec > float_with_nans/zstd 1.00 112.5±0.36ms 124.4 MB/sec 1.00 112.0±0.26ms 125.0 MB/sec > float_with_nans/zstd_parquet_2 1.01 133.1±0.45ms 105.2 MB/sec 1.00 131.6±0.22ms 106.4 MB/sec > list_primitive/bloom_filter 1.01 319.6±2.68ms 1706.6 MB/sec 1.00 317.7±1.36ms 1716.9 MB/sec > list_primitive/cdc 1.00 343.8±2.83ms 1586.3 MB/sec 1.01 346.2±2.94ms 1575.2 MB/sec > list_primitive/default 1.00 238.2±2.58ms 2.2 GB/sec 1.01 239.5±1.65ms 2.2 GB/sec > list_primitive/parquet_2 1.00 256.8±0.48ms 2.1 GB/sec 1.02 262.0±1.00ms 2.0 GB/sec > list_primitive/zstd 1.02 488.3±2.17ms 1116.8 MB/sec 1.00 479.0±2.20ms 1138.6 MB/sec > list_primitive/zstd_parquet_2 1.01 479.5±0.77ms 1137.3 MB/sec 1.00 476.8±0.42ms 1143.9 MB/sec > list_primitive_non_null/bloom_filter 1.00 409.6±5.41ms 1328.6 MB/sec 1.07 436.6±19.21ms 1246.6 MB/sec > list_primitive_non_null/cdc 1.00 425.1±9.00ms 1280.2 MB/sec 1.00 426.5±7.34ms 1276.1 MB/sec > list_primitive_non_null/default 1.00 279.6±4.59ms 1946.2 MB/sec 1.10 307.5±13.54ms 1770.1 MB/sec > list_primitive_non_null/parquet_2 1.00 293.8±11.66ms 1852.2 MB/sec 1.00 293.6±7.99ms 1853.9 MB/sec > list_primitive_non_null/zstd 1.00 697.0±9.93ms 780.9 MB/sec 1.01 706.5±14.66ms 770.3 MB/sec > list_primitive_non_null/zstd_parquet_2 1.00 677.5±0.49ms 803.3 MB/sec 1.02 689.1±1.40ms 789.8 MB/sec > list_primitive_sparse_99pct_null/bloom_filter 1.00 11.7±0.22ms 3.1 GB/sec 1.69 19.7±0.08ms 1892.9 MB/sec > list_primitive_sparse_99pct_null/cdc 1.00 22.4±0.12ms 1664.8 MB/sec 1.35 30.3±0.12ms 1231.3 MB/sec > list_primitive_sparse_99pct_null/default 1.00 11.2±0.10ms 3.3 GB/sec 1.75 19.5±0.11ms 1915.4 MB/sec > list_primitive_sparse_99pct_null/parquet_2 1.00 11.6±0.10ms 3.2 GB/sec 1.68 19.4±0.06ms 1926.2 MB/sec > list_primitive_sparse_99pct_null/zstd 1.00 13.6±0.09ms 2.7 GB/sec 1.57 21.3±0.07ms 1751.1 MB/sec > list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.7±0.06ms 3.1 GB/sec 1.67 19.6±0.11ms 1906.7 MB/sec > primitive/bloom_filter 1.04 150.5±0.66ms 298.2 MB/sec 1.00 145.3±0.52ms 308.8 MB/sec > primitive/cdc 1.03 157.0±0.69ms 285.8 MB/sec 1.00 152.6±0.47ms 294.0 MB/sec > primitive/default 1.03 118.1±0.53ms 380.0 MB/sec 1.00 114.3±0.30ms 392.5 MB/sec > primitive/parquet_2 1.04 134.6±1.66ms 333.3 MB/sec 1.00 129.7±0.65ms 345.9 MB/sec > primitive/zstd 1.03 148.5±0.78ms 302.2 MB/sec 1.00 143.9±0.45ms 311.8 MB/sec > primitive/zstd_parquet_2 1.03 167.6±1.68ms 267.7 MB/sec 1.00 162.7±0.40ms 275.9 MB/sec > primitive_all_null/bloom_filter 1.00 11.7±0.23ms 3.7 GB/sec 1.95 22.8±0.05ms 1968.2 MB/sec > primitive_all_null/cdc 1.00 28.2±0.35ms 1593.8 MB/sec 1.40 39.3±0.18ms 1141.1 MB/sec > primitive_all_null/default 1.00 11.1±0.28ms 4.0 GB/sec 2.00 22.1±0.02ms 2026.6 MB/sec > primitive_all_null/parquet_2 1.00 11.0±0.23ms 4.0 GB/sec 2.01 22.2±0.06ms 2025.3 MB/sec > primitive_all_null/zstd 1.00 11.2±0.27ms 3.9 GB/sec 1.99 22.3±0.09ms 2008.2 MB/sec > primitive_all_null/zstd_parquet_2 1.00 11.2±0.26ms 3.9 GB/sec 1.99 22.3±0.03ms 2016.3 MB/sec > primitive_non_null/bloom_filter 1.01 113.6±2.15ms 387.3 MB/sec 1.00 112.0±1.19ms 392.8 MB/sec > primitive_non_null/cdc 1.01 91.3±0.54ms 482.1 MB/sec 1.00 89.9±0.21ms 489.3 MB/sec > primitive_non_null/default 1.00 68.1±0.22ms 646.1 MB/sec 1.00 68.1±0.17ms 645.9 MB/sec > primitive_non_null/parquet_2 1.02 91.0±6.39ms 483.8 MB/sec 1.00 89.3±0.20ms 492.8 MB/sec > primitive_non_null/zstd 1.00 105.5±1.85ms 417.2 MB/sec 1.00 105.1±0.23ms 418.6 MB/sec > primitive_non_null/zstd_parquet_2 1.00 130.0±2.78ms 338.4 MB/sec 1.00 129.9±1.80ms 338.8 MB/sec > primitive_sparse_99pct_null/bloom_filter 1.00 18.1±0.08ms 2.4 GB/sec 1.55 28.1±0.21ms 1594.2 MB/sec > primitive_sparse_99pct_null/cdc 1.00 34.5±0.23ms 1300.3 MB/sec 1.29 44.4±0.11ms 1011.5 MB/sec > primitive_sparse_99pct_null/default 1.00 16.7±0.04ms 2.6 GB/sec 1.59 26.4±0.17ms 1697.5 MB/sec > primitive_sparse_99pct_null/parquet_2 1.00 16.7±0.05ms 2.6 GB/sec 1.59 26.6±0.08ms 1686.1 MB/sec > primitive_sparse_99pct_null/zstd 1.00 20.2±0.87ms 2.2 GB/sec 1.48 29.9±0.07ms 1502.7 MB/sec > primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.9±0.87ms 2.3 GB/sec 1.51 28.5±0.08ms 1572.5 MB/sec > string/bloom_filter 1.00 215.2±14.69ms 2.4 GB/sec 1.00 214.2±16.44ms 2.4 GB/sec > string/cdc 1.00 222.1±6.62ms 2.3 GB/sec 1.00 221.4±6.47ms 2.3 GB/sec > string/default 1.07 133.1±17.77ms 3.8 GB/sec 1.00 124.6±17.04ms 4.1 GB/sec > string/parquet_2 1.53 170.9±0.87ms 3.0 GB/sec 1.00 111.5±10.64ms 4.6 GB/sec > string/zstd 1.07 447.5±17.23ms 1171.5 MB/sec 1.00 417.7±2.47ms 1255.2 MB/sec > string/zstd_parquet_2 1.01 401.8±4.21ms 1304.8 MB/sec 1.00 396.8±1.75ms 1321.3 MB/sec > string_and_binary_view/bloom_filter 1.04 66.0±0.34ms 488.4 MB/sec 1.00 63.3±0.31ms 509.4 MB/sec > string_and_binary_view/cdc 1.03 58.5±0.25ms 550.9 MB/sec 1.00 57.0±0.32ms 565.9 MB/sec > string_and_binary_view/default 1.02 48.7±0.21ms 662.5 MB/sec 1.00 47.5±3.57ms 678.9 MB/sec > string_and_binary_view/parquet_2 1.03 59.6±0.28ms 541.3 MB/sec 1.00 58.1±0.23ms 555.3 MB/sec > string_and_binary_view/zstd 1.02 85.1±0.29ms 379.1 MB/sec 1.00 83.6±0.20ms 385.7 MB/sec > string_and_binary_view/zstd_parquet_2 1.03 73.5±0.27ms 439.1 MB/sec 1.00 71.7±0.19ms 450.1 MB/sec > string_dictionary/bloom_filter 1.15 102.1±0.35ms 2.5 GB/sec 1.00 88.6±0.71ms 2.9 GB/sec > string_dictionary/cdc 1.38 72.2±1.72ms 3.6 GB/sec 1.00 52.5±0.48ms 4.9 GB/sec > string_dictionary/default 1.20 58.0±0.55ms 4.4 GB/sec 1.00 48.4±0.36ms 5.3 GB/sec > string_dictionary/parquet_2 1.00 53.5±0.26ms 4.8 GB/sec 1.01 53.9±0.23ms 4.8 GB/sec > string_dictionary/zstd 1.08 225.1±0.68ms 1173.4 MB/sec 1.00 208.6±0.41ms 1266.5 MB/sec > string_dictionary/zstd_parquet_2 1.01 198.9±0.26ms 1328.3 MB/sec 1.00 197.4±0.27ms 1338.2 MB/sec > string_non_null/bloom_filter 1.11 268.6±14.61ms 1950.9 MB/sec 1.00 241.0±10.73ms 2.1 GB/sec > string_non_null/cdc 1.03 277.5±9.80ms 1888.4 MB/sec 1.00 270.2±7.42ms 1939.5 MB/sec > string_non_null/default 1.23 151.4±16.42ms 3.4 GB/sec 1.00 122.8±7.12ms 4.2 GB/sec > string_non_null/parquet_2 1.08 143.2±7.81ms 3.6 GB/sec 1.00 132.2±6.03ms 3.9 GB/sec > string_non_null/zstd 1.07 568.0±6.69ms 922.5 MB/sec 1.00 531.2±2.29ms 986.4 MB/sec > string_non_null/zstd_parquet_2 1.03 519.0±11.28ms 1009.6 MB/sec 1.00 502.2±0.67ms 1043.5 MB/sec > struct_all_null/bloom_filter 1.00 4.2±0.07ms 3.7 GB/sec 2.14 9.0±0.01ms 1793.5 MB/sec > struct_all_null/cdc 1.00 10.7±0.12ms 1505.0 MB/sec 1.45 15.5±0.11ms 1040.2 MB/sec > struct_all_null/default 1.00 3.9±0.05ms 4.0 GB/sec 2.23 8.7±0.01ms 1853.0 MB/sec > struct_all_null/parquet_2 1.00 3.9±0.08ms 4.0 GB/sec 2.22 8.7±0.01ms 1853.5 MB/sec > struct_all_null/zstd 1.00 4.0±0.06ms 4.0 GB/sec 2.21 8.8±0.01ms 1842.0 MB/sec > struct_all_null/zstd_parquet_2 1.00 4.0±0.06ms 4.0 GB/sec 2.21 8.7±0.01ms 1846.6 MB/sec > struct_non_null/bloom_filter 1.00 50.4±0.17ms 317.7 MB/sec 1.13 57.0±0.20ms 280.8 MB/sec > struct_non_null/cdc 1.00 46.6±0.11ms 343.1 MB/sec 1.12 52.1±0.24ms 306.8 MB/sec > struct_non_null/default 1.00 34.4±0.09ms 465.7 MB/sec 1.16 39.8±0.18ms 402.3 MB/sec > struct_non_null/parquet_2 1.00 42.8±0.08ms 374.0 MB/sec 1.13 48.3±0.12ms 331.0 MB/sec > struct_non_null/zstd 1.00 42.8±0.09ms 373.7 MB/sec 1.13 48.2±0.14ms 331.7 MB/sec > struct_non_null/zstd_parquet_2 1.00 56.4±0.13ms 283.7 MB/sec 1.10 62.1±0.18ms 257.8 MB/sec > struct_sparse_99pct_null/bloom_filter 1.00 7.6±0.12ms 2.1 GB/sec 1.54 11.6±0.10ms 1386.1 MB/sec > struct_sparse_99pct_null/cdc 1.00 13.8±0.09ms 1169.9 MB/sec 1.32 18.3±0.13ms 883.2 MB/sec > struct_sparse_99pct_null/default 1.00 6.9±0.04ms 2.3 GB/sec 1.63 11.2±0.07ms 1441.2 MB/sec > struct_sparse_99pct_null/parquet_2 1.00 6.9±0.05ms 2.3 GB/sec 1.60 11.0±0.03ms 1466.4 MB/sec > struct_sparse_99pct_null/zstd 1.00 8.3±0.07ms 1944.3 MB/sec 1.49 12.4±0.05ms 1301.2 MB/sec > struct_sparse_99pct_null/zstd_parquet_2 1.00 7.6±0.05ms 2.1 GB/sec 1.56 11.9±0.10ms 1357.8 MB/sec > ``` > > Resource Usage > **base (merge-base)** > > Metric Value > Wall time 1915.4s > Peak memory 6.6 GiB > Avg memory 6.4 GiB > CPU user 1861.0s > CPU sys 52.0s > Peak spill 0 B > **branch** > > Metric Value > Wall time 1925.4s > Peak memory 6.6 GiB > Avg memory 6.4 GiB > CPU user 1853.7s > CPU sys 70.0s > Peak spill 0 B > [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner That's more like it! :noice: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
