adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4461701137
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4461247885) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.02 13.1±0.08ms 19.0 MB/sec 1.00 12.9±0.07ms 19.3 MB/sec bool/cdc 1.01 16.0±0.11ms 15.6 MB/sec 1.00 15.8±0.10ms 15.8 MB/sec bool/default 1.02 11.0±0.06ms 22.6 MB/sec 1.00 10.8±0.05ms 23.1 MB/sec bool/parquet_2 1.01 14.9±0.06ms 16.8 MB/sec 1.00 14.7±0.06ms 17.0 MB/sec bool/zstd 1.01 11.5±0.08ms 21.7 MB/sec 1.00 11.4±0.05ms 22.0 MB/sec bool/zstd_parquet_2 1.00 15.2±0.08ms 16.5 MB/sec 1.00 15.1±0.05ms 16.5 MB/sec bool_non_null/bloom_filter 1.00 7.1±0.03ms 17.7 MB/sec 1.00 7.1±0.04ms 17.7 MB/sec bool_non_null/cdc 1.00 6.9±0.08ms 18.1 MB/sec 1.00 6.9±0.07ms 18.0 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.2 MB/sec 1.00 4.3±0.02ms 29.1 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.01 9.1±0.04ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.0 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.3 MB/sec 1.01 9.5±0.04ms 13.1 MB/sec float_with_nans/bloom_filter 1.00 93.7±2.24ms 149.5 MB/sec 1.01 94.8±0.84ms 147.6 MB/sec float_with_nans/cdc 1.00 82.3±1.53ms 170.1 MB/sec 1.01 83.3±0.64ms 168.1 MB/sec float_with_nans/default 1.01 76.1±1.09ms 184.0 MB/sec 1.00 75.6±0.49ms 185.2 MB/sec float_with_nans/parquet_2 1.00 96.2±0.88ms 145.5 MB/sec 1.00 96.5±2.03ms 145.1 MB/sec float_with_nans/zstd 1.00 113.0±0.89ms 123.8 MB/sec 1.00 112.5±1.30ms 124.4 MB/sec float_with_nans/zstd_parquet_2 1.00 134.1±1.84ms 104.4 MB/sec 1.00 133.6±1.05ms 104.8 MB/sec large_string_non_null/bloom_filter 1.00 82.4±2.71ms 3.0 GB/sec large_string_non_null/cdc 1.00 243.8±2.51ms 1049.9 MB/sec large_string_non_null/default 1.00 64.3±2.33ms 3.9 GB/sec large_string_non_null/parquet_2 1.00 63.6±1.81ms 3.9 GB/sec large_string_non_null/zstd 1.00 63.5±0.94ms 3.9 GB/sec large_string_non_null/zstd_parquet_2 1.00 63.3±1.81ms 4.0 GB/sec list_primitive/bloom_filter 1.00 337.7±9.69ms 1614.8 MB/sec 1.01 341.5±9.51ms 1596.9 MB/sec list_primitive/cdc 1.01 373.0±7.60ms 1462.0 MB/sec 1.00 369.2±3.64ms 1477.1 MB/sec list_primitive/default 1.00 257.2±3.41ms 2.1 GB/sec 1.00 257.6±4.71ms 2.1 GB/sec list_primitive/parquet_2 1.01 279.3±2.15ms 1952.5 MB/sec 1.00 277.4±2.07ms 1966.2 MB/sec list_primitive/zstd 1.00 511.9±4.47ms 1065.5 MB/sec 1.00 510.9±5.07ms 1067.4 MB/sec list_primitive/zstd_parquet_2 1.00 502.3±2.32ms 1085.8 MB/sec 1.00 502.5±3.18ms 1085.2 MB/sec list_primitive_non_null/bloom_filter 1.00 414.2±11.72ms 1313.8 MB/sec 1.02 421.2±15.76ms 1292.2 MB/sec list_primitive_non_null/cdc 1.00 445.7±9.47ms 1221.0 MB/sec 1.01 448.9±11.81ms 1212.3 MB/sec list_primitive_non_null/default 1.00 275.0±7.27ms 1978.8 MB/sec 1.03 283.4±7.83ms 1920.6 MB/sec list_primitive_non_null/parquet_2 1.00 298.9±3.93ms 1820.7 MB/sec 1.02 306.3±10.15ms 1777.0 MB/sec list_primitive_non_null/zstd 1.00 698.9±8.09ms 778.7 MB/sec 1.00 697.9±9.19ms 779.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 675.1±3.80ms 806.2 MB/sec 1.00 675.0±4.27ms 806.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.8±0.33ms 3.1 GB/sec 1.01 11.8±0.07ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 23.5±0.24ms 1587.6 MB/sec 1.00 23.4±0.18ms 1597.7 MB/sec list_primitive_sparse_99pct_null/default 1.02 11.5±0.15ms 3.2 GB/sec 1.00 11.3±0.13ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.2±0.22ms 3.3 GB/sec 1.00 11.2±0.25ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.03 13.3±0.13ms 2.7 GB/sec 1.00 12.9±0.26ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.04 11.7±0.13ms 3.1 GB/sec 1.00 11.2±0.23ms 3.3 GB/sec primitive/bloom_filter 1.00 152.0±1.60ms 295.2 MB/sec 1.00 152.8±2.07ms 293.8 MB/sec primitive/cdc 1.02 161.5±1.31ms 277.9 MB/sec 1.00 158.9±1.80ms 282.5 MB/sec primitive/default 1.00 118.9±1.67ms 377.3 MB/sec 1.00 119.4±0.76ms 376.0 MB/sec primitive/parquet_2 1.01 135.2±1.02ms 331.8 MB/sec 1.00 133.7±1.85ms 335.6 MB/sec primitive/zstd 1.00 148.7±1.75ms 301.8 MB/sec 1.00 148.9±0.80ms 301.3 MB/sec primitive/zstd_parquet_2 1.00 168.4±0.85ms 266.4 MB/sec 1.00 167.7±1.16ms 267.5 MB/sec primitive_all_null/bloom_filter 1.00 884.3±23.62µs 49.6 GB/sec 1.06 936.8±11.16µs 46.8 GB/sec primitive_all_null/cdc 1.00 18.0±0.34ms 2.4 GB/sec 1.07 19.3±0.43ms 2.3 GB/sec primitive_all_null/default 1.00 263.9±0.92µs 166.0 GB/sec 1.04 274.7±0.90µs 159.5 GB/sec primitive_all_null/parquet_2 1.00 260.0±1.63µs 168.5 GB/sec 1.07 278.9±1.05µs 157.1 GB/sec primitive_all_null/zstd 1.00 374.3±0.67µs 117.1 GB/sec 1.04 387.7±0.94µs 113.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 336.0±1.32µs 130.4 GB/sec 1.06 356.2±1.14µs 123.0 GB/sec primitive_non_null/bloom_filter 1.00 107.6±2.39ms 408.7 MB/sec 1.02 109.6±1.83ms 401.5 MB/sec primitive_non_null/cdc 1.00 91.4±1.28ms 481.3 MB/sec 1.01 92.1±1.08ms 477.7 MB/sec primitive_non_null/default 1.00 68.3±1.66ms 644.6 MB/sec 1.01 69.2±0.81ms 636.2 MB/sec primitive_non_null/parquet_2 1.00 90.2±0.73ms 488.0 MB/sec 1.01 91.4±1.18ms 481.4 MB/sec primitive_non_null/zstd 1.08 106.8±1.14ms 412.1 MB/sec 1.00 99.0±1.66ms 444.5 MB/sec primitive_non_null/zstd_parquet_2 1.04 129.9±2.91ms 338.7 MB/sec 1.00 124.4±0.99ms 353.6 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 19.2±0.49ms 2.3 GB/sec 1.00 19.3±0.25ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 35.6±0.46ms 1258.9 MB/sec 1.02 36.2±0.41ms 1239.7 MB/sec primitive_sparse_99pct_null/default 1.00 17.2±0.06ms 2.5 GB/sec 1.00 17.3±0.22ms 2.5 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 17.0±0.33ms 2.6 GB/sec 1.02 17.4±0.09ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.4±0.28ms 2.2 GB/sec 1.02 20.7±0.29ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 19.2±0.11ms 2.3 GB/sec 1.00 19.0±0.34ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 27.3±0.37ms 439.2 MB/sec short_string_non_null/cdc 1.00 20.4±0.08ms 589.1 MB/sec short_string_non_null/default 1.00 16.0±0.22ms 751.1 MB/sec short_string_non_null/parquet_2 1.00 25.5±0.12ms 470.3 MB/sec short_string_non_null/zstd 1.00 35.6±0.12ms 337.4 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.5±0.12ms 421.1 MB/sec string/bloom_filter 1.02 229.5±26.84ms 2.2 GB/sec 1.00 225.8±17.82ms 2.3 GB/sec string/cdc 1.00 223.7±6.15ms 2.3 GB/sec 1.01 225.3±10.03ms 2.3 GB/sec string/default 1.00 130.6±22.42ms 3.9 GB/sec 1.00 130.1±9.25ms 3.9 GB/sec string/parquet_2 1.00 113.4±7.32ms 4.5 GB/sec 1.14 129.1±2.05ms 4.0 GB/sec string/zstd 1.00 422.6±5.34ms 1240.5 MB/sec 1.07 450.2±20.31ms 1164.5 MB/sec string/zstd_parquet_2 1.00 405.6±7.28ms 1292.6 MB/sec 1.00 406.9±6.17ms 1288.3 MB/sec string_and_binary_view/bloom_filter 1.00 66.6±1.31ms 484.4 MB/sec 1.04 69.3±1.44ms 465.3 MB/sec string_and_binary_view/cdc 1.00 58.9±0.77ms 547.3 MB/sec 1.06 62.3±1.50ms 518.0 MB/sec string_and_binary_view/default 1.00 48.3±0.65ms 667.3 MB/sec 1.07 51.7±1.34ms 623.8 MB/sec string_and_binary_view/parquet_2 1.00 60.3±1.24ms 534.9 MB/sec 1.03 62.2±1.13ms 518.3 MB/sec string_and_binary_view/zstd 1.00 84.8±1.19ms 380.1 MB/sec 1.05 88.9±1.23ms 362.8 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.4±0.67ms 439.6 MB/sec 1.04 76.2±1.62ms 423.1 MB/sec string_dictionary/bloom_filter 1.00 96.0±5.76ms 2.7 GB/sec 1.01 97.3±3.97ms 2.6 GB/sec string_dictionary/cdc 1.00 52.9±2.49ms 4.9 GB/sec 1.08 57.3±1.59ms 4.5 GB/sec string_dictionary/default 1.00 48.7±1.44ms 5.3 GB/sec 1.09 52.9±1.45ms 4.9 GB/sec string_dictionary/parquet_2 1.00 54.2±1.29ms 4.8 GB/sec 1.04 56.2±0.71ms 4.6 GB/sec string_dictionary/zstd 1.00 212.1±2.79ms 1245.1 MB/sec 1.00 213.1±3.66ms 1239.3 MB/sec string_dictionary/zstd_parquet_2 1.00 200.3±1.42ms 1318.8 MB/sec 1.00 200.1±0.96ms 1320.0 MB/sec string_non_null/bloom_filter 1.00 262.8±20.48ms 1993.6 MB/sec 1.03 272.0±14.10ms 1926.3 MB/sec string_non_null/cdc 1.00 270.5±5.10ms 1937.3 MB/sec 1.01 272.0±8.15ms 1926.3 MB/sec string_non_null/default 1.00 143.1±12.20ms 3.6 GB/sec 1.01 143.9±13.51ms 3.6 GB/sec string_non_null/parquet_2 1.00 132.6±4.41ms 3.9 GB/sec 1.05 139.6±7.76ms 3.7 GB/sec string_non_null/zstd 1.00 543.2±6.68ms 964.7 MB/sec 1.01 548.3±7.64ms 955.7 MB/sec string_non_null/zstd_parquet_2 1.00 507.0±3.05ms 1033.5 MB/sec 1.00 508.5±2.96ms 1030.5 MB/sec struct_all_null/bloom_filter 1.00 367.0±4.83µs 42.9 GB/sec 1.04 382.7±4.73µs 41.2 GB/sec struct_all_null/cdc 1.00 7.1±0.12ms 2.2 GB/sec 1.10 7.9±0.23ms 2047.9 MB/sec struct_all_null/default 1.00 113.1±0.45µs 139.2 GB/sec 1.06 119.5±0.37µs 131.8 GB/sec struct_all_null/parquet_2 1.00 112.0±0.71µs 140.6 GB/sec 1.08 120.8±0.43µs 130.3 GB/sec struct_all_null/zstd 1.00 160.7±0.70µs 98.0 GB/sec 1.04 166.3±0.93µs 94.7 GB/sec struct_all_null/zstd_parquet_2 1.00 145.0±0.62µs 108.6 GB/sec 1.06 153.5±0.62µs 102.6 GB/sec struct_non_null/bloom_filter 1.00 46.6±1.26ms 343.3 MB/sec 1.03 48.0±1.40ms 333.1 MB/sec struct_non_null/cdc 1.00 45.4±0.75ms 352.1 MB/sec 1.02 46.5±0.35ms 344.2 MB/sec struct_non_null/default 1.00 32.7±0.64ms 489.0 MB/sec 1.00 32.8±0.26ms 488.3 MB/sec struct_non_null/parquet_2 1.00 41.1±0.28ms 389.2 MB/sec 1.01 41.4±0.65ms 386.4 MB/sec struct_non_null/zstd 1.00 41.3±0.49ms 387.0 MB/sec 1.00 41.3±0.49ms 387.6 MB/sec struct_non_null/zstd_parquet_2 1.00 55.5±0.46ms 288.4 MB/sec 1.00 55.3±0.28ms 289.4 MB/sec struct_sparse_99pct_null/bloom_filter 1.02 6.8±0.18ms 2.3 GB/sec 1.00 6.7±0.33ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.3±0.31ms 1213.5 MB/sec 1.04 13.8±0.27ms 1165.2 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.19ms 2.6 GB/sec 1.04 6.2±0.21ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.1±0.15ms 2.6 GB/sec 1.00 6.0±0.17ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.6±0.05ms 2.1 GB/sec 1.00 7.5±0.19ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.9±0.21ms 2.3 GB/sec 1.02 7.0±0.07ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1940.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1905.0s | | CPU sys | 33.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2080.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.7 GiB | | CPU user | 2038.4s | | CPU sys | 38.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
