adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4566743372
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4566182879) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.04 13.2±0.07ms 18.9 MB/sec 1.00 12.8±0.04ms 19.6 MB/sec bool/cdc 1.03 16.2±0.08ms 15.4 MB/sec 1.00 15.7±0.04ms 15.9 MB/sec bool/default 1.04 11.1±0.06ms 22.5 MB/sec 1.00 10.7±0.03ms 23.4 MB/sec bool/parquet_2 1.03 15.0±0.07ms 16.7 MB/sec 1.00 14.5±0.04ms 17.2 MB/sec bool/zstd 1.04 11.7±0.06ms 21.4 MB/sec 1.00 11.2±0.03ms 22.3 MB/sec bool/zstd_parquet_2 1.05 15.6±0.13ms 16.0 MB/sec 1.00 14.9±0.04ms 16.8 MB/sec bool_non_null/bloom_filter 1.02 7.0±0.02ms 17.8 MB/sec 1.00 6.9±0.03ms 18.1 MB/sec bool_non_null/cdc 1.04 6.9±0.23ms 18.1 MB/sec 1.00 6.6±0.04ms 18.8 MB/sec bool_non_null/default 1.03 4.3±0.02ms 29.2 MB/sec 1.00 4.1±0.02ms 30.2 MB/sec bool_non_null/parquet_2 1.01 9.1±0.03ms 13.8 MB/sec 1.00 9.0±0.04ms 13.9 MB/sec bool_non_null/zstd 1.03 4.6±0.02ms 27.0 MB/sec 1.00 4.5±0.02ms 27.7 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.00 9.4±0.04ms 13.3 MB/sec float_with_nans/bloom_filter 1.00 92.4±0.31ms 151.5 MB/sec 1.00 92.5±0.28ms 151.3 MB/sec float_with_nans/cdc 1.00 81.4±0.17ms 172.0 MB/sec 1.00 81.6±0.70ms 171.5 MB/sec float_with_nans/default 1.00 73.9±0.13ms 189.5 MB/sec 1.00 74.2±0.23ms 188.8 MB/sec float_with_nans/parquet_2 1.00 94.2±0.26ms 148.6 MB/sec 1.00 94.2±0.18ms 148.6 MB/sec float_with_nans/zstd 1.00 111.5±0.14ms 125.6 MB/sec 1.00 111.9±0.29ms 125.1 MB/sec float_with_nans/zstd_parquet_2 1.00 131.1±0.24ms 106.8 MB/sec 1.00 131.7±0.42ms 106.3 MB/sec large_string_non_null/bloom_filter 1.00 72.4±0.20ms 3.5 GB/sec 1.01 72.8±0.09ms 3.4 GB/sec large_string_non_null/cdc 1.00 239.1±1.09ms 1070.7 MB/sec 1.02 244.3±1.15ms 1048.1 MB/sec large_string_non_null/default 1.00 52.5±0.19ms 4.8 GB/sec 1.05 55.0±0.08ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 52.6±0.17ms 4.7 GB/sec 1.05 55.0±0.08ms 4.5 GB/sec large_string_non_null/zstd 1.00 52.6±0.20ms 4.8 GB/sec 1.05 55.0±0.08ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 52.6±0.18ms 4.8 GB/sec 1.05 55.1±0.09ms 4.5 GB/sec list_primitive/bloom_filter 1.07 356.5±1.63ms 1529.9 MB/sec 1.00 332.2±0.96ms 1641.5 MB/sec list_primitive/cdc 1.02 374.1±10.22ms 1457.9 MB/sec 1.00 365.8±0.76ms 1490.7 MB/sec list_primitive/default 1.09 278.1±2.15ms 1961.0 MB/sec 1.00 255.4±1.31ms 2.1 GB/sec list_primitive/parquet_2 1.08 298.0±0.66ms 1830.3 MB/sec 1.00 277.0±0.27ms 1969.1 MB/sec list_primitive/zstd 1.02 516.4±2.55ms 1056.2 MB/sec 1.00 505.5±0.62ms 1078.9 MB/sec list_primitive/zstd_parquet_2 1.00 500.8±1.42ms 1088.9 MB/sec 1.00 500.1±0.29ms 1090.5 MB/sec list_primitive_non_null/bloom_filter 1.09 444.9±10.80ms 1223.4 MB/sec 1.00 408.9±4.09ms 1331.0 MB/sec list_primitive_non_null/cdc 1.00 435.7±10.38ms 1249.1 MB/sec 1.00 436.8±7.09ms 1246.1 MB/sec list_primitive_non_null/default 1.13 314.2±14.83ms 1732.1 MB/sec 1.00 277.3±3.98ms 1962.8 MB/sec list_primitive_non_null/parquet_2 1.20 363.5±0.50ms 1497.2 MB/sec 1.00 302.5±7.83ms 1798.9 MB/sec list_primitive_non_null/zstd 1.00 698.8±14.82ms 778.9 MB/sec 1.00 698.1±5.95ms 779.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.06 714.0±18.42ms 762.3 MB/sec 1.00 670.5±0.49ms 811.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.8±0.04ms 3.1 GB/sec 1.03 12.1±0.03ms 3.0 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.2±0.06ms 1609.8 MB/sec 1.02 23.6±0.05ms 1581.8 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.5±0.02ms 3.2 GB/sec 1.03 11.8±0.02ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.5±0.03ms 3.2 GB/sec 1.03 11.8±0.03ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.3±0.03ms 2.7 GB/sec 1.03 13.6±0.03ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.6±0.03ms 3.1 GB/sec 1.03 12.0±0.03ms 3.0 GB/sec primitive/bloom_filter 1.01 150.6±0.51ms 297.9 MB/sec 1.00 148.6±0.44ms 301.9 MB/sec primitive/cdc 1.01 159.0±0.60ms 282.3 MB/sec 1.00 157.8±0.52ms 284.3 MB/sec primitive/default 1.01 118.7±0.47ms 378.0 MB/sec 1.00 117.6±0.26ms 381.5 MB/sec primitive/parquet_2 1.01 133.7±0.47ms 335.7 MB/sec 1.00 132.2±0.23ms 339.5 MB/sec primitive/zstd 1.01 148.7±0.73ms 301.8 MB/sec 1.00 146.9±0.26ms 305.6 MB/sec primitive/zstd_parquet_2 1.01 166.9±0.45ms 268.9 MB/sec 1.00 165.3±0.26ms 271.5 MB/sec primitive_all_null/bloom_filter 1.00 890.3±2.09µs 49.2 GB/sec 1.02 905.9±2.28µs 48.4 GB/sec primitive_all_null/cdc 1.00 18.4±0.28ms 2.4 GB/sec 1.00 18.4±0.41ms 2.4 GB/sec primitive_all_null/default 1.00 272.5±0.60µs 160.8 GB/sec 1.02 278.3±1.40µs 157.5 GB/sec primitive_all_null/parquet_2 1.00 279.5±0.86µs 156.8 GB/sec 1.00 279.2±0.93µs 157.0 GB/sec primitive_all_null/zstd 1.00 386.5±0.94µs 113.4 GB/sec 1.02 392.9±1.14µs 111.5 GB/sec primitive_all_null/zstd_parquet_2 1.00 355.3±1.04µs 123.3 GB/sec 1.00 356.5±1.07µs 122.9 GB/sec primitive_non_null/bloom_filter 1.00 106.1±0.42ms 414.8 MB/sec 1.00 106.5±0.45ms 413.2 MB/sec primitive_non_null/cdc 1.00 89.8±0.34ms 490.1 MB/sec 1.01 90.7±0.48ms 485.4 MB/sec primitive_non_null/default 1.00 66.9±0.26ms 657.3 MB/sec 1.01 67.8±0.15ms 648.7 MB/sec primitive_non_null/parquet_2 1.00 88.6±0.23ms 496.5 MB/sec 1.01 89.5±0.23ms 491.7 MB/sec primitive_non_null/zstd 1.00 97.6±0.23ms 450.7 MB/sec 1.01 98.4±0.15ms 447.3 MB/sec primitive_non_null/zstd_parquet_2 1.00 122.5±0.27ms 359.1 MB/sec 1.00 123.0±0.14ms 357.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 11.8±0.07ms 3.7 GB/sec 1.01 11.9±0.05ms 3.7 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.0±0.25ms 1549.6 MB/sec 1.01 29.1±0.38ms 1539.5 MB/sec primitive_sparse_99pct_null/default 1.00 10.5±0.03ms 4.2 GB/sec 1.01 10.6±0.03ms 4.2 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.5±0.03ms 4.2 GB/sec 1.01 10.6±0.04ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 13.8±0.04ms 3.2 GB/sec 1.02 14.0±0.04ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.4±0.04ms 3.5 GB/sec 1.01 12.5±0.03ms 3.5 GB/sec short_string_non_null/bloom_filter 1.02 27.7±0.06ms 433.6 MB/sec 1.00 27.0±0.07ms 443.8 MB/sec short_string_non_null/cdc 1.00 19.8±0.05ms 607.5 MB/sec 1.01 19.9±0.06ms 604.1 MB/sec short_string_non_null/default 1.00 15.6±0.04ms 770.1 MB/sec 1.01 15.7±0.05ms 762.4 MB/sec short_string_non_null/parquet_2 1.00 25.5±0.07ms 471.3 MB/sec 1.00 25.4±0.10ms 471.8 MB/sec short_string_non_null/zstd 1.00 35.2±0.10ms 340.7 MB/sec 1.00 35.3±0.07ms 339.7 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.3±0.04ms 424.8 MB/sec 1.00 28.2±0.09ms 425.1 MB/sec string/bloom_filter 1.04 225.7±26.00ms 2.3 GB/sec 1.00 216.1±16.66ms 2.4 GB/sec string/cdc 1.00 213.8±7.38ms 2.4 GB/sec 1.03 221.1±9.36ms 2.3 GB/sec string/default 1.08 128.5±22.92ms 4.0 GB/sec 1.00 119.0±8.24ms 4.3 GB/sec string/parquet_2 1.00 108.0±5.73ms 4.7 GB/sec 1.74 187.5±10.07ms 2.7 GB/sec string/zstd 1.00 415.9±1.51ms 1260.5 MB/sec 1.08 451.0±19.27ms 1162.3 MB/sec string/zstd_parquet_2 1.00 408.4±11.63ms 1283.7 MB/sec 1.02 416.6±19.27ms 1258.3 MB/sec string_and_binary_view/bloom_filter 1.00 64.1±0.31ms 503.1 MB/sec 1.00 64.0±0.21ms 503.9 MB/sec string_and_binary_view/cdc 1.00 59.1±0.22ms 546.0 MB/sec 1.00 59.2±0.16ms 544.7 MB/sec string_and_binary_view/default 1.00 48.4±0.17ms 666.0 MB/sec 1.00 48.3±0.11ms 668.0 MB/sec string_and_binary_view/parquet_2 1.00 59.7±0.23ms 539.8 MB/sec 1.00 59.5±0.14ms 541.8 MB/sec string_and_binary_view/zstd 1.01 85.4±0.25ms 377.5 MB/sec 1.00 85.0±0.14ms 379.5 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.3±0.21ms 440.0 MB/sec 1.00 73.5±0.14ms 438.9 MB/sec string_dictionary/bloom_filter 1.00 89.8±0.67ms 2.9 GB/sec 1.02 91.4±0.20ms 2.8 GB/sec string_dictionary/cdc 1.00 53.3±0.51ms 4.8 GB/sec 1.00 53.2±0.58ms 4.9 GB/sec string_dictionary/default 1.01 48.9±0.43ms 5.3 GB/sec 1.00 48.6±0.98ms 5.3 GB/sec string_dictionary/parquet_2 1.00 54.0±0.22ms 4.8 GB/sec 1.00 54.2±0.30ms 4.8 GB/sec string_dictionary/zstd 1.00 208.7±0.42ms 1265.4 MB/sec 1.01 210.0±1.04ms 1257.9 MB/sec string_dictionary/zstd_parquet_2 1.00 198.5±0.17ms 1330.5 MB/sec 1.00 199.0±0.22ms 1327.0 MB/sec string_non_null/bloom_filter 1.07 252.6±15.97ms 2.0 GB/sec 1.00 236.3±1.68ms 2.2 GB/sec string_non_null/cdc 1.02 275.1±14.26ms 1904.4 MB/sec 1.00 269.3±6.78ms 1945.7 MB/sec string_non_null/default 1.00 137.2±15.05ms 3.7 GB/sec 1.00 136.9±15.20ms 3.7 GB/sec string_non_null/parquet_2 1.16 139.1±5.97ms 3.7 GB/sec 1.00 120.2±0.66ms 4.3 GB/sec string_non_null/zstd 1.06 567.8±14.14ms 922.9 MB/sec 1.00 533.5±0.97ms 982.1 MB/sec string_non_null/zstd_parquet_2 1.00 503.0±4.83ms 1041.7 MB/sec 1.00 502.5±0.50ms 1042.8 MB/sec struct_all_null/bloom_filter 1.00 378.2±1.64µs 41.6 GB/sec 1.00 377.0±1.08µs 41.8 GB/sec struct_all_null/cdc 1.00 7.3±0.08ms 2.2 GB/sec 1.01 7.4±0.09ms 2.1 GB/sec struct_all_null/default 1.00 118.5±0.26µs 132.9 GB/sec 1.02 121.3±0.55µs 129.8 GB/sec struct_all_null/parquet_2 1.00 119.7±0.33µs 131.6 GB/sec 1.01 121.0±0.31µs 130.1 GB/sec struct_all_null/zstd 1.00 164.8±1.10µs 95.6 GB/sec 1.03 169.5±0.46µs 92.9 GB/sec struct_all_null/zstd_parquet_2 1.00 151.7±0.41µs 103.8 GB/sec 1.02 154.0±0.24µs 102.2 GB/sec struct_non_null/bloom_filter 1.00 45.7±0.18ms 350.0 MB/sec 1.01 46.1±0.26ms 347.2 MB/sec struct_non_null/cdc 1.00 45.1±0.18ms 354.6 MB/sec 1.01 45.7±0.16ms 350.2 MB/sec struct_non_null/default 1.00 31.7±0.16ms 505.4 MB/sec 1.03 32.5±0.09ms 493.0 MB/sec struct_non_null/parquet_2 1.00 40.5±0.20ms 395.4 MB/sec 1.01 41.0±0.12ms 390.0 MB/sec struct_non_null/zstd 1.00 40.3±0.17ms 397.3 MB/sec 1.02 40.9±0.11ms 390.7 MB/sec struct_non_null/zstd_parquet_2 1.00 54.4±0.17ms 294.4 MB/sec 1.01 55.1±0.12ms 290.6 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.4±0.02ms 2.5 GB/sec 1.01 6.5±0.02ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.2±0.09ms 1220.7 MB/sec 1.01 13.3±0.09ms 1214.5 MB/sec struct_sparse_99pct_null/default 1.00 5.9±0.01ms 2.7 GB/sec 1.01 5.9±0.01ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.00 5.9±0.02ms 2.7 GB/sec 1.00 5.9±0.01ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.00 7.2±0.02ms 2.2 GB/sec 1.00 7.3±0.01ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.4 GB/sec 1.00 6.7±0.01ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 2090.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2008.3s | | CPU sys | 77.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2045.4s | | Peak memory | 6.8 GiB | | Avg memory | 6.7 GiB | | CPU user | 1997.3s | | CPU sys | 45.7s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
