adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4536537847
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4536140027) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.00 13.1±0.04ms 19.2 MB/sec 1.00 13.1±0.06ms 19.1 MB/sec bool/cdc 1.01 15.9±0.06ms 15.7 MB/sec 1.00 15.8±0.11ms 15.8 MB/sec bool/default 1.00 10.9±0.03ms 22.8 MB/sec 1.00 11.0±0.06ms 22.8 MB/sec bool/parquet_2 1.00 14.8±0.04ms 16.9 MB/sec 1.00 14.8±0.07ms 16.9 MB/sec bool/zstd 1.00 11.5±0.04ms 21.8 MB/sec 1.00 11.5±0.06ms 21.7 MB/sec bool/zstd_parquet_2 1.00 15.2±0.05ms 16.5 MB/sec 1.00 15.2±0.06ms 16.5 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.9 MB/sec 1.00 7.0±0.02ms 18.0 MB/sec bool_non_null/cdc 1.00 6.8±0.02ms 18.5 MB/sec 1.00 6.8±0.09ms 18.4 MB/sec bool_non_null/default 1.01 4.2±0.02ms 29.6 MB/sec 1.00 4.2±0.03ms 29.8 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.00 9.0±0.05ms 13.9 MB/sec bool_non_null/zstd 1.01 4.6±0.02ms 27.4 MB/sec 1.00 4.5±0.02ms 27.5 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.3 MB/sec 1.00 9.4±0.03ms 13.3 MB/sec float_with_nans/bloom_filter 1.00 92.9±0.23ms 150.6 MB/sec 1.01 93.5±0.46ms 149.8 MB/sec float_with_nans/cdc 1.00 81.7±0.20ms 171.4 MB/sec 1.00 81.9±0.24ms 171.0 MB/sec float_with_nans/default 1.00 74.5±0.14ms 187.9 MB/sec 1.01 75.0±0.36ms 186.8 MB/sec float_with_nans/parquet_2 1.00 94.7±0.22ms 147.9 MB/sec 1.01 95.5±0.28ms 146.6 MB/sec float_with_nans/zstd 1.00 111.9±0.19ms 125.1 MB/sec 1.00 112.5±0.28ms 124.5 MB/sec float_with_nans/zstd_parquet_2 1.00 131.9±0.23ms 106.2 MB/sec 1.01 132.7±0.24ms 105.5 MB/sec large_string_non_null/bloom_filter 1.00 72.9±0.14ms 3.4 GB/sec large_string_non_null/cdc 1.00 242.5±1.13ms 1055.8 MB/sec large_string_non_null/default 1.00 55.3±0.10ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.3±0.10ms 4.5 GB/sec large_string_non_null/zstd 1.00 55.4±0.12ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.4±0.13ms 4.5 GB/sec list_primitive/bloom_filter 1.00 334.0±1.24ms 1632.6 MB/sec 1.07 355.8±2.91ms 1532.9 MB/sec list_primitive/cdc 1.00 367.8±1.39ms 1482.6 MB/sec 1.03 377.7±6.60ms 1444.0 MB/sec list_primitive/default 1.00 256.3±1.58ms 2.1 GB/sec 1.07 274.2±6.32ms 1989.1 MB/sec list_primitive/parquet_2 1.00 277.5±0.59ms 1965.6 MB/sec 1.00 278.8±0.38ms 1956.0 MB/sec list_primitive/zstd 1.00 509.7±3.72ms 1070.0 MB/sec 1.00 511.4±2.46ms 1066.5 MB/sec list_primitive/zstd_parquet_2 1.00 500.7±0.46ms 1089.2 MB/sec 1.00 502.0±0.43ms 1086.4 MB/sec list_primitive_non_null/bloom_filter 1.00 393.9±4.65ms 1381.8 MB/sec 1.15 454.5±10.66ms 1197.5 MB/sec list_primitive_non_null/cdc 1.01 441.7±7.12ms 1232.2 MB/sec 1.00 438.8±7.79ms 1240.2 MB/sec list_primitive_non_null/default 1.00 263.3±3.61ms 2.0 GB/sec 1.19 312.1±12.73ms 1743.8 MB/sec list_primitive_non_null/parquet_2 1.00 293.7±1.12ms 1853.2 MB/sec 1.19 349.2±0.64ms 1558.7 MB/sec list_primitive_non_null/zstd 1.00 686.2±4.92ms 793.1 MB/sec 1.04 714.2±15.84ms 762.0 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 669.8±1.26ms 812.6 MB/sec 1.00 669.5±0.80ms 812.9 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.6±0.05ms 3.1 GB/sec 1.05 12.3±0.06ms 3.0 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.4±0.08ms 1598.7 MB/sec 1.04 24.2±0.09ms 1541.4 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.3±0.04ms 3.2 GB/sec 1.06 12.0±0.07ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.3±0.04ms 3.2 GB/sec 1.06 12.0±0.07ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.1±0.04ms 2.8 GB/sec 1.06 13.9±0.08ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.5±0.07ms 3.2 GB/sec 1.06 12.2±0.07ms 3.0 GB/sec primitive/bloom_filter 1.00 150.6±0.40ms 297.9 MB/sec 1.01 151.6±0.59ms 295.9 MB/sec primitive/cdc 1.00 159.8±0.56ms 280.9 MB/sec 1.01 161.1±0.68ms 278.5 MB/sec primitive/default 1.00 118.7±0.30ms 378.1 MB/sec 1.01 119.8±0.45ms 374.6 MB/sec primitive/parquet_2 1.00 133.6±0.30ms 335.8 MB/sec 1.01 134.6±0.42ms 333.3 MB/sec primitive/zstd 1.00 148.5±0.31ms 302.1 MB/sec 1.01 149.4±0.42ms 300.4 MB/sec primitive/zstd_parquet_2 1.00 167.2±0.27ms 268.4 MB/sec 1.01 168.1±0.71ms 267.0 MB/sec primitive_all_null/bloom_filter 1.00 900.6±3.03µs 48.7 GB/sec 1.00 896.2±2.17µs 48.9 GB/sec primitive_all_null/cdc 1.03 19.2±0.37ms 2.3 GB/sec 1.00 18.7±0.33ms 2.3 GB/sec primitive_all_null/default 1.00 274.0±0.74µs 159.9 GB/sec 1.01 277.2±0.89µs 158.1 GB/sec primitive_all_null/parquet_2 1.01 280.5±1.09µs 156.2 GB/sec 1.00 279.0±0.89µs 157.1 GB/sec primitive_all_null/zstd 1.00 388.0±0.90µs 112.9 GB/sec 1.01 393.2±0.86µs 111.5 GB/sec primitive_all_null/zstd_parquet_2 1.00 356.4±1.22µs 122.9 GB/sec 1.01 360.4±0.92µs 121.6 GB/sec primitive_non_null/bloom_filter 1.00 108.7±0.29ms 404.7 MB/sec 1.00 108.4±0.28ms 406.1 MB/sec primitive_non_null/cdc 1.00 91.0±0.28ms 483.4 MB/sec 1.00 90.7±0.63ms 484.9 MB/sec primitive_non_null/default 1.00 68.1±0.16ms 646.4 MB/sec 1.00 68.3±0.20ms 644.1 MB/sec primitive_non_null/parquet_2 1.01 90.7±0.27ms 485.3 MB/sec 1.00 89.9±0.27ms 489.5 MB/sec primitive_non_null/zstd 1.07 105.6±0.94ms 416.8 MB/sec 1.00 98.9±0.23ms 445.0 MB/sec primitive_non_null/zstd_parquet_2 1.05 129.7±2.61ms 339.2 MB/sec 1.00 123.7±0.16ms 355.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.3±0.09ms 3.6 GB/sec 1.03 12.7±0.16ms 3.4 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.1±0.31ms 1489.3 MB/sec 1.05 31.6±0.24ms 1421.6 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.06ms 4.1 GB/sec 1.00 10.8±0.06ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.07ms 4.1 GB/sec 1.01 10.9±0.06ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.2±0.07ms 3.1 GB/sec 1.01 14.3±0.07ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.06ms 3.4 GB/sec 1.00 12.8±0.09ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.5±0.06ms 436.9 MB/sec short_string_non_null/cdc 1.00 20.1±0.06ms 597.2 MB/sec short_string_non_null/default 1.00 15.9±0.04ms 753.4 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.19ms 466.6 MB/sec short_string_non_null/zstd 1.00 35.5±0.08ms 338.2 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.4±0.06ms 422.1 MB/sec string/bloom_filter 1.00 215.7±19.88ms 2.4 GB/sec 1.00 215.9±14.00ms 2.4 GB/sec string/cdc 1.00 220.3±4.46ms 2.3 GB/sec 1.00 221.2±10.07ms 2.3 GB/sec string/default 1.00 125.3±20.12ms 4.1 GB/sec 1.03 129.1±15.98ms 4.0 GB/sec string/parquet_2 1.00 111.2±6.38ms 4.6 GB/sec 1.67 186.2±0.55ms 2.7 GB/sec string/zstd 1.00 415.9±1.93ms 1260.4 MB/sec 1.08 449.9±21.48ms 1165.2 MB/sec string/zstd_parquet_2 1.00 402.1±6.51ms 1303.9 MB/sec 1.01 405.4±16.19ms 1293.2 MB/sec string_and_binary_view/bloom_filter 1.00 63.7±0.17ms 506.5 MB/sec 1.02 65.0±0.30ms 496.1 MB/sec string_and_binary_view/cdc 1.00 58.7±0.11ms 549.1 MB/sec 1.03 60.3±0.24ms 534.9 MB/sec string_and_binary_view/default 1.00 48.0±0.13ms 672.1 MB/sec 1.02 48.9±0.25ms 659.8 MB/sec string_and_binary_view/parquet_2 1.00 59.0±0.14ms 546.4 MB/sec 1.02 60.1±0.32ms 536.7 MB/sec string_and_binary_view/zstd 1.00 84.5±0.13ms 381.7 MB/sec 1.01 85.6±0.25ms 376.8 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.9±0.12ms 442.7 MB/sec 1.02 73.9±0.31ms 436.1 MB/sec string_dictionary/bloom_filter 1.00 89.8±1.05ms 2.9 GB/sec 1.05 94.3±0.57ms 2.7 GB/sec string_dictionary/cdc 1.00 52.4±0.95ms 4.9 GB/sec 1.04 54.4±1.61ms 4.7 GB/sec string_dictionary/default 1.00 46.6±0.85ms 5.5 GB/sec 1.10 51.0±0.29ms 5.1 GB/sec string_dictionary/parquet_2 1.00 54.1±0.24ms 4.8 GB/sec 1.02 55.1±0.50ms 4.7 GB/sec string_dictionary/zstd 1.00 209.2±1.56ms 1262.7 MB/sec 1.01 212.1±0.80ms 1245.0 MB/sec string_dictionary/zstd_parquet_2 1.00 198.5±0.33ms 1330.6 MB/sec 1.00 199.1±0.42ms 1326.4 MB/sec string_non_null/bloom_filter 1.01 250.8±13.88ms 2.0 GB/sec 1.00 247.6±6.37ms 2.1 GB/sec string_non_null/cdc 1.00 266.8±2.89ms 1963.7 MB/sec 1.02 271.2±11.39ms 1932.2 MB/sec string_non_null/default 1.00 137.2±11.83ms 3.7 GB/sec 1.00 136.7±8.38ms 3.7 GB/sec string_non_null/parquet_2 1.06 131.1±3.11ms 3.9 GB/sec 1.00 123.3±0.71ms 4.2 GB/sec string_non_null/zstd 1.00 537.0±3.08ms 975.7 MB/sec 1.04 558.4±5.22ms 938.5 MB/sec string_non_null/zstd_parquet_2 1.00 503.2±0.58ms 1041.3 MB/sec 1.00 504.0±0.48ms 1039.7 MB/sec struct_all_null/bloom_filter 1.02 377.9±1.34µs 41.7 GB/sec 1.00 370.1±0.96µs 42.5 GB/sec struct_all_null/cdc 1.04 7.9±0.18ms 2047.5 MB/sec 1.00 7.6±0.07ms 2.1 GB/sec struct_all_null/default 1.00 119.0±0.37µs 132.4 GB/sec 1.01 120.5±0.43µs 130.7 GB/sec struct_all_null/parquet_2 1.00 120.6±0.36µs 130.6 GB/sec 1.00 121.0±0.35µs 130.2 GB/sec struct_all_null/zstd 1.00 166.6±0.44µs 94.5 GB/sec 1.01 168.1±0.27µs 93.7 GB/sec struct_all_null/zstd_parquet_2 1.00 153.0±0.54µs 102.9 GB/sec 1.01 154.5±0.51µs 101.9 GB/sec struct_non_null/bloom_filter 1.01 46.8±0.14ms 341.7 MB/sec 1.00 46.4±0.16ms 344.9 MB/sec struct_non_null/cdc 1.00 45.9±0.12ms 348.2 MB/sec 1.00 45.7±0.15ms 349.8 MB/sec struct_non_null/default 1.00 32.3±0.10ms 495.1 MB/sec 1.00 32.2±0.17ms 496.6 MB/sec struct_non_null/parquet_2 1.01 41.1±0.12ms 389.6 MB/sec 1.00 40.9±0.11ms 391.6 MB/sec struct_non_null/zstd 1.00 41.0±0.11ms 390.0 MB/sec 1.00 41.0±0.10ms 390.5 MB/sec struct_non_null/zstd_parquet_2 1.00 55.1±0.12ms 290.6 MB/sec 1.00 54.8±0.09ms 292.0 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 6.6±0.07ms 2.4 GB/sec 1.00 6.5±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.09ms 1179.1 MB/sec 1.07 14.6±0.10ms 1105.2 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.04ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.04ms 2.6 GB/sec 1.00 5.9±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.04ms 2.1 GB/sec 1.00 7.4±0.04ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.05ms 2.3 GB/sec 1.01 6.8±0.04ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1920.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1883.3s | | CPU sys | 33.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2080.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2011.8s | | CPU sys | 64.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
