adriangbot commented on PR #10020: URL: https://github.com/apache/arrow-rs/pull/10020#issuecomment-4547387529
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10020#issuecomment-4546798203) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-spill ----- ---- ------------------ bool/bloom_filter 1.00 13.1±0.08ms 19.0 MB/sec 1.01 13.2±0.07ms 18.9 MB/sec bool/cdc 1.00 15.8±0.09ms 15.8 MB/sec 1.00 15.8±0.07ms 15.8 MB/sec bool/default 1.00 11.0±0.06ms 22.7 MB/sec 1.00 11.0±0.08ms 22.7 MB/sec bool/parquet_2 1.00 14.8±0.07ms 16.9 MB/sec 1.00 14.9±0.07ms 16.8 MB/sec bool/zstd 1.00 11.6±0.07ms 21.6 MB/sec 1.00 11.6±0.07ms 21.6 MB/sec bool/zstd_parquet_2 1.00 15.2±0.08ms 16.4 MB/sec 1.00 15.2±0.07ms 16.4 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.8 MB/sec 1.01 7.1±0.02ms 17.7 MB/sec bool_non_null/cdc 1.00 6.8±0.02ms 18.3 MB/sec 1.01 6.9±0.03ms 18.2 MB/sec bool_non_null/default 1.00 4.3±0.03ms 29.1 MB/sec 1.01 4.3±0.02ms 28.8 MB/sec bool_non_null/parquet_2 1.00 9.1±0.04ms 13.8 MB/sec 1.00 9.1±0.04ms 13.8 MB/sec bool_non_null/zstd 1.00 4.7±0.03ms 26.9 MB/sec 1.01 4.7±0.02ms 26.7 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.00 9.5±0.03ms 13.2 MB/sec float_with_nans/bloom_filter 1.01 93.3±0.33ms 150.0 MB/sec 1.00 92.7±0.25ms 151.1 MB/sec float_with_nans/cdc 1.00 82.0±0.20ms 170.8 MB/sec 1.00 81.8±0.48ms 171.2 MB/sec float_with_nans/default 1.00 74.7±0.20ms 187.5 MB/sec 1.00 74.5±0.16ms 188.0 MB/sec float_with_nans/parquet_2 1.00 95.0±0.38ms 147.3 MB/sec 1.00 94.6±0.32ms 148.1 MB/sec float_with_nans/zstd 1.00 112.3±0.26ms 124.7 MB/sec 1.00 112.1±0.20ms 124.9 MB/sec float_with_nans/zstd_parquet_2 1.00 132.3±0.39ms 105.8 MB/sec 1.00 131.8±0.32ms 106.2 MB/sec list_primitive/bloom_filter 1.00 332.6±1.35ms 1639.8 MB/sec 1.02 338.0±7.18ms 1613.3 MB/sec list_primitive/cdc 1.00 365.4±1.54ms 1492.6 MB/sec 1.00 367.1±2.08ms 1485.4 MB/sec list_primitive/default 1.00 254.7±2.00ms 2.1 GB/sec 1.03 263.2±7.53ms 2.0 GB/sec list_primitive/parquet_2 1.00 275.3±0.62ms 1981.3 MB/sec 1.03 284.7±7.10ms 1915.7 MB/sec list_primitive/zstd 1.00 505.6±2.43ms 1078.7 MB/sec 1.02 514.5±7.38ms 1060.1 MB/sec list_primitive/zstd_parquet_2 1.00 498.2±1.33ms 1094.7 MB/sec 1.02 508.0±7.50ms 1073.6 MB/sec list_primitive_non_null/bloom_filter 1.00 399.2±4.80ms 1363.3 MB/sec 1.08 431.4±5.72ms 1261.5 MB/sec list_primitive_non_null/cdc 1.01 441.7±7.11ms 1232.1 MB/sec 1.00 437.1±9.33ms 1245.0 MB/sec list_primitive_non_null/default 1.00 266.3±3.96ms 2043.9 MB/sec 1.11 296.7±7.64ms 1834.4 MB/sec list_primitive_non_null/parquet_2 1.00 293.2±0.80ms 1856.4 MB/sec 1.12 327.4±0.76ms 1662.6 MB/sec list_primitive_non_null/zstd 1.00 687.6±3.94ms 791.6 MB/sec 1.03 708.3±11.37ms 768.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 669.1±2.04ms 813.4 MB/sec 1.00 669.8±0.88ms 812.5 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.4±0.07ms 3.2 GB/sec 1.03 11.8±0.12ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.0±0.06ms 1626.4 MB/sec 1.01 23.3±0.06ms 1607.1 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.0±0.05ms 3.3 GB/sec 1.03 11.4±0.13ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.1±0.07ms 3.3 GB/sec 1.04 11.5±0.13ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.9±0.07ms 2.8 GB/sec 1.04 13.3±0.11ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.2±0.06ms 3.3 GB/sec 1.04 11.6±0.14ms 3.1 GB/sec primitive/bloom_filter 1.00 151.0±0.48ms 297.2 MB/sec 1.00 151.5±0.47ms 296.2 MB/sec primitive/cdc 1.01 160.8±0.57ms 279.1 MB/sec 1.00 159.8±0.60ms 280.9 MB/sec primitive/default 1.00 119.6±0.42ms 375.2 MB/sec 1.00 119.5±0.40ms 375.4 MB/sec primitive/parquet_2 1.00 134.4±0.48ms 333.8 MB/sec 1.00 134.5±0.47ms 333.7 MB/sec primitive/zstd 1.00 149.1±0.45ms 300.9 MB/sec 1.00 149.3±0.37ms 300.7 MB/sec primitive/zstd_parquet_2 1.00 167.8±0.49ms 267.4 MB/sec 1.00 168.0±0.32ms 267.1 MB/sec primitive_all_null/bloom_filter 1.00 901.0±2.43µs 48.6 GB/sec 1.00 902.0±5.25µs 48.6 GB/sec primitive_all_null/cdc 1.03 19.5±0.22ms 2.2 GB/sec 1.00 18.9±0.37ms 2.3 GB/sec primitive_all_null/default 1.00 276.9±0.79µs 158.2 GB/sec 1.01 280.7±1.35µs 156.1 GB/sec primitive_all_null/parquet_2 1.00 278.7±1.22µs 157.3 GB/sec 1.03 286.9±1.60µs 152.8 GB/sec primitive_all_null/zstd 1.00 389.2±0.87µs 112.6 GB/sec 1.03 399.0±1.06µs 109.8 GB/sec primitive_all_null/zstd_parquet_2 1.00 355.5±1.25µs 123.3 GB/sec 1.03 366.9±1.26µs 119.4 GB/sec primitive_non_null/bloom_filter 1.00 106.7±0.24ms 412.6 MB/sec 1.02 108.9±0.59ms 404.0 MB/sec primitive_non_null/cdc 1.00 90.6±0.49ms 485.9 MB/sec 1.00 90.5±0.41ms 486.4 MB/sec primitive_non_null/default 1.00 67.7±0.19ms 650.0 MB/sec 1.01 68.4±0.35ms 643.4 MB/sec primitive_non_null/parquet_2 1.00 89.1±0.24ms 493.6 MB/sec 1.01 89.9±0.18ms 489.4 MB/sec primitive_non_null/zstd 1.06 104.6±0.93ms 420.6 MB/sec 1.00 98.9±0.22ms 445.1 MB/sec primitive_non_null/zstd_parquet_2 1.04 128.8±2.49ms 341.6 MB/sec 1.00 123.6±0.16ms 356.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.8±0.10ms 2.3 GB/sec 1.01 18.9±0.10ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.02 37.4±0.20ms 1199.7 MB/sec 1.00 36.8±0.29ms 1218.9 MB/sec primitive_sparse_99pct_null/default 1.01 17.1±0.07ms 2.6 GB/sec 1.00 17.0±0.06ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 17.0±0.07ms 2.6 GB/sec 1.00 17.0±0.05ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.4±0.06ms 2.2 GB/sec 1.00 20.4±0.06ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 19.0±0.06ms 2.3 GB/sec 1.00 18.9±0.06ms 2.3 GB/sec string/bloom_filter 1.02 220.1±20.49ms 2.3 GB/sec 1.00 215.0±19.09ms 2.4 GB/sec string/cdc 1.01 222.3±4.82ms 2.3 GB/sec 1.00 220.8±6.13ms 2.3 GB/sec string/default 1.02 128.8±20.89ms 4.0 GB/sec 1.00 126.6±17.61ms 4.0 GB/sec string/parquet_2 1.00 111.8±6.27ms 4.6 GB/sec 1.11 123.9±0.94ms 4.1 GB/sec string/zstd 1.00 417.7±1.87ms 1255.1 MB/sec 1.04 434.3±15.80ms 1207.1 MB/sec string/zstd_parquet_2 1.00 402.1±6.49ms 1303.8 MB/sec 1.00 403.3±3.73ms 1299.9 MB/sec string_and_binary_view/bloom_filter 1.02 64.9±0.26ms 496.9 MB/sec 1.00 63.9±0.28ms 504.5 MB/sec string_and_binary_view/cdc 1.01 58.7±0.20ms 549.6 MB/sec 1.00 58.2±0.18ms 553.9 MB/sec string_and_binary_view/default 1.01 48.5±0.20ms 664.9 MB/sec 1.00 48.2±0.15ms 668.9 MB/sec string_and_binary_view/parquet_2 1.00 59.2±0.20ms 545.1 MB/sec 1.00 59.2±0.20ms 545.0 MB/sec string_and_binary_view/zstd 1.00 85.0±0.20ms 379.4 MB/sec 1.00 84.6±0.21ms 381.2 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.0±0.20ms 441.5 MB/sec 1.00 73.0±0.20ms 441.9 MB/sec string_dictionary/bloom_filter 1.03 91.9±1.14ms 2.8 GB/sec 1.00 89.3±1.00ms 2.9 GB/sec string_dictionary/cdc 1.04 53.4±1.04ms 4.8 GB/sec 1.00 51.3±0.69ms 5.0 GB/sec string_dictionary/default 1.00 47.2±0.88ms 5.5 GB/sec 1.00 47.4±1.01ms 5.4 GB/sec string_dictionary/parquet_2 1.00 54.3±0.29ms 4.8 GB/sec 1.00 54.4±0.41ms 4.7 GB/sec string_dictionary/zstd 1.01 210.4±1.61ms 1255.2 MB/sec 1.00 207.9±1.40ms 1270.2 MB/sec string_dictionary/zstd_parquet_2 1.00 198.9±0.21ms 1327.7 MB/sec 1.00 199.1±0.17ms 1326.9 MB/sec string_non_null/bloom_filter 1.04 252.2±13.88ms 2.0 GB/sec 1.00 243.3±11.42ms 2.1 GB/sec string_non_null/cdc 1.00 267.0±2.82ms 1962.7 MB/sec 1.00 268.2±7.99ms 1953.7 MB/sec string_non_null/default 1.00 139.2±12.40ms 3.7 GB/sec 1.00 139.6±15.40ms 3.7 GB/sec string_non_null/parquet_2 1.00 130.7±2.87ms 3.9 GB/sec 1.00 130.6±1.07ms 3.9 GB/sec string_non_null/zstd 1.00 537.8±2.60ms 974.4 MB/sec 1.01 542.7±4.31ms 965.6 MB/sec string_non_null/zstd_parquet_2 1.00 504.0±1.59ms 1039.6 MB/sec 1.00 504.7±0.67ms 1038.2 MB/sec struct_all_null/bloom_filter 1.00 374.8±1.26µs 42.0 GB/sec 1.00 373.4±1.01µs 42.2 GB/sec struct_all_null/cdc 1.05 8.3±0.07ms 1954.4 MB/sec 1.00 7.9±0.19ms 2.0 GB/sec struct_all_null/default 1.00 119.8±0.24µs 131.4 GB/sec 1.01 120.6±0.64µs 130.6 GB/sec struct_all_null/parquet_2 1.00 120.4±0.48µs 130.8 GB/sec 1.03 124.0±0.67µs 127.0 GB/sec struct_all_null/zstd 1.00 167.3±0.38µs 94.2 GB/sec 1.02 171.3±1.35µs 91.9 GB/sec struct_all_null/zstd_parquet_2 1.00 153.4±0.58µs 102.6 GB/sec 1.03 158.7±0.57µs 99.2 GB/sec struct_non_null/bloom_filter 1.02 47.1±0.28ms 339.7 MB/sec 1.00 46.0±0.09ms 348.0 MB/sec struct_non_null/cdc 1.01 45.8±0.12ms 349.6 MB/sec 1.00 45.3±0.16ms 353.0 MB/sec struct_non_null/default 1.01 32.3±0.10ms 496.1 MB/sec 1.00 31.9±0.10ms 502.0 MB/sec struct_non_null/parquet_2 1.00 41.0±0.15ms 390.6 MB/sec 1.07 43.9±1.44ms 364.8 MB/sec struct_non_null/zstd 1.01 41.1±0.12ms 389.5 MB/sec 1.00 40.7±0.10ms 392.8 MB/sec struct_non_null/zstd_parquet_2 1.00 55.0±0.12ms 290.9 MB/sec 1.00 54.8±0.77ms 291.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.04ms 2.4 GB/sec 1.06 6.9±0.05ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.01 14.5±0.09ms 1111.8 MB/sec 1.00 14.4±0.10ms 1120.2 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.03ms 2.6 GB/sec 1.05 6.3±0.03ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.03ms 2.6 GB/sec 1.06 6.4±0.03ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.03ms 2.1 GB/sec 1.04 7.7±0.03ms 2.0 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.04ms 2.3 GB/sec 1.04 7.1±0.03ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1925.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1890.5s | | CPU sys | 33.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1935.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1885.2s | | CPU sys | 47.6s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
