adriangbot commented on PR #9830: URL: https://github.com/apache/arrow-rs/pull/9830#issuecomment-4330795173
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9830#issuecomment-4330457485) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group batch_rle_run main ----- ------------- ---- bool/bloom_filter 1.04 13.0±0.09ms 19.2 MB/sec 1.00 12.6±0.04ms 19.9 MB/sec bool/cdc 1.03 15.6±0.10ms 16.0 MB/sec 1.00 15.2±0.05ms 16.5 MB/sec bool/default 1.05 11.0±0.08ms 22.7 MB/sec 1.00 10.5±0.05ms 23.8 MB/sec bool/parquet_2 1.03 14.7±0.10ms 17.0 MB/sec 1.00 14.2±0.05ms 17.6 MB/sec bool/zstd 1.04 11.5±0.08ms 21.8 MB/sec 1.00 11.0±0.05ms 22.7 MB/sec bool/zstd_parquet_2 1.03 15.0±0.09ms 16.7 MB/sec 1.00 14.6±0.05ms 17.1 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.8 MB/sec 1.00 7.0±0.03ms 17.9 MB/sec bool_non_null/cdc 1.02 6.8±0.03ms 18.3 MB/sec 1.00 6.7±0.02ms 18.6 MB/sec bool_non_null/default 1.01 4.2±0.02ms 29.4 MB/sec 1.00 4.2±0.02ms 29.7 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.00 9.0±0.03ms 13.9 MB/sec bool_non_null/zstd 1.01 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.4 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.3 MB/sec 1.00 9.4±0.03ms 13.3 MB/sec float_with_nans/bloom_filter 1.02 94.0±0.44ms 149.0 MB/sec 1.00 92.4±0.36ms 151.5 MB/sec float_with_nans/cdc 1.00 81.5±0.17ms 171.8 MB/sec 1.00 81.5±0.22ms 171.7 MB/sec float_with_nans/default 1.01 75.1±0.86ms 186.4 MB/sec 1.00 74.0±0.24ms 189.1 MB/sec float_with_nans/parquet_2 1.01 95.3±0.27ms 146.9 MB/sec 1.00 94.4±0.22ms 148.3 MB/sec float_with_nans/zstd 1.00 112.5±0.36ms 124.4 MB/sec 1.00 112.0±0.26ms 125.0 MB/sec float_with_nans/zstd_parquet_2 1.01 133.1±0.45ms 105.2 MB/sec 1.00 131.6±0.22ms 106.4 MB/sec list_primitive/bloom_filter 1.01 319.6±2.68ms 1706.6 MB/sec 1.00 317.7±1.36ms 1716.9 MB/sec list_primitive/cdc 1.00 343.8±2.83ms 1586.3 MB/sec 1.01 346.2±2.94ms 1575.2 MB/sec list_primitive/default 1.00 238.2±2.58ms 2.2 GB/sec 1.01 239.5±1.65ms 2.2 GB/sec list_primitive/parquet_2 1.00 256.8±0.48ms 2.1 GB/sec 1.02 262.0±1.00ms 2.0 GB/sec list_primitive/zstd 1.02 488.3±2.17ms 1116.8 MB/sec 1.00 479.0±2.20ms 1138.6 MB/sec list_primitive/zstd_parquet_2 1.01 479.5±0.77ms 1137.3 MB/sec 1.00 476.8±0.42ms 1143.9 MB/sec list_primitive_non_null/bloom_filter 1.00 409.6±5.41ms 1328.6 MB/sec 1.07 436.6±19.21ms 1246.6 MB/sec list_primitive_non_null/cdc 1.00 425.1±9.00ms 1280.2 MB/sec 1.00 426.5±7.34ms 1276.1 MB/sec list_primitive_non_null/default 1.00 279.6±4.59ms 1946.2 MB/sec 1.10 307.5±13.54ms 1770.1 MB/sec list_primitive_non_null/parquet_2 1.00 293.8±11.66ms 1852.2 MB/sec 1.00 293.6±7.99ms 1853.9 MB/sec list_primitive_non_null/zstd 1.00 697.0±9.93ms 780.9 MB/sec 1.01 706.5±14.66ms 770.3 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 677.5±0.49ms 803.3 MB/sec 1.02 689.1±1.40ms 789.8 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.7±0.22ms 3.1 GB/sec 1.69 19.7±0.08ms 1892.9 MB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.4±0.12ms 1664.8 MB/sec 1.35 30.3±0.12ms 1231.3 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.2±0.10ms 3.3 GB/sec 1.75 19.5±0.11ms 1915.4 MB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.6±0.10ms 3.2 GB/sec 1.68 19.4±0.06ms 1926.2 MB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.6±0.09ms 2.7 GB/sec 1.57 21.3±0.07ms 1751.1 MB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.7±0.06ms 3.1 GB/sec 1.67 19.6±0.11ms 1906.7 MB/sec primitive/bloom_filter 1.04 150.5±0.66ms 298.2 MB/sec 1.00 145.3±0.52ms 308.8 MB/sec primitive/cdc 1.03 157.0±0.69ms 285.8 MB/sec 1.00 152.6±0.47ms 294.0 MB/sec primitive/default 1.03 118.1±0.53ms 380.0 MB/sec 1.00 114.3±0.30ms 392.5 MB/sec primitive/parquet_2 1.04 134.6±1.66ms 333.3 MB/sec 1.00 129.7±0.65ms 345.9 MB/sec primitive/zstd 1.03 148.5±0.78ms 302.2 MB/sec 1.00 143.9±0.45ms 311.8 MB/sec primitive/zstd_parquet_2 1.03 167.6±1.68ms 267.7 MB/sec 1.00 162.7±0.40ms 275.9 MB/sec primitive_all_null/bloom_filter 1.00 11.7±0.23ms 3.7 GB/sec 1.95 22.8±0.05ms 1968.2 MB/sec primitive_all_null/cdc 1.00 28.2±0.35ms 1593.8 MB/sec 1.40 39.3±0.18ms 1141.1 MB/sec primitive_all_null/default 1.00 11.1±0.28ms 4.0 GB/sec 2.00 22.1±0.02ms 2026.6 MB/sec primitive_all_null/parquet_2 1.00 11.0±0.23ms 4.0 GB/sec 2.01 22.2±0.06ms 2025.3 MB/sec primitive_all_null/zstd 1.00 11.2±0.27ms 3.9 GB/sec 1.99 22.3±0.09ms 2008.2 MB/sec primitive_all_null/zstd_parquet_2 1.00 11.2±0.26ms 3.9 GB/sec 1.99 22.3±0.03ms 2016.3 MB/sec primitive_non_null/bloom_filter 1.01 113.6±2.15ms 387.3 MB/sec 1.00 112.0±1.19ms 392.8 MB/sec primitive_non_null/cdc 1.01 91.3±0.54ms 482.1 MB/sec 1.00 89.9±0.21ms 489.3 MB/sec primitive_non_null/default 1.00 68.1±0.22ms 646.1 MB/sec 1.00 68.1±0.17ms 645.9 MB/sec primitive_non_null/parquet_2 1.02 91.0±6.39ms 483.8 MB/sec 1.00 89.3±0.20ms 492.8 MB/sec primitive_non_null/zstd 1.00 105.5±1.85ms 417.2 MB/sec 1.00 105.1±0.23ms 418.6 MB/sec primitive_non_null/zstd_parquet_2 1.00 130.0±2.78ms 338.4 MB/sec 1.00 129.9±1.80ms 338.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.1±0.08ms 2.4 GB/sec 1.55 28.1±0.21ms 1594.2 MB/sec primitive_sparse_99pct_null/cdc 1.00 34.5±0.23ms 1300.3 MB/sec 1.29 44.4±0.11ms 1011.5 MB/sec primitive_sparse_99pct_null/default 1.00 16.7±0.04ms 2.6 GB/sec 1.59 26.4±0.17ms 1697.5 MB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.7±0.05ms 2.6 GB/sec 1.59 26.6±0.08ms 1686.1 MB/sec primitive_sparse_99pct_null/zstd 1.00 20.2±0.87ms 2.2 GB/sec 1.48 29.9±0.07ms 1502.7 MB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.9±0.87ms 2.3 GB/sec 1.51 28.5±0.08ms 1572.5 MB/sec string/bloom_filter 1.00 215.2±14.69ms 2.4 GB/sec 1.00 214.2±16.44ms 2.4 GB/sec string/cdc 1.00 222.1±6.62ms 2.3 GB/sec 1.00 221.4±6.47ms 2.3 GB/sec string/default 1.07 133.1±17.77ms 3.8 GB/sec 1.00 124.6±17.04ms 4.1 GB/sec string/parquet_2 1.53 170.9±0.87ms 3.0 GB/sec 1.00 111.5±10.64ms 4.6 GB/sec string/zstd 1.07 447.5±17.23ms 1171.5 MB/sec 1.00 417.7±2.47ms 1255.2 MB/sec string/zstd_parquet_2 1.01 401.8±4.21ms 1304.8 MB/sec 1.00 396.8±1.75ms 1321.3 MB/sec string_and_binary_view/bloom_filter 1.04 66.0±0.34ms 488.4 MB/sec 1.00 63.3±0.31ms 509.4 MB/sec string_and_binary_view/cdc 1.03 58.5±0.25ms 550.9 MB/sec 1.00 57.0±0.32ms 565.9 MB/sec string_and_binary_view/default 1.02 48.7±0.21ms 662.5 MB/sec 1.00 47.5±3.57ms 678.9 MB/sec string_and_binary_view/parquet_2 1.03 59.6±0.28ms 541.3 MB/sec 1.00 58.1±0.23ms 555.3 MB/sec string_and_binary_view/zstd 1.02 85.1±0.29ms 379.1 MB/sec 1.00 83.6±0.20ms 385.7 MB/sec string_and_binary_view/zstd_parquet_2 1.03 73.5±0.27ms 439.1 MB/sec 1.00 71.7±0.19ms 450.1 MB/sec string_dictionary/bloom_filter 1.15 102.1±0.35ms 2.5 GB/sec 1.00 88.6±0.71ms 2.9 GB/sec string_dictionary/cdc 1.38 72.2±1.72ms 3.6 GB/sec 1.00 52.5±0.48ms 4.9 GB/sec string_dictionary/default 1.20 58.0±0.55ms 4.4 GB/sec 1.00 48.4±0.36ms 5.3 GB/sec string_dictionary/parquet_2 1.00 53.5±0.26ms 4.8 GB/sec 1.01 53.9±0.23ms 4.8 GB/sec string_dictionary/zstd 1.08 225.1±0.68ms 1173.4 MB/sec 1.00 208.6±0.41ms 1266.5 MB/sec string_dictionary/zstd_parquet_2 1.01 198.9±0.26ms 1328.3 MB/sec 1.00 197.4±0.27ms 1338.2 MB/sec string_non_null/bloom_filter 1.11 268.6±14.61ms 1950.9 MB/sec 1.00 241.0±10.73ms 2.1 GB/sec string_non_null/cdc 1.03 277.5±9.80ms 1888.4 MB/sec 1.00 270.2±7.42ms 1939.5 MB/sec string_non_null/default 1.23 151.4±16.42ms 3.4 GB/sec 1.00 122.8±7.12ms 4.2 GB/sec string_non_null/parquet_2 1.08 143.2±7.81ms 3.6 GB/sec 1.00 132.2±6.03ms 3.9 GB/sec string_non_null/zstd 1.07 568.0±6.69ms 922.5 MB/sec 1.00 531.2±2.29ms 986.4 MB/sec string_non_null/zstd_parquet_2 1.03 519.0±11.28ms 1009.6 MB/sec 1.00 502.2±0.67ms 1043.5 MB/sec struct_all_null/bloom_filter 1.00 4.2±0.07ms 3.7 GB/sec 2.14 9.0±0.01ms 1793.5 MB/sec struct_all_null/cdc 1.00 10.7±0.12ms 1505.0 MB/sec 1.45 15.5±0.11ms 1040.2 MB/sec struct_all_null/default 1.00 3.9±0.05ms 4.0 GB/sec 2.23 8.7±0.01ms 1853.0 MB/sec struct_all_null/parquet_2 1.00 3.9±0.08ms 4.0 GB/sec 2.22 8.7±0.01ms 1853.5 MB/sec struct_all_null/zstd 1.00 4.0±0.06ms 4.0 GB/sec 2.21 8.8±0.01ms 1842.0 MB/sec struct_all_null/zstd_parquet_2 1.00 4.0±0.06ms 4.0 GB/sec 2.21 8.7±0.01ms 1846.6 MB/sec struct_non_null/bloom_filter 1.00 50.4±0.17ms 317.7 MB/sec 1.13 57.0±0.20ms 280.8 MB/sec struct_non_null/cdc 1.00 46.6±0.11ms 343.1 MB/sec 1.12 52.1±0.24ms 306.8 MB/sec struct_non_null/default 1.00 34.4±0.09ms 465.7 MB/sec 1.16 39.8±0.18ms 402.3 MB/sec struct_non_null/parquet_2 1.00 42.8±0.08ms 374.0 MB/sec 1.13 48.3±0.12ms 331.0 MB/sec struct_non_null/zstd 1.00 42.8±0.09ms 373.7 MB/sec 1.13 48.2±0.14ms 331.7 MB/sec struct_non_null/zstd_parquet_2 1.00 56.4±0.13ms 283.7 MB/sec 1.10 62.1±0.18ms 257.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.6±0.12ms 2.1 GB/sec 1.54 11.6±0.10ms 1386.1 MB/sec struct_sparse_99pct_null/cdc 1.00 13.8±0.09ms 1169.9 MB/sec 1.32 18.3±0.13ms 883.2 MB/sec struct_sparse_99pct_null/default 1.00 6.9±0.04ms 2.3 GB/sec 1.63 11.2±0.07ms 1441.2 MB/sec struct_sparse_99pct_null/parquet_2 1.00 6.9±0.05ms 2.3 GB/sec 1.60 11.0±0.03ms 1466.4 MB/sec struct_sparse_99pct_null/zstd 1.00 8.3±0.07ms 1944.3 MB/sec 1.49 12.4±0.05ms 1301.2 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.6±0.05ms 2.1 GB/sec 1.56 11.9±0.10ms 1357.8 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1915.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1861.0s | | CPU sys | 52.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1925.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1853.7s | | CPU sys | 70.0s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
