adriangbot commented on PR #9619: URL: https://github.com/apache/arrow-rs/pull/9619#issuecomment-4559884385
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9619#issuecomment-4559559709) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main total_order_514 ----- ---- --------------- bool/bloom_filter 1.05 13.2±0.14ms 18.9 MB/sec 1.00 12.6±0.03ms 19.8 MB/sec bool/cdc 1.04 16.3±0.10ms 15.4 MB/sec 1.00 15.6±0.06ms 16.0 MB/sec bool/default 1.06 11.1±0.14ms 22.4 MB/sec 1.00 10.5±0.03ms 23.7 MB/sec bool/parquet_2 1.04 14.9±0.14ms 16.8 MB/sec 1.00 14.4±0.04ms 17.4 MB/sec bool/zstd 1.06 11.7±0.13ms 21.4 MB/sec 1.00 11.1±0.03ms 22.6 MB/sec bool/zstd_parquet_2 1.04 15.3±0.17ms 16.3 MB/sec 1.00 14.7±0.04ms 17.0 MB/sec bool_non_null/bloom_filter 1.06 7.0±0.02ms 17.9 MB/sec 1.00 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.06 6.8±0.03ms 18.5 MB/sec 1.00 6.4±0.05ms 19.6 MB/sec bool_non_null/default 1.11 4.2±0.02ms 29.6 MB/sec 1.00 3.8±0.02ms 32.9 MB/sec bool_non_null/parquet_2 1.05 9.0±0.03ms 13.9 MB/sec 1.00 8.6±0.04ms 14.6 MB/sec bool_non_null/zstd 1.10 4.6±0.02ms 27.3 MB/sec 1.00 4.1±0.02ms 30.2 MB/sec bool_non_null/zstd_parquet_2 1.05 9.4±0.03ms 13.3 MB/sec 1.00 9.0±0.02ms 13.9 MB/sec float_with_nans/bloom_filter 1.00 93.6±0.43ms 149.6 MB/sec 1.01 94.2±0.46ms 148.6 MB/sec float_with_nans/cdc 1.00 81.8±0.27ms 171.1 MB/sec 1.00 81.6±0.27ms 171.5 MB/sec float_with_nans/default 1.00 74.7±0.27ms 187.5 MB/sec 1.00 74.7±0.40ms 187.5 MB/sec float_with_nans/parquet_2 1.00 95.2±0.61ms 147.1 MB/sec 1.00 95.4±0.53ms 146.8 MB/sec float_with_nans/zstd 1.00 112.1±0.39ms 124.9 MB/sec 1.00 112.3±0.30ms 124.7 MB/sec float_with_nans/zstd_parquet_2 1.00 132.3±0.47ms 105.8 MB/sec 1.00 132.7±0.53ms 105.5 MB/sec list_primitive/bloom_filter 1.00 338.7±2.75ms 1610.2 MB/sec 1.05 355.5±2.35ms 1534.1 MB/sec list_primitive/cdc 1.00 370.4±1.46ms 1472.5 MB/sec 1.01 375.2±4.97ms 1453.5 MB/sec list_primitive/default 1.00 256.7±1.87ms 2.1 GB/sec 1.06 271.2±1.23ms 2011.0 MB/sec list_primitive/parquet_2 1.00 279.2±0.45ms 1953.0 MB/sec 1.04 290.3±0.97ms 1878.3 MB/sec list_primitive/zstd 1.00 510.5±3.12ms 1068.3 MB/sec 1.01 514.1±1.74ms 1060.9 MB/sec list_primitive/zstd_parquet_2 1.01 502.8±0.40ms 1084.6 MB/sec 1.00 499.3±0.43ms 1092.3 MB/sec list_primitive_non_null/bloom_filter 1.00 400.8±5.24ms 1357.9 MB/sec 1.11 444.6±7.64ms 1224.1 MB/sec list_primitive_non_null/cdc 1.02 443.3±7.05ms 1227.6 MB/sec 1.00 436.2±8.06ms 1247.8 MB/sec list_primitive_non_null/default 1.00 265.4±3.64ms 2.0 GB/sec 1.14 302.2±7.84ms 1800.7 MB/sec list_primitive_non_null/parquet_2 1.03 293.0±0.78ms 1857.4 MB/sec 1.00 283.9±3.70ms 1916.9 MB/sec list_primitive_non_null/zstd 1.00 685.5±3.94ms 793.9 MB/sec 1.05 716.5±16.46ms 759.6 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 668.5±1.22ms 814.1 MB/sec 1.00 666.3±0.75ms 816.9 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.9±0.11ms 3.1 GB/sec 1.01 12.0±0.11ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.4±0.18ms 1594.5 MB/sec 1.01 23.6±0.14ms 1581.3 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.6±0.09ms 3.2 GB/sec 1.00 11.6±0.09ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.6±0.09ms 3.2 GB/sec 1.00 11.6±0.10ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.4±0.12ms 2.7 GB/sec 1.00 13.5±0.10ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.7±0.10ms 3.1 GB/sec 1.01 11.8±0.10ms 3.1 GB/sec primitive/bloom_filter 1.04 153.6±0.75ms 292.2 MB/sec 1.00 147.1±0.63ms 305.1 MB/sec primitive/cdc 1.05 162.8±0.80ms 275.6 MB/sec 1.00 155.4±0.91ms 288.7 MB/sec primitive/default 1.07 121.5±2.03ms 369.2 MB/sec 1.00 113.8±0.44ms 394.3 MB/sec primitive/parquet_2 1.05 135.6±0.70ms 330.9 MB/sec 1.00 128.8±0.40ms 348.5 MB/sec primitive/zstd 1.05 150.6±0.79ms 298.0 MB/sec 1.00 143.5±0.47ms 312.7 MB/sec primitive/zstd_parquet_2 1.04 169.3±0.78ms 265.1 MB/sec 1.00 162.3±0.47ms 276.6 MB/sec primitive_all_null/bloom_filter 1.00 905.2±2.72µs 48.4 GB/sec 1.01 912.4±4.42µs 48.0 GB/sec primitive_all_null/cdc 1.00 18.9±0.35ms 2.3 GB/sec 1.02 19.4±0.29ms 2.3 GB/sec primitive_all_null/default 1.00 274.3±0.83µs 159.8 GB/sec 1.04 284.8±3.30µs 153.9 GB/sec primitive_all_null/parquet_2 1.00 280.3±0.69µs 156.3 GB/sec 1.01 284.1±2.53µs 154.3 GB/sec primitive_all_null/zstd 1.00 386.8±1.00µs 113.3 GB/sec 1.03 398.4±3.81µs 110.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 354.6±0.84µs 123.6 GB/sec 1.02 362.5±2.14µs 120.9 GB/sec primitive_non_null/bloom_filter 1.00 108.4±0.71ms 405.8 MB/sec 1.00 108.5±2.05ms 405.4 MB/sec primitive_non_null/cdc 1.06 90.5±0.40ms 486.4 MB/sec 1.00 85.0±0.44ms 517.6 MB/sec primitive_non_null/default 1.10 67.7±0.33ms 650.1 MB/sec 1.00 61.8±0.35ms 711.9 MB/sec primitive_non_null/parquet_2 1.07 89.6±0.43ms 491.3 MB/sec 1.00 83.8±0.39ms 525.1 MB/sec primitive_non_null/zstd 1.06 105.9±1.00ms 415.6 MB/sec 1.00 99.9±0.55ms 440.6 MB/sec primitive_non_null/zstd_parquet_2 1.04 129.1±2.44ms 340.9 MB/sec 1.00 123.7±2.27ms 355.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.1±0.22ms 3.6 GB/sec 1.01 12.2±0.26ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.07 31.7±0.35ms 1417.3 MB/sec 1.00 29.6±0.38ms 1515.3 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.11ms 4.1 GB/sec 1.00 10.7±0.11ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.6±0.11ms 4.1 GB/sec 1.00 10.6±0.12ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 13.9±0.11ms 3.1 GB/sec 1.00 14.0±0.12ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.8±0.14ms 3.4 GB/sec 1.00 12.6±0.12ms 3.5 GB/sec string/bloom_filter 1.07 224.7±20.59ms 2.3 GB/sec 1.00 210.8±5.30ms 2.4 GB/sec string/cdc 1.00 223.3±5.02ms 2.3 GB/sec 1.02 227.2±8.84ms 2.3 GB/sec string/default 1.10 129.9±21.34ms 3.9 GB/sec 1.00 118.0±6.29ms 4.3 GB/sec string/parquet_2 1.00 112.3±6.41ms 4.6 GB/sec 1.08 121.4±11.88ms 4.2 GB/sec string/zstd 1.00 418.1±1.95ms 1253.9 MB/sec 1.03 430.3±3.48ms 1218.3 MB/sec string/zstd_parquet_2 1.00 403.5±6.48ms 1299.4 MB/sec 1.00 402.3±5.27ms 1303.1 MB/sec string_and_binary_view/bloom_filter 1.00 65.3±0.41ms 494.0 MB/sec 1.01 65.9±0.48ms 489.3 MB/sec string_and_binary_view/cdc 1.00 59.3±0.41ms 544.1 MB/sec 1.00 59.2±0.20ms 545.2 MB/sec string_and_binary_view/default 1.01 48.9±0.24ms 659.9 MB/sec 1.00 48.4±0.14ms 666.1 MB/sec string_and_binary_view/parquet_2 1.01 60.0±0.30ms 537.3 MB/sec 1.00 59.5±0.22ms 542.3 MB/sec string_and_binary_view/zstd 1.01 85.5±0.26ms 377.2 MB/sec 1.00 85.0±0.17ms 379.3 MB/sec string_and_binary_view/zstd_parquet_2 1.01 74.0±0.32ms 436.0 MB/sec 1.00 73.4±0.19ms 439.6 MB/sec string_dictionary/bloom_filter 1.01 92.7±1.08ms 2.8 GB/sec 1.00 92.1±0.85ms 2.8 GB/sec string_dictionary/cdc 1.00 53.8±1.01ms 4.8 GB/sec 1.00 53.8±0.54ms 4.8 GB/sec string_dictionary/default 1.00 47.4±0.87ms 5.4 GB/sec 1.04 49.2±0.30ms 5.2 GB/sec string_dictionary/parquet_2 1.02 54.6±0.29ms 4.7 GB/sec 1.00 53.7±0.28ms 4.8 GB/sec string_dictionary/zstd 1.00 210.1±1.47ms 1257.0 MB/sec 1.00 209.7±0.65ms 1259.3 MB/sec string_dictionary/zstd_parquet_2 1.00 198.9±0.33ms 1328.1 MB/sec 1.00 198.6±0.31ms 1330.1 MB/sec string_non_null/bloom_filter 1.05 255.0±14.12ms 2.0 GB/sec 1.00 242.9±7.35ms 2.1 GB/sec string_non_null/cdc 1.00 267.1±2.89ms 1961.5 MB/sec 1.02 273.6±10.23ms 1915.3 MB/sec string_non_null/default 1.07 138.6±12.16ms 3.7 GB/sec 1.00 129.5±10.09ms 4.0 GB/sec string_non_null/parquet_2 1.00 130.4±2.90ms 3.9 GB/sec 1.08 140.8±4.64ms 3.6 GB/sec string_non_null/zstd 1.00 537.2±2.72ms 975.3 MB/sec 1.04 560.7±7.19ms 934.5 MB/sec string_non_null/zstd_parquet_2 1.00 503.9±0.69ms 1039.8 MB/sec 1.03 520.7±7.47ms 1006.4 MB/sec struct_all_null/bloom_filter 1.00 377.1±1.70µs 41.8 GB/sec 1.01 381.4±1.73µs 41.3 GB/sec struct_all_null/cdc 1.00 7.6±0.10ms 2.1 GB/sec 1.03 7.9±0.08ms 2046.5 MB/sec struct_all_null/default 1.00 119.2±0.31µs 132.1 GB/sec 1.02 121.8±1.36µs 129.3 GB/sec struct_all_null/parquet_2 1.00 120.7±0.35µs 130.5 GB/sec 1.01 122.3±0.92µs 128.8 GB/sec struct_all_null/zstd 1.00 166.4±0.34µs 94.6 GB/sec 1.02 169.9±1.58µs 92.7 GB/sec struct_all_null/zstd_parquet_2 1.00 153.7±0.36µs 102.5 GB/sec 1.01 155.0±0.84µs 101.6 GB/sec struct_non_null/bloom_filter 1.08 47.2±0.26ms 339.0 MB/sec 1.00 43.7±0.26ms 365.8 MB/sec struct_non_null/cdc 1.08 46.0±0.21ms 348.1 MB/sec 1.00 42.4±0.16ms 377.3 MB/sec struct_non_null/default 1.12 32.5±0.19ms 492.5 MB/sec 1.00 29.0±0.16ms 552.2 MB/sec struct_non_null/parquet_2 1.08 41.0±0.16ms 389.9 MB/sec 1.00 37.9±0.16ms 422.6 MB/sec struct_non_null/zstd 1.09 41.1±0.17ms 388.9 MB/sec 1.00 37.8±0.15ms 423.7 MB/sec struct_non_null/zstd_parquet_2 1.06 55.2±0.25ms 289.9 MB/sec 1.00 51.9±0.15ms 308.1 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 6.5±0.07ms 2.4 GB/sec 1.00 6.4±0.08ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.09 14.6±0.17ms 1106.2 MB/sec 1.00 13.4±0.12ms 1200.4 MB/sec struct_sparse_99pct_null/default 1.01 6.0±0.07ms 2.6 GB/sec 1.00 5.9±0.05ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.0±0.06ms 2.6 GB/sec 1.00 5.9±0.04ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.01 7.3±0.05ms 2.2 GB/sec 1.00 7.3±0.05ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.01 6.7±0.05ms 2.3 GB/sec 1.00 6.7±0.04ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1925.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1891.1s | | CPU sys | 33.4s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1915.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.3 GiB | | CPU user | 1856.3s | | CPU sys | 56.1s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
