adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4617599996
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4617225690) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.01 13.1±0.03ms 19.1 MB/sec 1.00 13.0±0.04ms 19.3 MB/sec bool/cdc 1.02 16.0±0.06ms 15.6 MB/sec 1.00 15.7±0.03ms 15.9 MB/sec bool/default 1.01 11.0±0.03ms 22.8 MB/sec 1.00 10.8±0.04ms 23.1 MB/sec bool/parquet_2 1.01 14.7±0.03ms 17.0 MB/sec 1.00 14.6±0.05ms 17.1 MB/sec bool/zstd 1.02 11.5±0.02ms 21.7 MB/sec 1.00 11.3±0.04ms 22.1 MB/sec bool/zstd_parquet_2 1.01 15.1±0.02ms 16.5 MB/sec 1.00 15.0±0.04ms 16.7 MB/sec bool_non_null/bloom_filter 1.01 7.0±0.02ms 17.8 MB/sec 1.00 7.0±0.03ms 18.0 MB/sec bool_non_null/cdc 1.02 6.8±0.03ms 18.4 MB/sec 1.00 6.7±0.05ms 18.7 MB/sec bool_non_null/default 1.03 4.3±0.02ms 29.0 MB/sec 1.00 4.2±0.03ms 29.9 MB/sec bool_non_null/parquet_2 1.01 9.0±0.03ms 13.8 MB/sec 1.00 8.9±0.04ms 14.0 MB/sec bool_non_null/zstd 1.04 4.7±0.03ms 26.7 MB/sec 1.00 4.5±0.02ms 27.7 MB/sec bool_non_null/zstd_parquet_2 1.01 9.5±0.04ms 13.2 MB/sec 1.00 9.4±0.04ms 13.4 MB/sec float_with_nans/bloom_filter 1.00 92.0±0.20ms 152.1 MB/sec 1.00 91.7±0.28ms 152.7 MB/sec float_with_nans/cdc 1.01 81.1±0.16ms 172.6 MB/sec 1.00 80.6±0.19ms 173.7 MB/sec float_with_nans/default 1.00 73.8±0.14ms 189.7 MB/sec 1.00 73.5±0.17ms 190.4 MB/sec float_with_nans/parquet_2 1.00 93.8±0.19ms 149.2 MB/sec 1.00 93.5±0.31ms 149.7 MB/sec float_with_nans/zstd 1.00 111.4±0.13ms 125.7 MB/sec 1.00 111.5±0.37ms 125.6 MB/sec float_with_nans/zstd_parquet_2 1.00 130.6±0.20ms 107.2 MB/sec 1.00 130.5±0.20ms 107.3 MB/sec large_string_non_null/bloom_filter 1.00 72.2±0.16ms 3.5 GB/sec 1.02 73.4±0.29ms 3.4 GB/sec large_string_non_null/cdc 1.00 238.9±0.86ms 1071.6 MB/sec 1.03 245.2±0.90ms 1044.1 MB/sec large_string_non_null/default 1.00 52.4±0.13ms 4.8 GB/sec 1.06 55.4±0.08ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 52.6±0.12ms 4.8 GB/sec 1.06 55.6±0.07ms 4.5 GB/sec large_string_non_null/zstd 1.00 52.6±0.13ms 4.8 GB/sec 1.06 55.7±0.07ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 53.1±0.11ms 4.7 GB/sec 1.05 55.7±0.08ms 4.5 GB/sec list_primitive/bloom_filter 1.09 311.6±3.15ms 1750.4 MB/sec 1.00 286.2±1.00ms 1905.6 MB/sec list_primitive/cdc 1.03 330.8±9.41ms 1648.8 MB/sec 1.00 322.6±1.10ms 1690.7 MB/sec list_primitive/default 1.07 227.8±5.82ms 2.3 GB/sec 1.00 212.4±0.51ms 2.5 GB/sec list_primitive/parquet_2 1.08 252.2±0.47ms 2.1 GB/sec 1.00 234.1±0.25ms 2.3 GB/sec list_primitive/zstd 1.02 469.6±5.43ms 1161.4 MB/sec 1.00 461.9±0.77ms 1180.7 MB/sec list_primitive/zstd_parquet_2 1.00 455.7±0.21ms 1196.7 MB/sec 1.00 457.0±0.46ms 1193.3 MB/sec list_primitive_non_null/bloom_filter 1.14 421.9±12.09ms 1290.0 MB/sec 1.00 369.3±3.90ms 1473.7 MB/sec list_primitive_non_null/cdc 1.01 413.5±9.70ms 1316.1 MB/sec 1.00 411.0±8.53ms 1324.3 MB/sec list_primitive_non_null/default 1.22 289.9±12.53ms 1877.0 MB/sec 1.00 238.6±3.98ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.07 290.4±0.67ms 1874.0 MB/sec 1.00 271.2±0.29ms 2007.2 MB/sec list_primitive_non_null/zstd 1.04 683.4±29.71ms 796.3 MB/sec 1.00 655.3±4.12ms 830.6 MB/sec list_primitive_non_null/zstd_parquet_2 1.09 702.4±2.38ms 774.8 MB/sec 1.00 642.8±0.58ms 846.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.1±0.11ms 3.0 GB/sec 1.02 12.3±0.02ms 3.0 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.7±0.04ms 1579.1 MB/sec 1.00 23.7±0.03ms 1575.2 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.8±0.19ms 3.1 GB/sec 1.02 12.0±0.02ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.8±0.02ms 3.1 GB/sec 1.02 12.0±0.01ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.6±0.02ms 2.7 GB/sec 1.01 13.8±0.02ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.9±0.02ms 3.1 GB/sec 1.02 12.1±0.02ms 3.0 GB/sec primitive/bloom_filter 1.02 151.2±0.58ms 296.7 MB/sec 1.00 147.8±0.36ms 303.6 MB/sec primitive/cdc 1.00 158.5±0.59ms 283.1 MB/sec 1.00 158.3±0.43ms 283.4 MB/sec primitive/default 1.01 117.8±0.30ms 380.9 MB/sec 1.00 116.8±0.16ms 384.0 MB/sec primitive/parquet_2 1.01 133.4±0.31ms 336.3 MB/sec 1.00 131.6±0.15ms 340.9 MB/sec primitive/zstd 1.01 147.5±0.29ms 304.3 MB/sec 1.00 146.3±0.16ms 306.6 MB/sec primitive/zstd_parquet_2 1.01 166.3±0.26ms 269.9 MB/sec 1.00 165.1±0.19ms 271.9 MB/sec primitive_all_null/bloom_filter 1.00 892.2±1.18µs 49.1 GB/sec 1.00 888.3±1.63µs 49.3 GB/sec primitive_all_null/cdc 1.02 19.4±0.39ms 2.3 GB/sec 1.00 18.9±0.36ms 2.3 GB/sec primitive_all_null/default 1.00 272.5±0.71µs 160.8 GB/sec 1.02 277.8±1.42µs 157.8 GB/sec primitive_all_null/parquet_2 1.00 276.8±1.09µs 158.3 GB/sec 1.01 278.7±1.77µs 157.3 GB/sec primitive_all_null/zstd 1.00 385.2±0.94µs 113.8 GB/sec 1.01 390.9±1.46µs 112.1 GB/sec primitive_all_null/zstd_parquet_2 1.00 356.2±0.97µs 123.0 GB/sec 1.00 357.1±1.72µs 122.7 GB/sec primitive_non_null/bloom_filter 1.02 108.6±0.35ms 405.0 MB/sec 1.00 106.2±0.46ms 414.3 MB/sec primitive_non_null/cdc 1.01 90.2±0.40ms 487.8 MB/sec 1.00 89.1±0.52ms 493.7 MB/sec primitive_non_null/default 1.01 67.2±0.20ms 654.4 MB/sec 1.00 66.9±0.25ms 657.8 MB/sec primitive_non_null/parquet_2 1.01 88.8±0.26ms 495.4 MB/sec 1.00 88.3±0.15ms 498.1 MB/sec primitive_non_null/zstd 1.02 98.9±1.75ms 444.7 MB/sec 1.00 97.3±0.13ms 452.3 MB/sec primitive_non_null/zstd_parquet_2 1.01 122.8±0.20ms 358.4 MB/sec 1.00 121.8±0.12ms 361.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 11.8±0.04ms 3.7 GB/sec 1.00 11.7±0.04ms 3.7 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.3±0.24ms 1531.1 MB/sec 1.06 31.1±0.26ms 1442.2 MB/sec primitive_sparse_99pct_null/default 1.00 10.5±0.02ms 4.2 GB/sec 1.00 10.5±0.02ms 4.2 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.5±0.02ms 4.2 GB/sec 1.00 10.5±0.02ms 4.2 GB/sec primitive_sparse_99pct_null/zstd 1.00 13.8±0.03ms 3.2 GB/sec 1.00 13.8±0.03ms 3.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.4±0.03ms 3.5 GB/sec 1.00 12.4±0.02ms 3.5 GB/sec short_string_non_null/bloom_filter 1.04 27.9±0.06ms 429.9 MB/sec 1.00 27.0±0.08ms 445.0 MB/sec short_string_non_null/cdc 1.00 19.7±0.05ms 609.0 MB/sec 1.00 19.8±0.05ms 607.2 MB/sec short_string_non_null/default 1.00 15.6±0.04ms 769.8 MB/sec 1.00 15.7±0.05ms 766.0 MB/sec short_string_non_null/parquet_2 1.00 25.2±0.05ms 476.0 MB/sec 1.01 25.4±0.04ms 471.6 MB/sec short_string_non_null/zstd 1.00 35.2±0.10ms 340.9 MB/sec 1.01 35.4±0.09ms 339.2 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.1±0.06ms 427.6 MB/sec 1.01 28.3±0.04ms 424.7 MB/sec string/bloom_filter 1.09 226.4±25.77ms 2.3 GB/sec 1.00 208.0±13.89ms 2.5 GB/sec string/cdc 1.00 214.1±7.36ms 2.4 GB/sec 1.03 220.1±9.71ms 2.3 GB/sec string/default 1.02 128.5±22.87ms 4.0 GB/sec 1.00 125.4±15.92ms 4.1 GB/sec string/parquet_2 1.00 107.7±5.59ms 4.8 GB/sec 1.66 178.9±1.20ms 2.9 GB/sec string/zstd 1.00 415.8±1.42ms 1260.8 MB/sec 1.07 443.5±19.84ms 1182.0 MB/sec string/zstd_parquet_2 1.01 408.7±11.83ms 1282.7 MB/sec 1.00 405.4±15.70ms 1293.2 MB/sec string_and_binary_view/bloom_filter 1.00 64.1±0.24ms 503.2 MB/sec 1.00 63.9±0.16ms 504.4 MB/sec string_and_binary_view/cdc 1.00 58.9±0.14ms 547.2 MB/sec 1.00 59.2±0.13ms 544.7 MB/sec string_and_binary_view/default 1.00 48.1±0.08ms 670.8 MB/sec 1.01 48.5±0.09ms 664.7 MB/sec string_and_binary_view/parquet_2 1.00 59.3±0.11ms 543.5 MB/sec 1.01 59.7±0.12ms 540.6 MB/sec string_and_binary_view/zstd 1.00 84.6±0.17ms 381.2 MB/sec 1.01 85.2±0.11ms 378.6 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.9±0.09ms 442.5 MB/sec 1.01 73.6±0.11ms 438.0 MB/sec string_dictionary/bloom_filter 1.00 92.4±0.66ms 2.8 GB/sec 1.01 93.0±0.12ms 2.8 GB/sec string_dictionary/cdc 1.00 52.9±0.49ms 4.9 GB/sec 1.03 54.7±0.57ms 4.7 GB/sec string_dictionary/default 1.00 49.7±0.42ms 5.2 GB/sec 1.00 49.8±0.07ms 5.2 GB/sec string_dictionary/parquet_2 1.01 54.5±0.17ms 4.7 GB/sec 1.00 54.0±0.22ms 4.8 GB/sec string_dictionary/zstd 1.00 207.9±0.51ms 1270.3 MB/sec 1.01 209.8±0.59ms 1259.2 MB/sec string_dictionary/zstd_parquet_2 1.00 198.1±0.19ms 1333.3 MB/sec 1.00 198.6±0.28ms 1330.1 MB/sec string_non_null/bloom_filter 1.00 250.1±16.34ms 2.0 GB/sec 1.03 258.8±16.89ms 2024.8 MB/sec string_non_null/cdc 1.04 274.6±14.48ms 1908.4 MB/sec 1.00 264.5±2.70ms 1980.9 MB/sec string_non_null/default 1.00 137.0±15.40ms 3.7 GB/sec 1.02 140.1±15.80ms 3.7 GB/sec string_non_null/parquet_2 1.12 138.8±6.16ms 3.7 GB/sec 1.00 123.7±0.76ms 4.1 GB/sec string_non_null/zstd 1.06 566.7±14.75ms 924.7 MB/sec 1.00 533.1±1.63ms 982.9 MB/sec string_non_null/zstd_parquet_2 1.00 503.2±4.89ms 1041.2 MB/sec 1.00 505.4±0.60ms 1036.7 MB/sec struct_all_null/bloom_filter 1.00 372.0±1.26µs 42.3 GB/sec 1.02 379.0±1.02µs 41.5 GB/sec struct_all_null/cdc 1.03 8.0±0.16ms 2026.7 MB/sec 1.00 7.7±0.14ms 2.0 GB/sec struct_all_null/default 1.00 118.7±0.30µs 132.7 GB/sec 1.02 120.8±0.69µs 130.3 GB/sec struct_all_null/parquet_2 1.00 120.3±0.36µs 130.9 GB/sec 1.00 120.5±1.09µs 130.7 GB/sec struct_all_null/zstd 1.00 165.3±0.71µs 95.2 GB/sec 1.02 168.7±0.69µs 93.3 GB/sec struct_all_null/zstd_parquet_2 1.00 153.1±0.66µs 102.9 GB/sec 1.00 153.5±1.00µs 102.6 GB/sec struct_non_null/bloom_filter 1.00 46.0±0.21ms 347.6 MB/sec 1.02 47.0±0.12ms 340.5 MB/sec struct_non_null/cdc 1.00 45.0±0.17ms 355.6 MB/sec 1.01 45.3±0.17ms 353.2 MB/sec struct_non_null/default 1.00 31.5±0.14ms 507.6 MB/sec 1.01 31.7±0.10ms 504.2 MB/sec struct_non_null/parquet_2 1.00 40.3±0.15ms 396.7 MB/sec 1.00 40.3±0.08ms 397.2 MB/sec struct_non_null/zstd 1.00 40.3±0.15ms 396.9 MB/sec 1.00 40.4±0.11ms 395.6 MB/sec struct_non_null/zstd_parquet_2 1.00 54.4±0.18ms 294.1 MB/sec 1.00 54.4±0.12ms 294.1 MB/sec struct_sparse_99pct_null/bloom_filter 1.07 6.7±0.01ms 2.3 GB/sec 1.00 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.08ms 1173.6 MB/sec 1.05 14.4±0.07ms 1118.2 MB/sec struct_sparse_99pct_null/default 1.07 6.2±0.01ms 2.5 GB/sec 1.00 5.8±0.01ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.07 6.2±0.01ms 2.5 GB/sec 1.00 5.8±0.02ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.05 7.6±0.01ms 2.1 GB/sec 1.00 7.2±0.03ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.06 7.0±0.01ms 2.2 GB/sec 1.00 6.6±0.02ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 2030.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 1952.9s | | CPU sys | 74.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2010.4s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 1965.1s | | CPU sys | 40.7s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
