adriangbot commented on PR #11267: URL: https://github.com/apache/arrow-rs/pull/11267#issuecomment-5904991864
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/11267#issuecomment-5904419577) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing runtime_bench (3e633534d4c7f35339fe1c4206e0c04b1b910c7c) to fa337f8 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fa337f843a8e8e666790b6b5833d69887aa7d2ce..3e633534d4c7f35339fe1c4206e0c04b1b910c7c) **Shard 1/4** · assignment `criterion-shard-v1` <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer shards: 4 ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group base changed ----- ---- ------- bool/default 1.02 9.2±0.08ms 27.2 MB/sec 1.00 9.1±0.07ms 110.3 MElem/sec bool/number_distinct_values 1.01 19.2±0.09ms 13.0 MB/sec 1.00 19.1±0.07ms 52.5 MElem/sec bool/zstd 1.01 9.8±0.09ms 25.6 MB/sec 1.00 9.7±0.07ms 103.2 MElem/sec bool_dictionary/cdc 1.00 12.7±0.15ms 78.8 MElem/sec bool_dictionary/parquet_2 1.00 10.2±0.06ms 98.3 MElem/sec bool_dictionary/zstd 1.00 9.5±0.11ms 105.6 MElem/sec bool_non_null/number_distinct_values 1.01 15.8±0.12ms 7.9 MB/sec 1.00 15.7±0.12ms 63.8 MElem/sec bool_non_null/zstd_parquet_2 1.02 5.2±0.03ms 24.1 MB/sec 1.00 5.1±0.04ms 196.9 MElem/sec bool_ree/default 1.00 25.5±0.11ms 8.3 MB/sec 1.00 25.4±0.11ms 39.4 MElem/sec bool_ree/zstd_parquet_2 1.00 26.6±0.10ms 8.0 MB/sec 1.00 26.5±0.11ms 37.7 MElem/sec byte_array_sparse_99pct_null/number_distinct_values 1.00 12.3±0.26ms 81.3 MElem/sec byte_array_sparse_99pct_null/zstd 1.00 16.9±0.21ms 59.3 MElem/sec decimal128_dictionary/bloom_filter 1.00 47.7±1.79ms 21.0 MElem/sec decimal128_dictionary/cdc 1.00 34.7±0.47ms 28.9 MElem/sec decimal128_dictionary/zstd 1.00 38.6±0.57ms 25.9 MElem/sec decimal128_dictionary_1pct_cardinality/bloom_filter 1.00 39.2±0.65ms 25.5 MElem/sec decimal128_dictionary_1pct_cardinality/cdc 1.00 29.1±0.28ms 34.3 MElem/sec decimal128_sparse/zstd 1.00 51.6±0.36ms 19.4 MElem/sec fixed_size_binary_non_null/default 1.00 35.1±0.50ms 28.5 MElem/sec fixed_size_binary_ree/bloom_filter 1.00 61.1±1.08ms 16.5 MB/sec 1.06 64.8±1.69ms 15.4 MElem/sec fixed_size_binary_ree/parquet_2 1.00 64.9±0.85ms 15.5 MB/sec 1.05 68.4±1.13ms 14.6 MElem/sec fixed_size_binary_ree/zstd_parquet_2 1.00 65.3±1.49ms 15.4 MB/sec 1.05 68.8±1.06ms 14.5 MElem/sec fixed_size_binary_ree_low_cardinality/default 1.00 46.9±0.44ms 21.3 MElem/sec fixed_size_binary_ree_low_cardinality/parquet_2 1.00 55.5±0.42ms 18.0 MElem/sec fixed_size_binary_ree_low_cardinality/zstd_parquet_2 1.00 55.5±0.60ms 18.0 MElem/sec float64_dictionary/default 1.00 15.7±0.14ms 63.6 MElem/sec float64_dictionary/parquet_2 1.00 15.3±0.17ms 65.2 MElem/sec float64_dictionary/zstd_parquet_2 1.00 21.6±0.12ms 46.2 MElem/sec float64_dictionary_1pct_cardinality/bloom_filter 1.00 13.9±0.15ms 72.0 MElem/sec float64_dictionary_1pct_cardinality/cdc 1.00 15.7±0.14ms 63.6 MElem/sec float64_dictionary_1pct_cardinality/parquet_2 1.00 13.1±0.16ms 76.5 MElem/sec float_with_nans/default 1.00 59.9±1.68ms 233.8 MB/sec 1.00 60.0±0.73ms 16.7 MElem/sec float_with_nans/zstd 1.00 99.2±1.94ms 141.1 MB/sec 1.01 100.0±0.94ms 10.0 MElem/sec int32_ree/cdc 1.01 38.6±0.22ms 10.5 MB/sec 1.00 38.3±0.16ms 26.1 MElem/sec int32_ree/parquet_2 1.00 34.5±0.11ms 11.8 MB/sec 1.00 34.6±0.17ms 28.9 MElem/sec int32_ree/zstd 1.00 35.1±0.23ms 11.6 MB/sec 1.00 35.1±0.21ms 28.5 MElem/sec int32_ree_95pct_null/number_distinct_values 1.00 22.3±0.07ms 18.3 MB/sec 1.00 22.3±0.09ms 44.9 MElem/sec int32_ree_95pct_null/zstd 1.00 21.6±0.07ms 18.8 MB/sec 1.00 21.5±0.05ms 46.5 MElem/sec int64_dictionary/bloom_filter 1.00 20.1±0.19ms 49.8 MElem/sec int64_dictionary/parquet_2 1.00 17.2±0.24ms 58.1 MElem/sec int64_dictionary/zstd_parquet_2 1.00 22.3±0.22ms 44.8 MElem/sec int64_dictionary_1pct_cardinality/bloom_filter 1.00 13.2±0.12ms 75.8 MElem/sec int64_dictionary_1pct_cardinality/default 1.00 12.9±0.17ms 77.5 MElem/sec int64_ree_low_cardinality/cdc 1.00 29.0±0.30ms 34.5 MElem/sec large_string_non_null/default 1.05 55.7±1.06ms 4.5 GB/sec 1.00 53.1±1.39ms 18.8 KElem/sec large_string_non_null/parquet_2 1.00 54.1±1.19ms 4.6 GB/sec 1.02 55.2±2.13ms 18.1 KElem/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 22.3±0.76ms 5.6 GB/sec 1.17 26.0±1.86ms 4.8 GB/sec list_int32_ree/default 1.00 117.3±1.44ms 8.5 MElem/sec list_int32_ree/zstd 1.00 118.4±0.82ms 8.4 MElem/sec list_int32_ree_short_runs/bloom_filter 1.00 129.9±1.46ms 7.7 MElem/sec list_nested/bloom_filter 1.00 135.4±0.81ms 213.1 MB/sec 1.02 137.7±1.54ms 7.3 MElem/sec list_nested/parquet_2 1.00 130.7±0.81ms 220.7 MB/sec 1.01 132.6±0.88ms 7.5 MElem/sec list_of_int32_ree/bloom_filter 1.00 121.0±0.72ms 8.3 MElem/sec list_of_int32_ree/cdc 1.00 142.8±0.70ms 7.0 MElem/sec list_of_int32_ree/default 1.00 120.9±0.76ms 8.3 MElem/sec list_of_int32_ree/zstd 1.00 121.3±0.72ms 8.2 MElem/sec list_of_int32_ree/zstd_parquet_2 1.00 121.5±0.66ms 8.2 MElem/sec list_of_int32_ree_alt_empty/number_distinct_values 1.00 107.8±0.36ms 9.3 MElem/sec list_of_int32_ree_alt_empty/zstd_parquet_2 1.00 79.2±0.40ms 12.6 MElem/sec list_of_int32_ree_alt_null/zstd 1.00 114.1±0.45ms 8.8 MElem/sec list_of_list_int32_ree/cdc 1.00 191.4±1.08ms 5.2 MElem/sec list_of_list_int32_ree/default 1.00 144.0±0.77ms 6.9 MElem/sec list_of_list_int32_ree/number_distinct_values 1.00 273.9±1.43ms 3.7 MElem/sec list_of_list_int32_ree/zstd_parquet_2 1.00 147.0±1.33ms 6.8 MElem/sec list_primitive_non_null/cdc 1.04 395.3±12.42ms 1376.9 MB/sec 1.00 379.0±5.97ms 2.6 MElem/sec list_primitive_non_null/default 1.38 251.0±17.12ms 2.1 GB/sec 1.00 181.9±6.48ms 5.5 MElem/sec list_primitive_sparse_99pct_null/cdc 1.03 25.9±0.29ms 1444.0 MB/sec 1.00 25.2±0.26ms 39.7 MElem/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.1±0.13ms 2.8 GB/sec 1.00 13.0±0.18ms 77.1 MElem/sec list_string_ree/zstd_parquet_2 1.00 126.8±0.88ms 7.9 MElem/sec list_struct_with_list/bloom_filter 1.00 261.5±2.21ms 174.4 MB/sec 1.01 263.9±2.73ms 3.8 MElem/sec list_struct_with_list/zstd_parquet_2 1.00 272.5±4.17ms 167.3 MB/sec 1.00 273.4±2.42ms 3.7 MElem/sec ndv/large_binary_high_cardinality/ndv_on 1.00 39.1±1.46ms 192.1 MB/sec 1.00 39.0±0.76ms 192.6 MB/sec ndv/utf8_view_low_cardinality/ndv_on 1.00 23.8±0.09ms 419.9 MB/sec 1.00 23.7±0.08ms 421.7 MB/sec numeric_ree_of_dict/zstd_parquet_2 1.00 32.3±0.24ms 31.0 MElem/sec primitive/parquet_2 1.02 121.8±1.84ms 368.5 MB/sec 1.00 119.3±1.47ms 8.4 MElem/sec primitive_all_null/number_distinct_values 1.17 272.1±1.87µs 161.1 GB/sec 1.00 233.5±1.88µs 4.2 GElem/sec primitive_dictionary/number_distinct_values 1.00 54.0±0.89ms 18.5 MElem/sec primitive_dictionary_1pct_cardinality/bloom_filter 1.00 13.4±0.14ms 74.4 MElem/sec primitive_dictionary_1pct_cardinality/zstd_parquet_2 1.00 15.2±0.11ms 65.6 MElem/sec primitive_non_null/bloom_filter 1.00 95.7±1.36ms 459.9 MB/sec 1.02 98.0±1.08ms 10.2 MElem/sec primitive_non_null/cdc 1.00 82.1±1.31ms 536.2 MB/sec 1.03 84.5±2.09ms 11.8 MElem/sec primitive_non_null/parquet_2 1.00 76.0±1.88ms 579.3 MB/sec 1.01 76.5±1.71ms 13.1 MElem/sec primitive_sparse_99pct_null/number_distinct_values 1.00 15.3±0.25ms 2.9 GB/sec 1.00 15.3±0.28ms 65.2 MElem/sec ree_list_ree_list/bloom_filter 1.00 286.1±2.60ms 3.5 MElem/sec ree_list_ree_list/cdc 1.00 332.9±2.64ms 3.0 MElem/sec ree_list_ree_list/number_distinct_values 1.00 415.1±2.95ms 2.4 MElem/sec ree_struct_of_dict/bloom_filter 1.00 61.2±0.87ms 16.3 MElem/sec ree_struct_of_dict/cdc 1.00 69.2±0.51ms 14.5 MElem/sec ree_struct_of_dict/zstd_parquet_2 1.00 63.2±1.18ms 15.8 MElem/sec short_string_non_null/cdc 1.00 20.0±0.15ms 598.9 MB/sec 1.03 20.6±0.07ms 48.4 MElem/sec small_string_shared_prefix/plain 1.16 1162.4±25.57µs 6.7 GB/sec 1.00 998.9±28.79µs 7.9 GB/sec string/bloom_filter 1.40 266.6±39.60ms 1966.2 MB/sec 1.00 190.4±15.68ms 5.3 MElem/sec string/default 1.70 144.2±28.26ms 3.5 GB/sec 1.00 85.0±1.56ms 11.8 MElem/sec string_dictionary_1pct_cardinality/cdc 1.00 24.5±0.13ms 40.9 MElem/sec string_dictionary_1pct_cardinality/default 1.00 21.2±0.12ms 47.1 MElem/sec string_dictionary_low_cardinality_100/zstd 1.00 22.1±0.07ms 181.3 MB/sec 1.00 22.1±0.05ms 45.3 MElem/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 22.1±0.09ms 181.2 MB/sec 1.00 22.0±0.06ms 45.4 MElem/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 22.3±0.07ms 180.0 MB/sec 1.02 22.7±0.10ms 44.0 MElem/sec string_dictionary_low_cardinality_400/cdc 1.00 24.7±0.12ms 162.4 MB/sec 1.01 24.9±0.15ms 40.1 MElem/sec string_dictionary_low_cardinality_400/zstd 1.00 22.7±0.10ms 176.4 MB/sec 1.02 23.1±0.13ms 43.2 MElem/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 22.7±0.09ms 176.6 MB/sec 1.01 22.9±0.09ms 43.6 MElem/sec string_non_null/cdc 1.09 265.8±12.75ms 1971.2 MB/sec 1.00 242.9±5.34ms 4.1 MElem/sec string_ree/number_distinct_values 1.32 154.0±9.02ms 106.6 MB/sec 1.00 116.7±2.63ms 8.6 MElem/sec string_ree/zstd_parquet_2 1.53 145.9±3.82ms 112.4 MB/sec 1.00 95.4±1.31ms 10.5 MElem/sec string_ree_95pct_null/bloom_filter 1.00 25.5±0.21ms 55.2 MB/sec 1.00 25.4±0.12ms 39.4 MElem/sec string_ree_95pct_null/zstd 1.01 25.9±0.31ms 54.4 MB/sec 1.00 25.6±0.23ms 39.1 MElem/sec string_ree_int64_run_ends/cdc 1.00 45.4±0.21ms 22.0 MElem/sec string_ree_low_cardinality/cdc 1.00 45.4±0.19ms 22.0 MElem/sec string_ree_low_cardinality/parquet_2 1.00 35.9±0.17ms 27.9 MElem/sec string_ree_low_cardinality/zstd_parquet_2 1.00 36.1±0.17ms 27.7 MElem/sec string_ree_of_dict/cdc 1.00 46.0±0.12ms 21.7 MElem/sec struct_all_null/default 1.18 116.5±0.85µs 135.1 GB/sec 1.00 98.4±0.86µs 9.9 GElem/sec struct_all_null/zstd_parquet_2 1.22 159.7±0.83µs 98.6 GB/sec 1.00 130.6±1.31µs 7.5 GElem/sec struct_non_null/cdc 1.00 40.4±0.53ms 396.1 MB/sec 1.04 42.0±0.97ms 23.8 MElem/sec struct_non_null/zstd_parquet_2 1.00 47.5±0.62ms 336.7 MB/sec 1.04 49.2±0.94ms 20.3 MElem/sec struct_of_list_of_int32_ree_alt_null/zstd_parquet_2 1.00 115.6±0.49ms 8.6 MElem/sec struct_of_list_of_int32_ree_fragmented/default 1.00 124.0±1.05ms 8.1 MElem/sec struct_of_list_of_int32_ree_single_null/number_distinct_values 1.00 178.9±0.76ms 5.6 MElem/sec struct_ree/cdc 1.00 62.2±0.26ms 16.1 MElem/sec struct_ree/default 1.00 46.3±0.34ms 21.6 MElem/sec struct_ree/parquet_2 1.00 46.5±0.39ms 21.5 MElem/sec struct_ree_short_runs/bloom_filter 1.00 60.0±0.40ms 16.7 MElem/sec struct_ree_short_runs/default 1.00 60.0±0.23ms 16.7 MElem/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.09ms 2.6 GB/sec 1.05 6.3±0.11ms 157.8 MElem/sec struct_sparse_99pct_null/zstd 1.00 7.7±0.09ms 2.0 GB/sec 1.00 7.7±0.08ms 130.1 MElem/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 825.2s | | Peak memory | 2.8 GiB | | Avg memory | 2.5 GiB | | CPU user | 787.0s | | CPU sys | 32.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1755.4s | | Peak memory | 6.2 GiB | | Avg memory | 3.0 GiB | | CPU user | 1738.6s | | CPU sys | 12.6s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
