adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5404818498
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5404308395) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (c7591d17b58bd3db5cd2201a272653837da9c8c6) to 3577093f26591aee806a9133c891b6b8e5255477 [diff](https://github.com/apache/arrow-rs/compare/3577093f26591aee806a9133c891b6b8e5255477..c7591d17b58bd3db5cd2201a272653837da9c8c6) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer env: BENCH_FILTER: "^[a-l]" baseline: ref: "3577093f26591aee806a9133c891b6b8e5255477" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.8±0.11ms 19.5 MB/sec 1.01 13.0±0.11ms 19.3 MB/sec bool/cdc 1.00 15.7±0.10ms 15.9 MB/sec 1.02 16.0±0.11ms 15.6 MB/sec bool/default 1.00 10.7±0.10ms 23.3 MB/sec 1.01 10.9±0.10ms 23.0 MB/sec bool/number_distinct_values 1.00 21.3±0.12ms 11.8 MB/sec 1.00 21.4±0.12ms 11.7 MB/sec bool/parquet_2 1.00 13.7±0.11ms 18.2 MB/sec 1.00 13.8±0.11ms 18.2 MB/sec bool/zstd 1.00 11.3±0.11ms 22.2 MB/sec 1.01 11.4±0.12ms 22.0 MB/sec bool/zstd_parquet_2 1.00 14.1±0.12ms 17.7 MB/sec 1.01 14.2±0.11ms 17.7 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.02ms 18.9 MB/sec 1.01 6.7±0.03ms 18.7 MB/sec bool_non_null/cdc 1.00 6.5±0.07ms 19.3 MB/sec 1.00 6.5±0.03ms 19.2 MB/sec bool_non_null/default 1.00 3.8±0.02ms 32.6 MB/sec 1.02 3.9±0.02ms 32.1 MB/sec bool_non_null/number_distinct_values 1.00 18.0±0.16ms 7.0 MB/sec 1.00 17.9±0.03ms 7.0 MB/sec bool_non_null/parquet_2 1.00 7.7±0.02ms 16.2 MB/sec 1.00 7.7±0.03ms 16.3 MB/sec bool_non_null/zstd 1.00 4.2±0.02ms 29.8 MB/sec 1.02 4.3±0.02ms 29.3 MB/sec bool_non_null/zstd_parquet_2 1.00 8.1±0.02ms 15.4 MB/sec 1.00 8.1±0.02ms 15.4 MB/sec bool_ree/bloom_filter 1.00 30.4±0.19ms 7.0 MB/sec 1.00 30.5±0.16ms 7.0 MB/sec bool_ree/cdc 1.00 32.0±0.17ms 6.7 MB/sec 1.00 31.9±0.14ms 6.7 MB/sec bool_ree/default 1.00 27.7±0.19ms 7.7 MB/sec 1.01 27.9±0.14ms 7.6 MB/sec bool_ree/number_distinct_values 1.00 40.4±0.19ms 5.3 MB/sec 1.00 40.5±0.18ms 5.3 MB/sec bool_ree/parquet_2 1.00 29.1±0.19ms 7.3 MB/sec 1.00 29.3±0.13ms 7.3 MB/sec bool_ree/zstd 1.00 28.4±0.19ms 7.5 MB/sec 1.00 28.4±0.18ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.5±0.18ms 7.2 MB/sec 1.00 29.5±0.14ms 7.2 MB/sec decimal/bloom_filter 1.07 177.9±2.44ms 337.2 MB/sec 1.00 166.8±0.50ms 359.8 MB/sec decimal/cdc 1.03 103.4±4.31ms 580.3 MB/sec 1.00 100.1±0.42ms 599.7 MB/sec decimal/default 1.06 132.4±2.88ms 453.3 MB/sec 1.00 124.5±0.99ms 482.0 MB/sec decimal/number_distinct_values 1.02 380.8±2.44ms 157.6 MB/sec 1.00 373.4±1.99ms 160.7 MB/sec decimal/parquet_2 1.04 235.6±4.12ms 254.7 MB/sec 1.00 226.5±3.23ms 265.0 MB/sec decimal/zstd 1.06 146.8±2.04ms 408.6 MB/sec 1.00 139.2±1.16ms 431.1 MB/sec decimal/zstd_parquet_2 1.04 257.8±5.69ms 232.7 MB/sec 1.00 248.6±4.88ms 241.4 MB/sec fixed_size_binary_ree/bloom_filter 1.01 79.8±0.87ms 12.6 MB/sec 1.00 79.1±1.30ms 12.7 MB/sec fixed_size_binary_ree/cdc 1.01 62.4±0.38ms 16.1 MB/sec 1.00 61.6±0.23ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 70.4±0.99ms 14.3 MB/sec 1.02 71.6±0.29ms 14.1 MB/sec fixed_size_binary_ree/number_distinct_values 1.30 89.9±0.96ms 11.2 MB/sec 1.00 69.3±0.18ms 14.5 MB/sec fixed_size_binary_ree/parquet_2 1.03 85.7±0.93ms 11.8 MB/sec 1.00 82.9±0.38ms 12.1 MB/sec fixed_size_binary_ree/zstd 1.02 76.7±0.96ms 13.1 MB/sec 1.00 75.0±0.26ms 13.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.04 86.7±0.91ms 11.6 MB/sec 1.00 83.5±0.98ms 12.1 MB/sec float_with_nans/bloom_filter 1.06 92.8±0.98ms 150.8 MB/sec 1.00 88.0±0.31ms 159.2 MB/sec float_with_nans/cdc 1.03 71.5±0.53ms 195.9 MB/sec 1.00 69.3±0.34ms 202.2 MB/sec float_with_nans/default 1.04 73.6±1.01ms 190.3 MB/sec 1.00 70.4±0.23ms 198.8 MB/sec float_with_nans/number_distinct_values 1.03 174.5±0.97ms 80.2 MB/sec 1.00 169.5±0.27ms 82.6 MB/sec float_with_nans/parquet_2 1.03 89.6±0.98ms 156.2 MB/sec 1.00 86.6±0.22ms 161.6 MB/sec float_with_nans/zstd 1.03 112.1±0.95ms 124.9 MB/sec 1.00 108.9±0.22ms 128.5 MB/sec float_with_nans/zstd_parquet_2 1.03 126.9±0.99ms 110.4 MB/sec 1.00 123.6±0.41ms 113.2 MB/sec fsb/bloom_filter 1.06 8.5±0.11ms 1886.5 MB/sec 1.00 8.0±0.03ms 2003.3 MB/sec fsb/cdc 1.04 10.8±0.04ms 1491.3 MB/sec 1.00 10.4±0.04ms 1544.4 MB/sec fsb/default 1.04 7.2±0.10ms 2.2 GB/sec 1.00 6.9±0.03ms 2.3 GB/sec fsb/number_distinct_values 1.04 11.9±0.11ms 1355.6 MB/sec 1.00 11.4±0.08ms 1411.8 MB/sec fsb/parquet_2 1.06 13.8±0.13ms 1172.5 MB/sec 1.00 13.0±0.06ms 1238.3 MB/sec fsb/zstd 1.03 9.7±0.10ms 1664.0 MB/sec 1.00 9.4±0.04ms 1715.6 MB/sec fsb/zstd_parquet_2 1.05 14.5±0.12ms 1108.4 MB/sec 1.00 13.9±0.06ms 1159.7 MB/sec int32_ree/bloom_filter 1.01 40.2±0.27ms 10.1 MB/sec 1.00 39.8±0.24ms 10.2 MB/sec int32_ree/cdc 1.01 39.5±0.17ms 10.3 MB/sec 1.00 39.3±0.13ms 10.4 MB/sec int32_ree/default 1.01 35.6±0.20ms 11.4 MB/sec 1.00 35.3±0.06ms 11.5 MB/sec int32_ree/number_distinct_values 1.01 52.7±0.23ms 7.7 MB/sec 1.00 52.0±0.07ms 7.8 MB/sec int32_ree/parquet_2 1.02 35.9±0.20ms 11.3 MB/sec 1.00 35.3±0.06ms 11.5 MB/sec int32_ree/zstd 1.02 36.6±0.23ms 11.1 MB/sec 1.00 35.8±0.05ms 11.4 MB/sec int32_ree/zstd_parquet_2 1.02 36.4±0.19ms 11.2 MB/sec 1.00 35.8±0.08ms 11.4 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.2±0.02ms 18.3 MB/sec 1.00 22.0±0.06ms 18.5 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.04ms 16.9 MB/sec 1.02 24.4±0.11ms 16.6 MB/sec int32_ree_95pct_null/default 1.01 21.7±0.02ms 18.8 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/number_distinct_values 1.01 22.7±0.02ms 17.9 MB/sec 1.00 22.5±0.03ms 18.1 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.7±0.01ms 18.8 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.01 22.0±0.01ms 18.5 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 21.9±0.01ms 18.6 MB/sec 1.00 21.7±0.02ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.08 64.5±0.49ms 3.9 GB/sec 1.00 59.8±0.42ms 4.2 GB/sec large_string_distinct/plain 1.04 62.7±0.72ms 4.0 GB/sec 1.00 60.1±0.59ms 4.2 GB/sec large_string_distinct_nullable/delta_byte_array 1.12 59.2±0.72ms 4.2 GB/sec 1.00 52.8±0.34ms 4.7 GB/sec large_string_non_null/bloom_filter 1.05 69.4±0.11ms 3.6 GB/sec 1.00 65.9±0.19ms 3.8 GB/sec large_string_non_null/cdc 1.01 240.8±0.97ms 1063.3 MB/sec 1.00 237.4±0.80ms 1078.2 MB/sec large_string_non_null/default 1.05 53.0±0.53ms 4.7 GB/sec 1.00 50.6±0.23ms 4.9 GB/sec large_string_non_null/number_distinct_values 1.04 68.3±0.19ms 3.7 GB/sec 1.00 66.0±0.25ms 3.8 GB/sec large_string_non_null/parquet_2 1.03 51.9±0.08ms 4.8 GB/sec 1.00 50.5±0.20ms 5.0 GB/sec large_string_non_null/zstd 1.02 52.1±0.07ms 4.8 GB/sec 1.00 50.8±0.22ms 4.9 GB/sec large_string_non_null/zstd_parquet_2 1.02 52.0±0.07ms 4.8 GB/sec 1.00 50.7±0.22ms 4.9 GB/sec large_string_shared_prefix/delta_byte_array 1.05 44.8±0.21ms 5.6 GB/sec 1.00 42.9±0.11ms 5.8 GB/sec large_string_shared_prefix/plain 1.04 97.2±0.86ms 2.6 GB/sec 1.00 93.5±0.76ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.02 56.0±0.41ms 4.5 GB/sec 1.00 55.0±0.22ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 41.9±0.16ms 6.0 GB/sec 1.02 42.7±0.13ms 5.9 GB/sec large_string_shared_prefix_nullable/plain 1.09 67.2±0.44ms 3.7 GB/sec 1.00 61.4±0.30ms 4.1 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.04 22.6±0.10ms 5.5 GB/sec 1.00 21.9±0.07ms 5.7 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 41.5±0.21ms 6.0 GB/sec 1.63 67.7±0.23ms 3.7 GB/sec list_nested/bloom_filter 1.02 145.9±0.61ms 197.8 MB/sec 1.00 142.7±0.20ms 202.1 MB/sec list_nested/cdc 1.02 162.1±0.25ms 178.0 MB/sec 1.00 159.4±0.19ms 181.0 MB/sec list_nested/default 1.02 130.5±0.20ms 221.1 MB/sec 1.00 128.5±0.17ms 224.6 MB/sec list_nested/number_distinct_values 1.14 323.8±1.56ms 89.1 MB/sec 1.00 285.0±1.19ms 101.3 MB/sec list_nested/parquet_2 1.01 143.6±0.22ms 200.9 MB/sec 1.00 141.5±0.17ms 203.9 MB/sec list_nested/zstd 1.02 140.1±0.21ms 205.9 MB/sec 1.00 137.4±0.17ms 210.0 MB/sec list_nested/zstd_parquet_2 1.02 156.5±0.23ms 184.3 MB/sec 1.00 154.2±0.15ms 187.1 MB/sec list_primitive/bloom_filter 1.18 323.5±27.54ms 1686.0 MB/sec 1.00 273.7±1.47ms 1992.7 MB/sec list_primitive/cdc 1.04 323.0±9.27ms 1688.6 MB/sec 1.00 309.8±2.30ms 1760.6 MB/sec list_primitive/default 1.11 231.1±24.10ms 2.3 GB/sec 1.00 208.0±18.73ms 2.6 GB/sec list_primitive/number_distinct_values 1.02 407.7±1.46ms 1337.8 MB/sec 1.00 399.7±6.79ms 1364.4 MB/sec list_primitive/parquet_2 1.02 223.6±0.33ms 2.4 GB/sec 1.00 219.1±0.37ms 2.4 GB/sec list_primitive/zstd 1.03 461.5±2.89ms 1181.7 MB/sec 1.00 450.2±1.89ms 1211.4 MB/sec list_primitive/zstd_parquet_2 1.02 448.3±1.39ms 1216.5 MB/sec 1.00 441.2±0.30ms 1236.2 MB/sec list_primitive_non_null/bloom_filter 1.11 409.0±15.29ms 1330.8 MB/sec 1.00 366.8±14.95ms 1483.7 MB/sec list_primitive_non_null/cdc 1.03 397.1±1.19ms 1370.5 MB/sec 1.00 385.0±7.13ms 1413.5 MB/sec list_primitive_non_null/default 1.07 253.9±13.89ms 2.1 GB/sec 1.00 236.9±11.15ms 2.2 GB/sec list_primitive_non_null/number_distinct_values 1.06 594.1±5.68ms 916.1 MB/sec 1.00 563.0±12.42ms 966.6 MB/sec list_primitive_non_null/parquet_2 1.06 270.5±17.01ms 2012.1 MB/sec 1.00 255.8±12.22ms 2.1 GB/sec list_primitive_non_null/zstd 1.06 694.0±4.65ms 784.2 MB/sec 1.00 657.5±3.23ms 827.8 MB/sec list_primitive_non_null/zstd_parquet_2 1.03 656.4±19.15ms 829.1 MB/sec 1.00 640.3±13.43ms 850.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 13.2±0.05ms 2.8 GB/sec 1.00 12.8±0.37ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.9±0.11ms 1503.6 MB/sec 1.00 24.5±0.16ms 1522.3 MB/sec list_primitive_sparse_99pct_null/default 1.03 12.7±0.03ms 2.9 GB/sec 1.00 12.3±0.07ms 3.0 GB/sec list_primitive_sparse_99pct_null/number_distinct_values 1.02 12.7±0.05ms 2.9 GB/sec 1.00 12.5±0.29ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.7±0.13ms 2.9 GB/sec 1.00 12.6±0.15ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.6±0.06ms 2.5 GB/sec 1.01 14.8±0.39ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.9±0.04ms 2.8 GB/sec 1.03 13.2±0.35ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.03 284.9±1.54ms 160.0 MB/sec 1.00 276.5±1.15ms 164.9 MB/sec list_struct_with_list/cdc 1.02 321.3±0.84ms 141.9 MB/sec 1.00 316.2±0.53ms 144.2 MB/sec list_struct_with_list/default 1.02 255.2±0.34ms 178.7 MB/sec 1.00 251.1±0.57ms 181.6 MB/sec list_struct_with_list/number_distinct_values 1.03 543.1±3.83ms 84.0 MB/sec 1.00 527.0±12.55ms 86.5 MB/sec list_struct_with_list/parquet_2 1.02 272.9±0.53ms 167.1 MB/sec 1.00 268.9±0.98ms 169.6 MB/sec list_struct_with_list/zstd 1.02 277.7±0.45ms 164.2 MB/sec 1.00 272.9±0.62ms 167.1 MB/sec list_struct_with_list/zstd_parquet_2 1.01 295.9±0.39ms 154.1 MB/sec 1.00 292.8±1.33ms 155.7 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 2085.5s | | Peak memory | 2.9 GiB | | Avg memory | 2.5 GiB | | CPU user | 1991.4s | | CPU sys | 89.9s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2150.5s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2047.2s | | CPU sys | 101.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
