adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187750033
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187132069) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.5±0.03ms 20.0 MB/sec 1.01 12.7±0.07ms 19.8 MB/sec bool/cdc 1.02 15.5±0.14ms 16.1 MB/sec 1.00 15.2±0.04ms 16.4 MB/sec bool/default 1.00 10.5±0.05ms 23.9 MB/sec 1.01 10.6±0.05ms 23.7 MB/sec bool/parquet_2 1.00 14.2±0.07ms 17.6 MB/sec 1.00 14.3±0.04ms 17.5 MB/sec bool/zstd 1.00 11.0±0.06ms 22.7 MB/sec 1.00 11.0±0.06ms 22.6 MB/sec bool/zstd_parquet_2 1.00 14.6±0.04ms 17.2 MB/sec 1.01 14.7±0.06ms 17.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.3 MB/sec 1.02 6.7±0.05ms 18.8 MB/sec bool_non_null/cdc 1.00 6.3±0.09ms 19.9 MB/sec 1.00 6.3±0.02ms 19.8 MB/sec bool_non_null/default 1.00 3.8±0.04ms 33.2 MB/sec 1.03 3.9±0.02ms 32.4 MB/sec bool_non_null/parquet_2 1.00 8.5±0.04ms 14.7 MB/sec 1.02 8.6±0.04ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.4 MB/sec 1.03 4.2±0.04ms 29.6 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.03ms 14.0 MB/sec 1.02 9.0±0.03ms 13.8 MB/sec bool_ree/bloom_filter 1.00 30.0±0.08ms 7.1 MB/sec 1.00 30.0±0.08ms 7.1 MB/sec bool_ree/cdc 1.01 31.6±0.19ms 6.7 MB/sec 1.00 31.1±0.09ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.06ms 7.8 MB/sec 1.00 27.2±0.06ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.08ms 7.4 MB/sec 1.00 28.9±0.10ms 7.4 MB/sec bool_ree/zstd 1.00 27.9±0.05ms 7.6 MB/sec 1.00 27.8±0.04ms 7.7 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.09ms 7.3 MB/sec 1.00 29.2±0.10ms 7.3 MB/sec decimal/bloom_filter 1.02 122.7±3.31ms 489.1 MB/sec 1.00 120.0±3.97ms 500.2 MB/sec decimal/cdc 1.01 102.4±1.26ms 586.2 MB/sec 1.00 100.9±0.45ms 594.5 MB/sec decimal/default 1.01 79.3±0.91ms 756.6 MB/sec 1.00 78.6±0.44ms 762.9 MB/sec decimal/parquet_2 1.01 178.8±2.77ms 335.5 MB/sec 1.00 177.9±2.63ms 337.2 MB/sec decimal/zstd 1.00 90.7±1.10ms 661.8 MB/sec 1.00 90.7±1.80ms 661.6 MB/sec decimal/zstd_parquet_2 1.01 198.9±3.08ms 301.6 MB/sec 1.00 197.7±3.08ms 303.4 MB/sec fixed_size_binary_ree/bloom_filter 1.01 59.5±1.80ms 16.9 MB/sec 1.00 58.9±1.60ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.6±0.57ms 16.3 MB/sec 1.00 61.6±0.42ms 16.4 MB/sec fixed_size_binary_ree/default 1.00 51.2±0.18ms 19.7 MB/sec 1.00 51.1±0.97ms 19.7 MB/sec fixed_size_binary_ree/parquet_2 1.03 67.0±1.72ms 15.0 MB/sec 1.00 65.2±0.28ms 15.4 MB/sec fixed_size_binary_ree/zstd 1.01 57.1±0.25ms 17.6 MB/sec 1.00 56.7±0.25ms 17.8 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.0±1.24ms 15.0 MB/sec 1.00 67.3±1.68ms 15.0 MB/sec float_with_nans/bloom_filter 1.01 82.3±3.20ms 170.2 MB/sec 1.00 81.4±3.40ms 171.9 MB/sec float_with_nans/cdc 1.03 71.6±1.96ms 195.5 MB/sec 1.00 69.5±0.39ms 201.6 MB/sec float_with_nans/default 1.00 63.6±1.13ms 220.1 MB/sec 1.00 63.9±1.50ms 219.0 MB/sec float_with_nans/parquet_2 1.02 82.0±1.71ms 170.8 MB/sec 1.00 80.0±0.79ms 175.0 MB/sec float_with_nans/zstd 1.02 102.2±1.81ms 137.0 MB/sec 1.00 100.7±1.10ms 139.1 MB/sec float_with_nans/zstd_parquet_2 1.01 118.8±1.93ms 117.9 MB/sec 1.00 117.4±0.93ms 119.3 MB/sec fsb/bloom_filter 1.04 8.2±0.24ms 1956.5 MB/sec 1.00 7.9±0.04ms 2032.2 MB/sec fsb/cdc 1.01 10.4±0.03ms 1550.9 MB/sec 1.00 10.3±0.03ms 1566.6 MB/sec fsb/default 1.00 6.9±0.10ms 2.3 GB/sec 1.03 7.1±0.27ms 2.2 GB/sec fsb/parquet_2 1.04 13.6±0.47ms 1184.8 MB/sec 1.00 13.1±0.07ms 1229.7 MB/sec fsb/zstd 1.02 9.7±0.34ms 1666.3 MB/sec 1.00 9.5±0.26ms 1695.1 MB/sec fsb/zstd_parquet_2 1.02 14.3±0.08ms 1131.4 MB/sec 1.00 14.0±0.05ms 1151.7 MB/sec int32_ree/bloom_filter 1.01 40.2±0.52ms 10.1 MB/sec 1.00 40.0±0.11ms 10.2 MB/sec int32_ree/cdc 1.00 40.4±0.35ms 10.1 MB/sec 1.00 40.4±0.38ms 10.1 MB/sec int32_ree/default 1.01 36.6±0.30ms 11.1 MB/sec 1.00 36.3±0.06ms 11.2 MB/sec int32_ree/parquet_2 1.00 36.4±0.08ms 11.2 MB/sec 1.00 36.5±0.28ms 11.1 MB/sec int32_ree/zstd 1.00 36.9±0.05ms 11.0 MB/sec 1.00 37.0±0.30ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.31ms 11.0 MB/sec 1.00 37.0±0.31ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.03ms 18.6 MB/sec 1.00 22.0±0.26ms 18.5 MB/sec int32_ree_95pct_null/cdc 1.00 23.8±0.15ms 17.1 MB/sec 1.01 24.0±0.04ms 17.0 MB/sec int32_ree_95pct_null/default 1.01 21.6±0.10ms 18.9 MB/sec 1.00 21.4±0.02ms 19.0 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.02ms 18.9 MB/sec 1.00 21.5±0.17ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.01 22.0±0.19ms 18.5 MB/sec 1.00 21.7±0.15ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 21.9±0.18ms 18.6 MB/sec 1.00 21.6±0.07ms 18.8 MB/sec large_string_distinct/delta_byte_array 1.00 65.7±3.75ms 3.8 GB/sec 1.06 69.7±8.83ms 3.6 GB/sec large_string_distinct/plain 1.01 60.7±0.86ms 4.1 GB/sec 1.00 59.8±1.43ms 4.2 GB/sec large_string_non_null/bloom_filter 1.01 72.9±1.45ms 3.4 GB/sec 1.00 71.8±0.10ms 3.5 GB/sec large_string_non_null/cdc 1.00 244.4±2.22ms 1047.6 MB/sec 1.00 244.7±2.73ms 1046.3 MB/sec large_string_non_null/default 1.02 55.5±1.48ms 4.5 GB/sec 1.00 54.3±0.63ms 4.6 GB/sec large_string_non_null/parquet_2 1.01 54.6±0.08ms 4.6 GB/sec 1.00 54.1±0.19ms 4.6 GB/sec large_string_non_null/zstd 1.05 57.1±2.66ms 4.4 GB/sec 1.00 54.3±0.13ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.01 54.7±0.10ms 4.6 GB/sec 1.00 54.0±0.10ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.07 58.4±5.13ms 4.3 GB/sec 1.00 54.5±0.11ms 4.6 GB/sec large_string_shared_prefix/plain 1.07 99.2±9.35ms 2.5 GB/sec 1.00 92.7±2.55ms 2.7 GB/sec list_nested/bloom_filter 1.02 146.6±1.99ms 196.8 MB/sec 1.00 143.8±0.80ms 200.7 MB/sec list_nested/cdc 1.00 162.0±1.26ms 178.1 MB/sec 1.00 162.3±1.39ms 177.8 MB/sec list_nested/default 1.00 130.8±0.94ms 220.7 MB/sec 1.00 130.7±1.14ms 220.7 MB/sec list_nested/parquet_2 1.00 143.9±0.98ms 200.5 MB/sec 1.00 144.0±1.12ms 200.4 MB/sec list_nested/zstd 1.00 140.3±1.28ms 205.6 MB/sec 1.00 140.0±1.36ms 206.2 MB/sec list_nested/zstd_parquet_2 1.00 157.1±1.17ms 183.6 MB/sec 1.00 156.7±1.17ms 184.1 MB/sec list_primitive/bloom_filter 1.01 287.2±19.56ms 1898.6 MB/sec 1.00 284.3±18.45ms 1918.5 MB/sec list_primitive/cdc 1.00 312.4±3.91ms 1745.9 MB/sec 1.00 313.0±4.81ms 1742.5 MB/sec list_primitive/default 1.00 200.6±4.18ms 2.7 GB/sec 1.02 203.7±6.06ms 2.6 GB/sec list_primitive/parquet_2 1.00 225.8±2.56ms 2.4 GB/sec 1.00 225.3±2.82ms 2.4 GB/sec list_primitive/zstd 1.00 455.6±8.11ms 1196.9 MB/sec 1.01 459.4±10.50ms 1187.1 MB/sec list_primitive/zstd_parquet_2 1.00 449.7±5.50ms 1212.8 MB/sec 1.00 448.3±5.22ms 1216.6 MB/sec list_primitive_non_null/bloom_filter 1.06 387.4±29.83ms 1404.7 MB/sec 1.00 367.0±30.72ms 1483.1 MB/sec list_primitive_non_null/cdc 1.00 396.2±12.11ms 1373.6 MB/sec 1.00 394.4±12.05ms 1379.9 MB/sec list_primitive_non_null/default 1.05 240.8±8.98ms 2.2 GB/sec 1.00 229.2±9.29ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.08 268.5±12.06ms 2027.1 MB/sec 1.00 249.1±8.26ms 2.1 GB/sec list_primitive_non_null/zstd 1.02 672.0±13.34ms 809.9 MB/sec 1.00 657.9±16.97ms 827.2 MB/sec list_primitive_non_null/zstd_parquet_2 1.01 653.5±14.49ms 832.9 MB/sec 1.00 648.4±10.82ms 839.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.04ms 2.9 GB/sec 1.03 13.2±0.48ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.2±0.35ms 1546.0 MB/sec 1.00 23.9±0.25ms 1561.8 MB/sec list_primitive_sparse_99pct_null/default 1.04 12.8±0.40ms 2.9 GB/sec 1.00 12.3±0.02ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.02 12.8±0.40ms 2.9 GB/sec 1.00 12.5±0.35ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.2±0.03ms 2.6 GB/sec 1.00 14.1±0.16ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.5±0.02ms 2.9 GB/sec 1.03 12.8±0.40ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.01 284.3±4.88ms 160.4 MB/sec 1.00 281.8±4.75ms 161.8 MB/sec list_struct_with_list/cdc 1.00 321.2±2.63ms 141.9 MB/sec 1.00 319.7±2.68ms 142.6 MB/sec list_struct_with_list/default 1.00 255.9±2.62ms 178.2 MB/sec 1.00 254.9±3.10ms 178.9 MB/sec list_struct_with_list/parquet_2 1.00 273.1±2.74ms 167.0 MB/sec 1.00 272.2±2.34ms 167.5 MB/sec list_struct_with_list/zstd 1.00 277.4±2.73ms 164.3 MB/sec 1.00 276.3±2.97ms 165.0 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.1±2.55ms 154.0 MB/sec 1.00 294.8±2.53ms 154.7 MB/sec primitive/bloom_filter 1.00 146.0±5.12ms 307.4 MB/sec 1.01 147.7±6.02ms 303.9 MB/sec primitive/cdc 1.00 155.0±2.46ms 289.5 MB/sec 1.00 154.7±2.73ms 290.0 MB/sec primitive/default 1.00 114.9±2.43ms 390.5 MB/sec 1.00 114.4±2.47ms 392.2 MB/sec primitive/parquet_2 1.00 129.3±2.43ms 347.0 MB/sec 1.00 129.1±2.50ms 347.7 MB/sec primitive/zstd 1.00 143.6±1.04ms 312.5 MB/sec 1.00 143.6±2.83ms 312.4 MB/sec primitive/zstd_parquet_2 1.00 161.8±2.80ms 277.3 MB/sec 1.00 161.9±2.58ms 277.1 MB/sec primitive_all_null/bloom_filter 1.00 893.6±2.39µs 49.0 GB/sec 1.01 903.4±44.62µs 48.5 GB/sec primitive_all_null/cdc 1.00 18.5±0.37ms 2.4 GB/sec 1.04 19.2±0.30ms 2.3 GB/sec primitive_all_null/default 1.02 275.1±1.57µs 159.3 GB/sec 1.00 271.0±1.14µs 161.7 GB/sec primitive_all_null/parquet_2 1.02 285.0±1.92µs 153.8 GB/sec 1.00 280.6±1.42µs 156.2 GB/sec primitive_all_null/zstd 1.01 424.9±1.87µs 103.1 GB/sec 1.00 421.3±1.54µs 104.0 GB/sec primitive_all_null/zstd_parquet_2 1.02 386.2±1.51µs 113.5 GB/sec 1.00 380.2±1.75µs 115.3 GB/sec primitive_non_null/bloom_filter 1.03 103.9±5.32ms 423.3 MB/sec 1.00 100.9±0.35ms 436.1 MB/sec primitive_non_null/cdc 1.03 86.8±2.52ms 506.6 MB/sec 1.00 84.2±0.24ms 522.4 MB/sec primitive_non_null/default 1.00 61.8±0.42ms 712.0 MB/sec 1.00 61.8±0.80ms 712.2 MB/sec primitive_non_null/parquet_2 1.01 85.1±2.33ms 517.3 MB/sec 1.00 84.3±2.20ms 522.0 MB/sec primitive_non_null/zstd 1.02 93.9±2.96ms 468.7 MB/sec 1.00 92.0±0.16ms 478.4 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.4±2.68ms 374.8 MB/sec 1.00 117.5±2.55ms 374.5 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 12.1±0.06ms 3.6 GB/sec 1.00 12.0±0.05ms 3.7 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.0±1.10ms 1493.9 MB/sec 1.03 31.1±0.75ms 1444.8 MB/sec primitive_sparse_99pct_null/default 1.03 11.2±0.48ms 3.9 GB/sec 1.00 10.8±0.32ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.1±0.42ms 4.0 GB/sec 1.01 11.2±0.47ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.03 14.6±0.55ms 3.0 GB/sec 1.00 14.2±0.28ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.05ms 3.4 GB/sec 1.03 13.0±0.52ms 3.4 GB/sec short_string_non_null/bloom_filter 1.02 26.9±0.06ms 446.4 MB/sec 1.00 26.3±0.06ms 456.9 MB/sec short_string_non_null/cdc 1.00 19.6±0.06ms 612.3 MB/sec 1.00 19.6±0.20ms 613.3 MB/sec short_string_non_null/default 1.02 15.7±0.23ms 763.1 MB/sec 1.00 15.5±0.18ms 774.8 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.32ms 463.8 MB/sec 1.01 26.0±0.36ms 461.3 MB/sec short_string_non_null/zstd 1.00 35.9±0.45ms 334.0 MB/sec 1.00 35.8±0.41ms 334.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.7±0.17ms 418.1 MB/sec 1.00 28.6±0.04ms 420.0 MB/sec small_string_distinct/delta_byte_array 1.03 998.9±82.15µs 7.9 GB/sec 1.00 970.1±87.81µs 8.1 GB/sec small_string_distinct/plain 1.06 802.8±72.62µs 9.8 GB/sec 1.00 758.1±61.08µs 10.3 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1002.3±2.82µs 7.8 GB/sec 1.00 1006.9±53.16µs 7.8 GB/sec small_string_partial_prefix/plain 1.02 1012.3±5.56µs 7.7 GB/sec 1.00 989.4±2.55µs 7.9 GB/sec small_string_shared_prefix/delta_byte_array 1.00 984.7±38.83µs 8.0 GB/sec 1.00 989.2±11.47µs 7.9 GB/sec small_string_shared_prefix/plain 1.02 1164.9±97.28µs 6.7 GB/sec 1.00 1142.2±106.86µs 6.9 GB/sec string/bloom_filter 1.04 219.1±32.88ms 2.3 GB/sec 1.00 211.2±29.55ms 2.4 GB/sec string/cdc 1.00 201.9±4.16ms 2.5 GB/sec 1.00 201.5±5.08ms 2.5 GB/sec string/default 1.09 119.8±19.39ms 4.3 GB/sec 1.00 109.9±6.85ms 4.7 GB/sec string/parquet_2 1.03 99.7±5.00ms 5.1 GB/sec 1.00 97.2±4.65ms 5.3 GB/sec string/zstd 1.00 416.7±13.23ms 1258.2 MB/sec 1.08 449.8±14.23ms 1165.5 MB/sec string/zstd_parquet_2 1.00 383.4±3.74ms 1367.3 MB/sec 1.02 390.4±7.83ms 1342.8 MB/sec string_and_binary_view/bloom_filter 1.00 67.0±5.07ms 481.0 MB/sec 1.00 66.9±4.82ms 482.2 MB/sec string_and_binary_view/cdc 1.00 58.7±0.52ms 549.0 MB/sec 1.03 60.5±2.77ms 533.4 MB/sec string_and_binary_view/default 1.00 48.7±2.25ms 662.2 MB/sec 1.01 49.0±2.24ms 658.4 MB/sec string_and_binary_view/parquet_2 1.02 59.9±2.05ms 538.1 MB/sec 1.00 59.0±0.09ms 546.2 MB/sec string_and_binary_view/zstd 1.00 84.8±0.51ms 380.5 MB/sec 1.00 84.8±0.13ms 380.1 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.8±1.32ms 437.2 MB/sec 1.01 74.7±2.68ms 432.0 MB/sec string_dictionary/bloom_filter 1.00 88.9±10.43ms 2.9 GB/sec 1.01 89.5±11.97ms 2.9 GB/sec string_dictionary/cdc 1.00 48.7±4.15ms 5.3 GB/sec 1.02 49.5±3.33ms 5.2 GB/sec string_dictionary/default 1.00 43.2±3.07ms 6.0 GB/sec 1.03 44.4±3.39ms 5.8 GB/sec string_dictionary/parquet_2 1.01 49.1±0.45ms 5.3 GB/sec 1.00 48.5±0.38ms 5.3 GB/sec string_dictionary/zstd 1.00 207.1±5.43ms 1275.4 MB/sec 1.00 208.0±5.46ms 1269.8 MB/sec string_dictionary/zstd_parquet_2 1.00 192.9±2.10ms 1369.0 MB/sec 1.00 192.7±2.45ms 1370.4 MB/sec string_non_null/bloom_filter 1.12 243.9±32.47ms 2.1 GB/sec 1.00 217.5±24.22ms 2.4 GB/sec string_non_null/cdc 1.02 254.6±8.34ms 2.0 GB/sec 1.00 248.9±9.34ms 2.1 GB/sec string_non_null/default 1.14 119.3±14.64ms 4.3 GB/sec 1.00 104.8±17.96ms 4.9 GB/sec string_non_null/parquet_2 1.00 122.7±15.32ms 4.2 GB/sec 1.05 129.4±6.60ms 4.0 GB/sec string_non_null/zstd 1.01 563.0±18.96ms 930.7 MB/sec 1.00 556.3±15.11ms 941.9 MB/sec string_non_null/zstd_parquet_2 1.00 506.9±7.61ms 1033.6 MB/sec 1.01 511.4±7.51ms 1024.6 MB/sec string_ree/bloom_filter 1.00 153.3±4.72ms 107.0 MB/sec 1.02 156.4±6.03ms 104.9 MB/sec string_ree/cdc 1.00 225.0±5.49ms 72.9 MB/sec 1.00 224.1±5.93ms 73.2 MB/sec string_ree/default 1.00 125.1±4.52ms 131.2 MB/sec 1.03 129.0±5.17ms 127.2 MB/sec string_ree/parquet_2 1.00 127.2±2.55ms 129.0 MB/sec 1.01 129.0±4.88ms 127.2 MB/sec string_ree/zstd 1.00 185.8±7.18ms 88.3 MB/sec 1.02 189.8±7.85ms 86.4 MB/sec string_ree/zstd_parquet_2 1.00 142.0±2.43ms 115.6 MB/sec 1.02 145.5±4.16ms 112.8 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.4±0.53ms 53.2 MB/sec 1.00 26.6±0.61ms 53.0 MB/sec string_ree_95pct_null/cdc 1.01 32.7±0.68ms 43.0 MB/sec 1.00 32.3±0.06ms 43.5 MB/sec string_ree_95pct_null/default 1.01 24.8±0.28ms 56.7 MB/sec 1.00 24.5±0.04ms 57.5 MB/sec string_ree_95pct_null/parquet_2 1.01 25.0±0.50ms 56.2 MB/sec 1.00 24.8±0.47ms 56.8 MB/sec string_ree_95pct_null/zstd 1.01 25.5±0.04ms 55.2 MB/sec 1.00 25.3±0.05ms 55.7 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.7±0.45ms 54.8 MB/sec 1.00 25.4±0.46ms 55.3 MB/sec struct_all_null/bloom_filter 1.01 373.7±5.09µs 42.1 GB/sec 1.00 369.9±1.23µs 42.6 GB/sec struct_all_null/cdc 1.00 7.4±0.09ms 2.1 GB/sec 1.06 7.8±0.07ms 2.0 GB/sec struct_all_null/default 1.02 118.9±1.02µs 132.4 GB/sec 1.00 116.9±0.61µs 134.7 GB/sec struct_all_null/parquet_2 1.01 122.3±0.77µs 128.7 GB/sec 1.00 120.8±0.58µs 130.4 GB/sec struct_all_null/zstd 1.01 183.6±0.69µs 85.8 GB/sec 1.00 181.2±0.67µs 86.9 GB/sec struct_all_null/zstd_parquet_2 1.01 166.6±0.63µs 94.5 GB/sec 1.00 164.2±0.73µs 95.9 GB/sec struct_non_null/bloom_filter 1.04 44.4±0.76ms 360.4 MB/sec 1.00 42.8±0.13ms 373.8 MB/sec struct_non_null/cdc 1.03 43.9±1.16ms 364.2 MB/sec 1.00 42.7±0.20ms 374.6 MB/sec struct_non_null/default 1.05 30.8±1.33ms 518.7 MB/sec 1.00 29.3±0.08ms 547.0 MB/sec struct_non_null/parquet_2 1.01 38.6±0.32ms 414.5 MB/sec 1.00 38.1±0.11ms 420.1 MB/sec struct_non_null/zstd 1.00 38.5±0.32ms 415.5 MB/sec 1.00 38.7±1.20ms 413.6 MB/sec struct_non_null/zstd_parquet_2 1.02 53.5±1.32ms 299.1 MB/sec 1.00 52.5±1.29ms 304.7 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.9±0.46ms 2.3 GB/sec 1.00 6.8±0.45ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.4±0.28ms 1204.1 MB/sec 1.04 13.9±0.10ms 1156.9 MB/sec struct_sparse_99pct_null/default 1.02 6.1±0.17ms 2.6 GB/sec 1.00 5.9±0.01ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.05 6.2±0.29ms 2.5 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.03ms 2.1 GB/sec 1.04 7.6±0.28ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.03 7.1±0.31ms 2.2 GB/sec 1.00 6.8±0.26ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3010.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2928.9s | | CPU sys | 78.4s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3020.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2934.0s | | CPU sys | 82.5s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
