adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5189186392
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5188253066) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to main [diff](https://github.com/apache/arrow-rs/compare/291efc247b9639c0bf87d2621f679b6cce4942bf..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "main" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.8±0.07ms 19.5 MB/sec 1.00 12.8±0.03ms 19.5 MB/sec bool/cdc 1.01 15.8±0.08ms 15.8 MB/sec 1.00 15.7±0.07ms 16.0 MB/sec bool/default 1.00 10.7±0.05ms 23.4 MB/sec 1.00 10.6±0.03ms 23.5 MB/sec bool/parquet_2 1.06 14.4±0.06ms 17.3 MB/sec 1.00 13.6±0.04ms 18.4 MB/sec bool/zstd 1.00 11.2±0.06ms 22.2 MB/sec 1.00 11.2±0.04ms 22.3 MB/sec bool/zstd_parquet_2 1.06 14.8±0.06ms 16.9 MB/sec 1.00 14.0±0.05ms 17.8 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.03ms 19.0 MB/sec 1.04 6.9±0.04ms 18.2 MB/sec bool_non_null/cdc 1.00 6.5±0.10ms 19.4 MB/sec 1.06 6.8±0.05ms 18.3 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.2 MB/sec 1.06 4.0±0.02ms 31.2 MB/sec bool_non_null/parquet_2 1.09 8.5±0.03ms 14.7 MB/sec 1.00 7.8±0.03ms 16.0 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.5 MB/sec 1.08 4.4±0.03ms 28.2 MB/sec bool_non_null/zstd_parquet_2 1.08 8.9±0.03ms 14.0 MB/sec 1.00 8.3±0.03ms 15.2 MB/sec bool_ree/bloom_filter 1.01 30.5±0.24ms 7.0 MB/sec 1.00 30.2±0.06ms 7.0 MB/sec bool_ree/cdc 1.01 32.1±0.14ms 6.6 MB/sec 1.00 31.7±0.06ms 6.7 MB/sec bool_ree/default 1.01 27.8±0.16ms 7.7 MB/sec 1.00 27.5±0.08ms 7.7 MB/sec bool_ree/parquet_2 1.02 29.4±0.26ms 7.2 MB/sec 1.00 28.9±0.06ms 7.4 MB/sec bool_ree/zstd 1.01 28.5±0.18ms 7.5 MB/sec 1.00 28.2±0.09ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.01 29.6±0.14ms 7.2 MB/sec 1.00 29.3±0.13ms 7.3 MB/sec decimal/bloom_filter 1.04 126.3±3.03ms 475.2 MB/sec 1.00 120.9±1.99ms 496.3 MB/sec decimal/cdc 1.02 103.2±0.76ms 581.5 MB/sec 1.00 101.5±0.66ms 591.0 MB/sec decimal/default 1.02 81.7±1.19ms 734.7 MB/sec 1.00 79.9±0.85ms 750.6 MB/sec decimal/parquet_2 1.01 180.9±0.65ms 331.8 MB/sec 1.00 179.1±2.30ms 334.9 MB/sec decimal/zstd 1.02 92.7±1.07ms 647.3 MB/sec 1.00 90.7±0.91ms 661.2 MB/sec decimal/zstd_parquet_2 1.01 200.2±0.72ms 299.7 MB/sec 1.00 198.7±2.47ms 302.0 MB/sec fixed_size_binary_ree/bloom_filter 1.00 60.6±0.49ms 16.6 MB/sec 1.01 61.3±0.80ms 16.4 MB/sec fixed_size_binary_ree/cdc 1.00 62.3±0.25ms 16.2 MB/sec 1.00 62.3±0.54ms 16.2 MB/sec fixed_size_binary_ree/default 1.01 52.9±0.27ms 19.0 MB/sec 1.00 52.5±0.55ms 19.2 MB/sec fixed_size_binary_ree/parquet_2 1.03 69.3±0.49ms 14.5 MB/sec 1.00 67.5±0.35ms 14.9 MB/sec fixed_size_binary_ree/zstd 1.01 58.8±0.33ms 17.1 MB/sec 1.00 58.4±0.69ms 17.3 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.03 70.2±0.52ms 14.3 MB/sec 1.00 68.1±0.76ms 14.8 MB/sec float_with_nans/bloom_filter 1.01 84.6±1.57ms 165.5 MB/sec 1.00 83.6±1.97ms 167.6 MB/sec float_with_nans/cdc 1.02 72.5±0.56ms 193.0 MB/sec 1.00 71.1±0.92ms 196.8 MB/sec float_with_nans/default 1.01 64.3±0.90ms 217.6 MB/sec 1.00 63.7±1.23ms 219.8 MB/sec float_with_nans/parquet_2 1.04 82.8±0.46ms 169.0 MB/sec 1.00 79.5±1.31ms 176.1 MB/sec float_with_nans/zstd 1.02 104.3±0.38ms 134.2 MB/sec 1.00 102.4±1.40ms 136.7 MB/sec float_with_nans/zstd_parquet_2 1.03 120.5±0.32ms 116.2 MB/sec 1.00 116.6±1.40ms 120.1 MB/sec fsb/bloom_filter 1.00 8.1±0.04ms 1996.7 MB/sec 1.05 8.5±0.24ms 1896.8 MB/sec fsb/cdc 1.00 10.3±0.04ms 1560.6 MB/sec 1.06 10.9±0.05ms 1473.5 MB/sec fsb/default 1.00 6.9±0.04ms 2.3 GB/sec 1.06 7.3±0.03ms 2.1 GB/sec fsb/parquet_2 1.00 13.4±0.07ms 1202.7 MB/sec 1.03 13.8±0.19ms 1166.3 MB/sec fsb/zstd 1.00 9.4±0.05ms 1712.4 MB/sec 1.04 9.8±0.03ms 1646.5 MB/sec fsb/zstd_parquet_2 1.00 14.3±0.07ms 1127.1 MB/sec 1.04 14.9±0.17ms 1082.0 MB/sec int32_ree/bloom_filter 1.00 41.9±0.16ms 9.7 MB/sec 1.01 42.4±0.44ms 9.6 MB/sec int32_ree/cdc 1.02 41.2±0.28ms 9.9 MB/sec 1.00 40.3±0.24ms 10.1 MB/sec int32_ree/default 1.02 37.0±0.18ms 11.0 MB/sec 1.00 36.3±0.22ms 11.2 MB/sec int32_ree/parquet_2 1.02 37.1±0.28ms 11.0 MB/sec 1.00 36.2±0.22ms 11.2 MB/sec int32_ree/zstd 1.02 37.7±0.12ms 10.8 MB/sec 1.00 36.9±0.26ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.03 37.8±0.35ms 10.8 MB/sec 1.00 36.7±0.22ms 11.1 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.4±0.06ms 18.2 MB/sec 1.00 22.3±0.08ms 18.3 MB/sec int32_ree_95pct_null/cdc 1.00 24.1±0.11ms 16.9 MB/sec 1.01 24.4±0.09ms 16.7 MB/sec int32_ree_95pct_null/default 1.00 21.8±0.05ms 18.6 MB/sec 1.00 21.7±0.09ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.8±0.03ms 18.7 MB/sec 1.00 21.7±0.06ms 18.7 MB/sec int32_ree_95pct_null/zstd 1.01 22.1±0.04ms 18.4 MB/sec 1.00 22.0±0.05ms 18.5 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 22.0±0.04ms 18.5 MB/sec 1.00 21.9±0.06ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.00 62.9±0.54ms 4.0 GB/sec 1.32 82.9±3.28ms 3.0 GB/sec large_string_distinct/plain 1.00 59.5±0.58ms 4.2 GB/sec 1.12 66.5±1.85ms 3.8 GB/sec large_string_non_null/bloom_filter 1.00 76.9±0.61ms 3.3 GB/sec 1.09 83.8±2.54ms 3.0 GB/sec large_string_non_null/cdc 1.00 248.5±1.44ms 1030.0 MB/sec 1.03 256.1±2.39ms 999.6 MB/sec large_string_non_null/default 1.00 58.9±0.60ms 4.2 GB/sec 1.09 64.2±2.66ms 3.9 GB/sec large_string_non_null/parquet_2 1.00 58.4±0.71ms 4.3 GB/sec 1.10 64.3±2.53ms 3.9 GB/sec large_string_non_null/zstd 1.00 59.4±2.43ms 4.2 GB/sec 1.09 64.7±2.23ms 3.9 GB/sec large_string_non_null/zstd_parquet_2 1.00 59.1±0.62ms 4.2 GB/sec 1.09 64.7±2.42ms 3.9 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.1±0.18ms 4.6 GB/sec 2.25 122.0±2.75ms 2.0 GB/sec large_string_shared_prefix/plain 1.00 91.1±0.66ms 2.7 GB/sec 1.15 105.0±1.60ms 2.4 GB/sec list_nested/bloom_filter 1.00 145.9±0.18ms 197.8 MB/sec 1.01 146.6±0.24ms 196.8 MB/sec list_nested/cdc 1.00 161.9±0.27ms 178.3 MB/sec 1.01 163.5±0.89ms 176.5 MB/sec list_nested/default 1.00 130.9±0.15ms 220.4 MB/sec 1.00 130.8±0.30ms 220.6 MB/sec list_nested/parquet_2 1.00 144.0±0.20ms 200.4 MB/sec 1.00 144.5±0.26ms 199.7 MB/sec list_nested/zstd 1.00 140.2±0.33ms 205.8 MB/sec 1.00 140.2±0.38ms 205.8 MB/sec list_nested/zstd_parquet_2 1.00 156.8±0.15ms 184.0 MB/sec 1.00 156.4±0.50ms 184.5 MB/sec list_primitive/bloom_filter 1.00 303.6±4.45ms 1796.2 MB/sec 1.02 310.9±8.06ms 1754.1 MB/sec list_primitive/cdc 1.00 309.2±0.78ms 1763.9 MB/sec 1.03 319.4±6.54ms 1707.7 MB/sec list_primitive/default 1.00 208.0±2.71ms 2.6 GB/sec 1.09 227.2±7.55ms 2.3 GB/sec list_primitive/parquet_2 1.00 230.0±0.61ms 2.3 GB/sec 1.03 235.8±1.13ms 2.3 GB/sec list_primitive/zstd 1.00 463.1±4.32ms 1177.5 MB/sec 1.00 465.4±5.01ms 1171.9 MB/sec list_primitive/zstd_parquet_2 1.00 447.8±3.21ms 1217.9 MB/sec 1.02 455.8±1.32ms 1196.4 MB/sec list_primitive_non_null/bloom_filter 1.00 356.9±4.59ms 1524.8 MB/sec 1.12 399.0±16.09ms 1364.1 MB/sec list_primitive_non_null/cdc 1.03 404.0±18.88ms 1347.2 MB/sec 1.00 393.5±9.25ms 1383.0 MB/sec list_primitive_non_null/default 1.00 223.4±3.61ms 2.4 GB/sec 1.22 272.0±10.90ms 2000.9 MB/sec list_primitive_non_null/parquet_2 1.00 258.1±5.81ms 2.1 GB/sec 1.19 306.1±4.72ms 1777.9 MB/sec list_primitive_non_null/zstd 1.00 646.8±5.10ms 841.4 MB/sec 1.08 701.4±5.95ms 775.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 642.3±10.81ms 847.3 MB/sec 1.02 657.0±16.62ms 828.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.05 13.3±0.07ms 2.7 GB/sec 1.00 12.6±0.13ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.04 24.9±0.07ms 1500.9 MB/sec 1.00 23.9±0.09ms 1566.2 MB/sec list_primitive_sparse_99pct_null/default 1.05 12.9±0.06ms 2.8 GB/sec 1.00 12.3±0.04ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.05 12.9±0.06ms 2.8 GB/sec 1.00 12.3±0.03ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.04 14.7±0.08ms 2.5 GB/sec 1.00 14.1±0.06ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.05 13.1±0.07ms 2.8 GB/sec 1.00 12.5±0.13ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 280.4±0.92ms 162.6 MB/sec 1.02 286.5±0.85ms 159.2 MB/sec list_struct_with_list/cdc 1.00 318.5±0.39ms 143.2 MB/sec 1.01 322.1±0.91ms 141.6 MB/sec list_struct_with_list/default 1.00 253.8±0.79ms 179.6 MB/sec 1.01 256.1±1.05ms 178.0 MB/sec list_struct_with_list/parquet_2 1.00 271.2±0.79ms 168.1 MB/sec 1.01 273.2±0.80ms 166.9 MB/sec list_struct_with_list/zstd 1.00 275.7±0.78ms 165.4 MB/sec 1.01 278.9±0.80ms 163.5 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.4±0.83ms 154.9 MB/sec 1.00 295.0±1.09ms 154.5 MB/sec primitive/bloom_filter 1.00 153.4±1.54ms 292.6 MB/sec 1.02 156.5±2.53ms 286.8 MB/sec primitive/cdc 1.00 159.8±0.77ms 280.9 MB/sec 1.00 160.1±2.04ms 280.3 MB/sec primitive/default 1.01 117.0±0.59ms 383.5 MB/sec 1.00 116.4±1.52ms 385.7 MB/sec primitive/parquet_2 1.01 132.7±0.39ms 338.3 MB/sec 1.00 131.5±1.21ms 341.4 MB/sec primitive/zstd 1.00 148.2±0.65ms 302.7 MB/sec 1.00 147.8±1.25ms 303.6 MB/sec primitive/zstd_parquet_2 1.00 165.6±0.45ms 270.9 MB/sec 1.00 165.3±1.30ms 271.5 MB/sec primitive_all_null/bloom_filter 1.02 915.0±7.58µs 47.9 GB/sec 1.00 895.3±8.63µs 48.9 GB/sec primitive_all_null/cdc 1.00 18.5±0.42ms 2.4 GB/sec 1.03 19.1±0.23ms 2.3 GB/sec primitive_all_null/default 1.00 275.1±1.18µs 159.3 GB/sec 1.00 274.0±1.44µs 159.9 GB/sec primitive_all_null/parquet_2 1.00 282.9±1.30µs 154.9 GB/sec 1.00 282.8±1.39µs 155.0 GB/sec primitive_all_null/zstd 1.02 428.9±1.83µs 102.2 GB/sec 1.00 422.4±1.54µs 103.8 GB/sec primitive_all_null/zstd_parquet_2 1.01 385.0±1.31µs 113.8 GB/sec 1.00 382.8±1.64µs 114.5 GB/sec primitive_non_null/bloom_filter 1.00 106.1±1.28ms 414.6 MB/sec 1.05 111.3±2.81ms 395.4 MB/sec primitive_non_null/cdc 1.00 87.6±0.51ms 502.5 MB/sec 1.03 90.0±1.65ms 488.9 MB/sec primitive_non_null/default 1.00 64.0±0.65ms 687.4 MB/sec 1.00 63.8±1.57ms 689.2 MB/sec primitive_non_null/parquet_2 1.02 87.0±0.40ms 506.0 MB/sec 1.00 85.5±1.22ms 514.8 MB/sec primitive_non_null/zstd 1.00 96.5±0.35ms 455.9 MB/sec 1.02 98.8±2.08ms 445.5 MB/sec primitive_non_null/zstd_parquet_2 1.00 120.0±0.98ms 366.7 MB/sec 1.02 122.6±1.78ms 358.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.12 13.4±0.11ms 3.3 GB/sec 1.00 12.0±0.07ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.02 30.5±0.28ms 1471.1 MB/sec 1.00 30.0±0.36ms 1496.3 MB/sec primitive_sparse_99pct_null/default 1.06 11.2±0.03ms 3.9 GB/sec 1.00 10.6±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.07 11.3±0.06ms 3.9 GB/sec 1.00 10.6±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.06 14.8±0.07ms 3.0 GB/sec 1.00 13.9±0.08ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.07 13.4±0.04ms 3.3 GB/sec 1.00 12.5±0.07ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 28.1±0.07ms 427.2 MB/sec 1.08 30.3±0.58ms 396.5 MB/sec short_string_non_null/cdc 1.00 20.3±0.04ms 590.8 MB/sec 1.03 20.9±0.34ms 573.4 MB/sec short_string_non_null/default 1.00 16.1±0.04ms 744.1 MB/sec 1.04 16.8±0.32ms 715.6 MB/sec short_string_non_null/parquet_2 1.00 26.2±0.25ms 457.6 MB/sec 1.02 26.8±0.36ms 447.3 MB/sec short_string_non_null/zstd 1.00 36.2±0.05ms 331.3 MB/sec 1.03 37.2±0.37ms 323.0 MB/sec short_string_non_null/zstd_parquet_2 1.00 29.1±0.06ms 411.8 MB/sec 1.03 29.9±0.27ms 400.8 MB/sec small_string_distinct/delta_byte_array 1.00 961.8±7.38µs 8.2 GB/sec 1.13 1090.0±75.72µs 7.2 GB/sec small_string_distinct/plain 1.00 735.6±3.08µs 10.7 GB/sec 1.10 812.7±11.93µs 9.7 GB/sec small_string_partial_prefix/delta_byte_array 1.00 983.8±3.90µs 8.0 GB/sec 1.19 1175.2±25.30µs 6.7 GB/sec small_string_partial_prefix/plain 1.00 979.2±3.86µs 8.0 GB/sec 1.16 1131.4±22.27µs 6.9 GB/sec small_string_shared_prefix/delta_byte_array 1.00 980.3±1.85µs 8.0 GB/sec 1.07 1051.7±3.74µs 7.5 GB/sec small_string_shared_prefix/plain 1.00 1100.5±11.27µs 7.1 GB/sec 1.07 1173.0±9.31µs 6.7 GB/sec string/bloom_filter 1.00 240.7±26.79ms 2.1 GB/sec 1.26 302.3±30.05ms 1734.2 MB/sec string/cdc 1.00 214.7±5.76ms 2.4 GB/sec 1.07 228.9±11.68ms 2.2 GB/sec string/default 1.00 119.7±15.36ms 4.3 GB/sec 1.24 148.6±23.16ms 3.4 GB/sec string/parquet_2 1.00 105.7±7.23ms 4.8 GB/sec 1.18 124.6±2.46ms 4.1 GB/sec string/zstd 1.00 441.6±9.63ms 1187.2 MB/sec 1.16 511.1±17.17ms 1025.7 MB/sec string/zstd_parquet_2 1.00 386.9±1.35ms 1354.9 MB/sec 1.23 475.0±5.36ms 1103.6 MB/sec string_and_binary_view/bloom_filter 1.00 68.0±0.76ms 474.1 MB/sec 1.18 80.3±2.87ms 401.8 MB/sec string_and_binary_view/cdc 1.00 62.1±0.49ms 519.5 MB/sec 1.09 67.5±2.22ms 477.8 MB/sec string_and_binary_view/default 1.00 49.4±0.42ms 653.5 MB/sec 1.15 56.6±2.15ms 569.6 MB/sec string_and_binary_view/parquet_2 1.00 61.7±1.66ms 522.6 MB/sec 1.09 67.5±2.41ms 477.6 MB/sec string_and_binary_view/zstd 1.00 88.6±0.39ms 363.9 MB/sec 1.07 94.5±1.67ms 341.2 MB/sec string_and_binary_view/zstd_parquet_2 1.00 76.4±0.38ms 422.2 MB/sec 1.07 82.1±1.46ms 392.9 MB/sec string_dictionary/bloom_filter 1.00 94.9±1.83ms 2.7 GB/sec 1.83 174.0±7.63ms 1517.9 MB/sec string_dictionary/cdc 1.00 54.1±1.62ms 4.8 GB/sec 1.05 56.9±2.17ms 4.5 GB/sec string_dictionary/default 1.00 49.4±5.01ms 5.2 GB/sec 1.58 78.2±5.61ms 3.3 GB/sec string_dictionary/parquet_2 1.00 50.1±0.60ms 5.1 GB/sec 1.78 89.1±3.13ms 2.9 GB/sec string_dictionary/zstd 1.00 214.0±2.65ms 1234.2 MB/sec 1.22 261.6±6.04ms 1009.8 MB/sec string_dictionary/zstd_parquet_2 1.00 195.3±0.54ms 1352.6 MB/sec 1.06 206.9±6.89ms 1276.4 MB/sec string_non_null/bloom_filter 1.00 265.2±22.49ms 1976.2 MB/sec 1.31 347.7±34.07ms 1507.2 MB/sec string_non_null/cdc 1.07 275.0±11.14ms 1905.5 MB/sec 1.00 256.4±2.90ms 2043.6 MB/sec string_non_null/default 1.00 132.1±14.22ms 3.9 GB/sec 1.20 158.5±30.25ms 3.2 GB/sec string_non_null/parquet_2 1.00 122.2±6.25ms 4.2 GB/sec 1.05 127.8±6.46ms 4.0 GB/sec string_non_null/zstd 1.00 587.0±3.64ms 892.7 MB/sec 1.05 618.1±17.00ms 847.8 MB/sec string_non_null/zstd_parquet_2 1.00 500.4±4.67ms 1047.1 MB/sec 1.07 533.9±8.94ms 981.4 MB/sec string_ree/bloom_filter 1.38 167.3±1.43ms 98.1 MB/sec 1.00 121.6±3.81ms 135.0 MB/sec string_ree/cdc 1.00 224.7±2.23ms 73.0 MB/sec 1.06 238.1±2.68ms 68.9 MB/sec string_ree/default 1.48 133.5±1.75ms 122.9 MB/sec 1.00 90.0±2.38ms 182.3 MB/sec string_ree/parquet_2 1.05 133.5±1.71ms 122.9 MB/sec 1.00 127.5±20.89ms 128.7 MB/sec string_ree/zstd 1.00 201.0±8.62ms 81.6 MB/sec 1.04 209.1±4.15ms 78.5 MB/sec string_ree/zstd_parquet_2 1.00 144.7±1.12ms 113.4 MB/sec 1.05 152.3±2.63ms 107.7 MB/sec string_ree_95pct_null/bloom_filter 1.00 27.2±0.26ms 51.7 MB/sec 1.00 27.2±0.18ms 51.7 MB/sec string_ree_95pct_null/cdc 1.00 33.4±0.07ms 42.2 MB/sec 1.01 33.6±0.15ms 41.9 MB/sec string_ree_95pct_null/default 1.00 25.6±0.10ms 55.1 MB/sec 1.00 25.5±0.20ms 55.2 MB/sec string_ree_95pct_null/parquet_2 1.00 25.5±0.08ms 55.2 MB/sec 1.00 25.5±0.15ms 55.3 MB/sec string_ree_95pct_null/zstd 1.01 26.4±0.07ms 53.2 MB/sec 1.00 26.3±0.19ms 53.5 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 26.3±0.07ms 53.4 MB/sec 1.00 26.2±0.14ms 53.7 MB/sec struct_all_null/bloom_filter 1.00 378.8±1.17µs 41.6 GB/sec 1.01 382.3±1.70µs 41.2 GB/sec struct_all_null/cdc 1.00 7.3±0.11ms 2.2 GB/sec 1.07 7.8±0.13ms 2.0 GB/sec struct_all_null/default 1.01 118.7±0.54µs 132.7 GB/sec 1.00 117.6±0.62µs 133.9 GB/sec struct_all_null/parquet_2 1.00 121.7±0.60µs 129.4 GB/sec 1.00 122.1±0.59µs 128.9 GB/sec struct_all_null/zstd 1.00 183.4±0.44µs 85.9 GB/sec 1.00 182.9±0.70µs 86.1 GB/sec struct_all_null/zstd_parquet_2 1.00 165.8±0.58µs 95.0 GB/sec 1.00 165.3±0.71µs 95.3 GB/sec struct_non_null/bloom_filter 1.03 45.4±0.32ms 352.6 MB/sec 1.00 44.1±0.97ms 362.9 MB/sec struct_non_null/cdc 1.03 43.5±0.12ms 367.6 MB/sec 1.00 42.1±0.26ms 380.2 MB/sec struct_non_null/default 1.09 30.3±0.27ms 527.6 MB/sec 1.00 27.9±0.20ms 573.2 MB/sec struct_non_null/parquet_2 1.04 38.9±0.10ms 411.5 MB/sec 1.00 37.2±0.16ms 429.7 MB/sec struct_non_null/zstd 1.03 38.9±0.12ms 411.3 MB/sec 1.00 37.7±0.23ms 424.0 MB/sec struct_non_null/zstd_parquet_2 1.00 52.7±0.12ms 303.7 MB/sec 1.01 53.4±2.27ms 299.7 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.9±0.04ms 2.3 GB/sec 1.06 7.3±0.04ms 2.2 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.10ms 1173.8 MB/sec 1.06 14.6±0.08ms 1105.1 MB/sec struct_sparse_99pct_null/default 1.00 6.1±0.04ms 2.6 GB/sec 1.04 6.3±0.11ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.2±0.03ms 2.5 GB/sec 1.03 6.4±0.02ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.6±0.05ms 2.1 GB/sec 1.02 7.7±0.09ms 2.0 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.0±0.04ms 2.3 GB/sec 1.02 7.2±0.03ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3125.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.5 GiB | | CPU user | 2993.4s | | CPU sys | 129.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3035.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2959.8s | | CPU sys | 73.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
