adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5188513281
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187770717) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.07ms 19.8 MB/sec 1.00 12.7±0.08ms 19.8 MB/sec bool/cdc 1.01 15.6±0.07ms 16.1 MB/sec 1.00 15.4±0.09ms 16.3 MB/sec bool/default 1.00 10.6±0.07ms 23.7 MB/sec 1.00 10.6±0.06ms 23.7 MB/sec bool/parquet_2 1.00 14.3±0.08ms 17.4 MB/sec 1.00 14.4±0.09ms 17.4 MB/sec bool/zstd 1.00 11.1±0.06ms 22.6 MB/sec 1.00 11.1±0.06ms 22.5 MB/sec bool/zstd_parquet_2 1.00 14.7±0.05ms 17.0 MB/sec 1.00 14.7±0.07ms 17.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.2 MB/sec 1.02 6.6±0.03ms 18.9 MB/sec bool_non_null/cdc 1.00 6.3±0.03ms 20.0 MB/sec 1.01 6.4±0.03ms 19.7 MB/sec bool_non_null/default 1.00 3.7±0.03ms 33.4 MB/sec 1.03 3.9±0.02ms 32.4 MB/sec bool_non_null/parquet_2 1.00 8.5±0.04ms 14.7 MB/sec 1.02 8.6±0.04ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.03ms 30.5 MB/sec 1.03 4.2±0.03ms 29.8 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.04ms 14.0 MB/sec 1.01 9.0±0.04ms 13.8 MB/sec bool_ree/bloom_filter 1.00 30.1±0.12ms 7.1 MB/sec 1.00 30.2±0.12ms 7.0 MB/sec bool_ree/cdc 1.01 31.6±0.11ms 6.7 MB/sec 1.00 31.4±0.12ms 6.8 MB/sec bool_ree/default 1.00 27.4±0.13ms 7.8 MB/sec 1.00 27.5±0.11ms 7.8 MB/sec bool_ree/parquet_2 1.00 29.0±0.11ms 7.3 MB/sec 1.00 29.1±0.12ms 7.3 MB/sec bool_ree/zstd 1.00 28.1±0.17ms 7.6 MB/sec 1.00 28.1±0.12ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.3±0.12ms 7.3 MB/sec 1.00 29.3±0.11ms 7.3 MB/sec decimal/bloom_filter 1.02 123.2±0.44ms 486.8 MB/sec 1.00 121.2±1.74ms 495.1 MB/sec decimal/cdc 1.01 102.1±0.39ms 587.8 MB/sec 1.00 101.3±0.51ms 592.1 MB/sec decimal/default 1.00 79.4±0.36ms 755.8 MB/sec 1.00 79.1±0.44ms 758.1 MB/sec decimal/parquet_2 1.01 179.5±0.57ms 334.2 MB/sec 1.00 178.3±2.53ms 336.5 MB/sec decimal/zstd 1.01 90.7±0.43ms 661.3 MB/sec 1.00 89.8±0.45ms 668.4 MB/sec decimal/zstd_parquet_2 1.01 200.0±1.13ms 300.0 MB/sec 1.00 197.5±2.45ms 303.8 MB/sec fixed_size_binary_ree/bloom_filter 1.01 59.5±0.22ms 16.9 MB/sec 1.00 59.0±0.32ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.01 62.2±0.25ms 16.2 MB/sec 1.00 61.8±0.26ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 52.3±0.20ms 19.3 MB/sec 1.00 52.1±1.03ms 19.3 MB/sec fixed_size_binary_ree/parquet_2 1.02 67.7±0.35ms 14.9 MB/sec 1.00 66.6±0.35ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.01 58.3±0.25ms 17.3 MB/sec 1.00 57.8±0.25ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.02 68.3±0.40ms 14.8 MB/sec 1.00 67.2±0.28ms 15.0 MB/sec float_with_nans/bloom_filter 1.02 82.0±0.29ms 170.8 MB/sec 1.00 80.6±0.34ms 173.6 MB/sec float_with_nans/cdc 1.01 70.9±0.52ms 197.6 MB/sec 1.00 70.1±0.18ms 199.6 MB/sec float_with_nans/default 1.01 63.3±0.23ms 221.2 MB/sec 1.00 62.9±0.26ms 222.6 MB/sec float_with_nans/parquet_2 1.01 81.1±0.28ms 172.7 MB/sec 1.00 80.4±1.11ms 174.2 MB/sec float_with_nans/zstd 1.00 101.6±0.25ms 137.8 MB/sec 1.00 101.6±0.40ms 137.8 MB/sec float_with_nans/zstd_parquet_2 1.01 117.9±0.27ms 118.7 MB/sec 1.00 117.1±0.36ms 119.5 MB/sec fsb/bloom_filter 1.02 8.2±0.05ms 1969.5 MB/sec 1.00 8.1±0.06ms 2002.9 MB/sec fsb/cdc 1.00 10.4±0.06ms 1543.9 MB/sec 1.00 10.4±0.04ms 1545.2 MB/sec fsb/default 1.01 7.0±0.04ms 2.2 GB/sec 1.00 7.0±0.04ms 2.3 GB/sec fsb/parquet_2 1.02 13.7±0.07ms 1178.3 MB/sec 1.00 13.4±0.10ms 1205.6 MB/sec fsb/zstd 1.01 9.5±0.06ms 1702.1 MB/sec 1.00 9.4±0.06ms 1722.2 MB/sec fsb/zstd_parquet_2 1.02 14.6±0.09ms 1107.9 MB/sec 1.00 14.3±0.07ms 1130.3 MB/sec int32_ree/bloom_filter 1.00 40.4±0.20ms 10.1 MB/sec 1.01 40.9±0.38ms 9.9 MB/sec int32_ree/cdc 1.00 40.3±0.13ms 10.1 MB/sec 1.01 40.6±0.17ms 10.0 MB/sec int32_ree/default 1.00 36.6±0.15ms 11.1 MB/sec 1.00 36.6±0.41ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.6±0.13ms 11.1 MB/sec 1.00 36.6±0.17ms 11.1 MB/sec int32_ree/zstd 1.00 37.2±0.16ms 10.9 MB/sec 1.00 37.1±0.11ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 37.0±0.12ms 11.0 MB/sec 1.00 37.1±0.17ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.0±0.06ms 18.5 MB/sec 1.00 21.8±0.06ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.00 23.8±0.07ms 17.1 MB/sec 1.01 24.1±0.10ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.03ms 18.9 MB/sec 1.00 21.5±0.04ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.6±0.04ms 18.8 MB/sec 1.00 21.5±0.04ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.04ms 18.6 MB/sec 1.00 21.8±0.04ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.7 MB/sec 1.00 21.7±0.04ms 18.8 MB/sec large_string_distinct/delta_byte_array 1.02 66.4±0.70ms 3.8 GB/sec 1.00 65.3±0.46ms 3.8 GB/sec large_string_distinct/plain 1.02 61.8±1.15ms 4.0 GB/sec 1.00 60.4±0.63ms 4.1 GB/sec large_string_non_null/bloom_filter 1.00 73.7±0.13ms 3.4 GB/sec 1.01 74.5±0.48ms 3.4 GB/sec large_string_non_null/cdc 1.01 246.2±1.08ms 1039.9 MB/sec 1.00 244.5±1.05ms 1047.0 MB/sec large_string_non_null/default 1.00 55.9±0.12ms 4.5 GB/sec 1.00 55.9±0.57ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.8±0.13ms 4.5 GB/sec 1.00 56.1±0.59ms 4.5 GB/sec large_string_non_null/zstd 1.00 55.9±0.14ms 4.5 GB/sec 1.00 55.9±0.59ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.8±0.13ms 4.5 GB/sec 1.00 55.9±0.68ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 57.2±0.31ms 4.4 GB/sec 1.00 57.0±0.34ms 4.4 GB/sec large_string_shared_prefix/plain 1.01 95.5±0.71ms 2.6 GB/sec 1.00 94.1±0.98ms 2.7 GB/sec list_nested/bloom_filter 1.02 147.0±0.36ms 196.2 MB/sec 1.00 144.4±0.24ms 199.8 MB/sec list_nested/cdc 1.00 162.7±0.17ms 177.4 MB/sec 1.00 162.1±0.20ms 178.0 MB/sec list_nested/default 1.01 131.7±0.17ms 219.2 MB/sec 1.00 130.6±0.20ms 220.9 MB/sec list_nested/parquet_2 1.01 144.7±0.19ms 199.4 MB/sec 1.00 143.7±0.19ms 200.7 MB/sec list_nested/zstd 1.01 140.8±0.20ms 205.0 MB/sec 1.00 139.9±0.18ms 206.3 MB/sec list_nested/zstd_parquet_2 1.01 157.5±0.21ms 183.2 MB/sec 1.00 156.6±0.22ms 184.2 MB/sec list_primitive/bloom_filter 1.01 282.4±0.99ms 1931.2 MB/sec 1.00 279.2±2.04ms 1953.2 MB/sec list_primitive/cdc 1.01 310.9±1.34ms 1754.3 MB/sec 1.00 308.5±0.59ms 1767.6 MB/sec list_primitive/default 1.01 199.9±1.45ms 2.7 GB/sec 1.00 198.4±1.05ms 2.7 GB/sec list_primitive/parquet_2 1.01 225.8±0.43ms 2.4 GB/sec 1.00 224.2±0.29ms 2.4 GB/sec list_primitive/zstd 1.00 454.9±1.90ms 1198.8 MB/sec 1.00 453.3±1.10ms 1203.1 MB/sec list_primitive/zstd_parquet_2 1.00 449.0±0.93ms 1214.5 MB/sec 1.00 447.4±1.13ms 1219.0 MB/sec list_primitive_non_null/bloom_filter 1.00 379.7±7.18ms 1433.3 MB/sec 1.01 381.9±5.53ms 1425.1 MB/sec list_primitive_non_null/cdc 1.00 389.3±7.65ms 1398.0 MB/sec 1.01 393.7±10.06ms 1382.4 MB/sec list_primitive_non_null/default 1.00 241.4±4.79ms 2.2 GB/sec 1.01 244.9±10.11ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.01 268.5±10.24ms 2026.6 MB/sec 1.00 265.2±14.02ms 2.0 GB/sec list_primitive_non_null/zstd 1.00 663.5±3.18ms 820.2 MB/sec 1.00 664.7±11.16ms 818.8 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 648.3±11.90ms 839.5 MB/sec 1.01 653.8±11.09ms 832.5 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.01 12.8±0.08ms 2.9 GB/sec 1.00 12.7±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.4±0.12ms 1528.9 MB/sec 1.00 24.1±0.14ms 1550.1 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.4±0.06ms 2.9 GB/sec 1.00 12.4±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.5±0.05ms 2.9 GB/sec 1.00 12.4±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.3±0.07ms 2.6 GB/sec 1.01 14.4±0.08ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.06ms 2.9 GB/sec 1.00 12.7±0.07ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 284.1±1.09ms 160.5 MB/sec 1.00 282.2±1.01ms 161.6 MB/sec list_struct_with_list/cdc 1.00 320.0±0.43ms 142.5 MB/sec 1.00 319.3±0.37ms 142.8 MB/sec list_struct_with_list/default 1.00 254.6±0.42ms 179.1 MB/sec 1.00 253.6±0.47ms 179.8 MB/sec list_struct_with_list/parquet_2 1.00 272.1±0.43ms 167.6 MB/sec 1.00 270.9±0.42ms 168.3 MB/sec list_struct_with_list/zstd 1.00 276.5±0.37ms 164.9 MB/sec 1.00 275.6±0.41ms 165.5 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.6±0.68ms 154.2 MB/sec 1.00 294.4±0.82ms 154.9 MB/sec primitive/bloom_filter 1.00 149.1±0.62ms 301.1 MB/sec 1.00 149.7±0.70ms 299.8 MB/sec primitive/cdc 1.00 156.4±0.95ms 286.9 MB/sec 1.00 155.7±0.76ms 288.3 MB/sec primitive/default 1.00 114.8±0.55ms 390.9 MB/sec 1.00 115.0±0.60ms 390.3 MB/sec primitive/parquet_2 1.01 130.3±0.65ms 344.3 MB/sec 1.00 129.7±0.50ms 346.1 MB/sec primitive/zstd 1.00 144.6±0.52ms 310.3 MB/sec 1.00 144.4±0.52ms 310.8 MB/sec primitive/zstd_parquet_2 1.00 162.8±0.52ms 275.7 MB/sec 1.00 162.4±0.56ms 276.4 MB/sec primitive_all_null/bloom_filter 1.01 907.9±4.10µs 48.3 GB/sec 1.00 895.0±4.68µs 49.0 GB/sec primitive_all_null/cdc 1.00 18.4±0.27ms 2.4 GB/sec 1.05 19.2±0.29ms 2.3 GB/sec primitive_all_null/default 1.01 275.3±1.78µs 159.2 GB/sec 1.00 272.0±1.26µs 161.1 GB/sec primitive_all_null/parquet_2 1.01 284.1±1.55µs 154.3 GB/sec 1.00 281.9±1.36µs 155.4 GB/sec primitive_all_null/zstd 1.00 423.8±1.56µs 103.4 GB/sec 1.00 421.9±1.72µs 103.9 GB/sec primitive_all_null/zstd_parquet_2 1.02 388.1±1.55µs 112.9 GB/sec 1.00 379.6±1.48µs 115.4 GB/sec primitive_non_null/bloom_filter 1.01 105.4±0.61ms 417.5 MB/sec 1.00 104.7±0.41ms 420.3 MB/sec primitive_non_null/cdc 1.01 86.2±0.33ms 510.5 MB/sec 1.00 85.5±0.32ms 514.6 MB/sec primitive_non_null/default 1.02 63.7±0.33ms 691.2 MB/sec 1.00 62.6±0.23ms 703.1 MB/sec primitive_non_null/parquet_2 1.00 84.9±0.23ms 518.5 MB/sec 1.00 84.5±0.30ms 520.7 MB/sec primitive_non_null/zstd 1.01 93.8±0.29ms 468.9 MB/sec 1.00 93.3±0.27ms 471.5 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.7±0.26ms 373.7 MB/sec 1.00 117.3±0.27ms 375.3 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 12.4±0.11ms 3.5 GB/sec 1.00 12.3±0.11ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.7±0.36ms 1508.6 MB/sec 1.04 30.8±0.39ms 1456.3 MB/sec primitive_sparse_99pct_null/default 1.00 10.8±0.05ms 4.0 GB/sec 1.00 10.9±0.05ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.9±0.04ms 4.0 GB/sec 1.00 10.9±0.06ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.3±0.07ms 3.1 GB/sec 1.00 14.3±0.22ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.07ms 3.4 GB/sec 1.00 12.8±0.06ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 28.2±0.09ms 425.7 MB/sec 1.01 28.6±0.07ms 420.2 MB/sec short_string_non_null/cdc 1.01 19.9±0.07ms 603.3 MB/sec 1.00 19.8±0.06ms 607.1 MB/sec short_string_non_null/default 1.01 15.8±0.08ms 761.4 MB/sec 1.00 15.6±0.05ms 767.8 MB/sec short_string_non_null/parquet_2 1.01 26.0±0.11ms 462.3 MB/sec 1.00 25.8±0.05ms 464.7 MB/sec short_string_non_null/zstd 1.00 36.1±0.07ms 332.8 MB/sec 1.00 35.9±0.11ms 334.3 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.9±0.06ms 415.5 MB/sec 1.00 28.8±0.08ms 417.2 MB/sec small_string_distinct/delta_byte_array 1.00 970.7±6.77µs 8.1 GB/sec 1.02 987.3±9.71µs 7.9 GB/sec small_string_distinct/plain 1.00 718.1±9.65µs 10.9 GB/sec 1.07 766.8±5.54µs 10.2 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1017.0±4.57µs 7.7 GB/sec 1.00 1016.3±6.87µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 1036.0±4.07µs 7.6 GB/sec 1.00 1033.1±6.01µs 7.6 GB/sec small_string_shared_prefix/delta_byte_array 1.00 986.7±1.87µs 7.9 GB/sec 1.00 991.0±2.46µs 7.9 GB/sec small_string_shared_prefix/plain 1.01 1136.5±7.06µs 6.9 GB/sec 1.00 1129.1±8.38µs 6.9 GB/sec string/bloom_filter 1.00 218.6±24.74ms 2.3 GB/sec 1.04 228.0±27.16ms 2.2 GB/sec string/cdc 1.00 210.1±6.99ms 2.4 GB/sec 1.00 209.7±11.85ms 2.4 GB/sec string/default 1.00 113.3±15.19ms 4.5 GB/sec 1.05 118.5±18.90ms 4.3 GB/sec string/parquet_2 1.01 103.6±7.03ms 4.9 GB/sec 1.00 102.6±8.91ms 5.0 GB/sec string/zstd 1.00 417.6±1.01ms 1255.5 MB/sec 1.00 418.0±1.61ms 1254.3 MB/sec string/zstd_parquet_2 1.00 385.0±0.28ms 1361.7 MB/sec 1.02 392.6±9.73ms 1335.3 MB/sec string_and_binary_view/bloom_filter 1.02 66.4±0.28ms 485.4 MB/sec 1.00 65.5±0.28ms 492.7 MB/sec string_and_binary_view/cdc 1.01 59.9±0.20ms 538.5 MB/sec 1.00 59.4±0.19ms 542.9 MB/sec string_and_binary_view/default 1.00 48.9±0.17ms 659.9 MB/sec 1.00 48.7±0.17ms 661.6 MB/sec string_and_binary_view/parquet_2 1.00 60.2±0.19ms 536.1 MB/sec 1.00 60.0±0.19ms 537.2 MB/sec string_and_binary_view/zstd 1.01 86.5±0.29ms 372.9 MB/sec 1.00 85.8±0.19ms 376.0 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.1±0.22ms 435.1 MB/sec 1.00 73.9±0.23ms 436.2 MB/sec string_dictionary/bloom_filter 1.01 88.3±1.03ms 2.9 GB/sec 1.00 87.2±0.33ms 3.0 GB/sec string_dictionary/cdc 1.01 49.0±0.64ms 5.3 GB/sec 1.00 48.6±0.49ms 5.3 GB/sec string_dictionary/default 1.00 43.5±0.83ms 5.9 GB/sec 1.02 44.3±0.29ms 5.8 GB/sec string_dictionary/parquet_2 1.01 49.6±0.15ms 5.2 GB/sec 1.00 49.4±0.17ms 5.2 GB/sec string_dictionary/zstd 1.00 208.3±1.83ms 1267.8 MB/sec 1.00 208.6±0.45ms 1266.3 MB/sec string_dictionary/zstd_parquet_2 1.01 193.4±0.21ms 1365.5 MB/sec 1.00 192.3±0.17ms 1373.9 MB/sec string_non_null/bloom_filter 1.04 250.0±19.57ms 2.0 GB/sec 1.00 240.2±15.09ms 2.1 GB/sec string_non_null/cdc 1.00 252.1±2.18ms 2.0 GB/sec 1.01 254.7±3.58ms 2.0 GB/sec string_non_null/default 1.00 119.3±18.93ms 4.3 GB/sec 1.00 119.2±12.92ms 4.3 GB/sec string_non_null/parquet_2 1.00 109.3±0.26ms 4.7 GB/sec 1.19 130.5±7.89ms 3.9 GB/sec string_non_null/zstd 1.00 534.4±1.37ms 980.6 MB/sec 1.05 563.2±8.65ms 930.4 MB/sec string_non_null/zstd_parquet_2 1.00 495.3±5.78ms 1057.9 MB/sec 1.02 506.9±8.92ms 1033.7 MB/sec string_ree/bloom_filter 1.00 153.0±4.06ms 107.2 MB/sec 1.07 164.2±5.98ms 99.9 MB/sec string_ree/cdc 1.16 222.8±2.44ms 73.6 MB/sec 1.00 192.0±4.08ms 85.5 MB/sec string_ree/default 1.00 125.5±4.03ms 130.7 MB/sec 1.06 133.5±4.35ms 122.9 MB/sec string_ree/parquet_2 1.00 133.0±3.96ms 123.3 MB/sec 1.03 137.6±5.79ms 119.2 MB/sec string_ree/zstd 1.00 186.8±3.74ms 87.8 MB/sec 1.05 195.9±5.96ms 83.8 MB/sec string_ree/zstd_parquet_2 1.57 148.4±3.92ms 110.6 MB/sec 1.00 94.5±0.32ms 173.6 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.5±0.16ms 53.1 MB/sec 1.00 26.4±0.13ms 53.4 MB/sec string_ree_95pct_null/cdc 1.00 32.4±0.11ms 43.4 MB/sec 1.01 32.8±0.08ms 42.9 MB/sec string_ree_95pct_null/default 1.01 25.0±0.07ms 56.2 MB/sec 1.00 24.8±0.09ms 56.7 MB/sec string_ree_95pct_null/parquet_2 1.00 24.9±0.09ms 56.5 MB/sec 1.00 24.8±0.08ms 56.7 MB/sec string_ree_95pct_null/zstd 1.00 25.7±0.12ms 54.6 MB/sec 1.00 25.7±0.08ms 54.8 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.7±0.12ms 54.8 MB/sec 1.00 25.7±0.07ms 54.8 MB/sec struct_all_null/bloom_filter 1.01 380.1±2.48µs 41.4 GB/sec 1.00 376.4±2.31µs 41.8 GB/sec struct_all_null/cdc 1.00 7.3±0.06ms 2.2 GB/sec 1.08 7.9±0.09ms 2047.3 MB/sec struct_all_null/default 1.01 118.2±0.63µs 133.3 GB/sec 1.00 117.0±0.48µs 134.6 GB/sec struct_all_null/parquet_2 1.01 122.0±0.70µs 129.0 GB/sec 1.00 120.9±0.54µs 130.3 GB/sec struct_all_null/zstd 1.01 182.5±0.61µs 86.3 GB/sec 1.00 179.8±0.90µs 87.6 GB/sec struct_all_null/zstd_parquet_2 1.01 165.5±0.56µs 95.2 GB/sec 1.00 163.9±0.77µs 96.1 GB/sec struct_non_null/bloom_filter 1.02 45.2±0.19ms 353.6 MB/sec 1.00 44.2±0.19ms 362.3 MB/sec struct_non_null/cdc 1.00 43.4±0.13ms 368.6 MB/sec 1.00 43.2±0.15ms 370.4 MB/sec struct_non_null/default 1.01 30.1±0.10ms 531.5 MB/sec 1.00 29.7±0.10ms 538.6 MB/sec struct_non_null/parquet_2 1.01 38.7±0.10ms 413.2 MB/sec 1.00 38.4±0.09ms 416.6 MB/sec struct_non_null/zstd 1.01 38.7±0.10ms 413.0 MB/sec 1.00 38.4±0.10ms 416.7 MB/sec struct_non_null/zstd_parquet_2 1.01 52.5±0.11ms 304.7 MB/sec 1.00 52.1±0.12ms 307.2 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.04ms 2.4 GB/sec 1.00 6.6±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.4±0.12ms 1203.1 MB/sec 1.05 14.0±0.11ms 1149.4 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.02ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.02ms 2.1 GB/sec 1.00 7.4±0.03ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.02ms 2.3 GB/sec 1.00 6.8±0.03ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3010.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 2926.3s | | CPU sys | 81.1s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3015.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2929.0s | | CPU sys | 80.6s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
