adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5189177475
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5188253164) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to main [diff](https://github.com/apache/arrow-rs/compare/291efc247b9639c0bf87d2621f679b6cce4942bf..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "main" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.6±0.05ms 19.9 MB/sec 1.01 12.7±0.06ms 19.7 MB/sec bool/cdc 1.01 15.5±0.05ms 16.1 MB/sec 1.00 15.3±0.06ms 16.4 MB/sec bool/default 1.00 10.5±0.04ms 23.9 MB/sec 1.01 10.6±0.04ms 23.6 MB/sec bool/parquet_2 1.06 14.3±0.05ms 17.5 MB/sec 1.00 13.5±0.06ms 18.5 MB/sec bool/zstd 1.00 11.0±0.05ms 22.6 MB/sec 1.01 11.1±0.04ms 22.5 MB/sec bool/zstd_parquet_2 1.05 14.6±0.05ms 17.1 MB/sec 1.00 13.9±0.06ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.2 MB/sec 1.03 6.7±0.02ms 18.7 MB/sec bool_non_null/cdc 1.00 6.3±0.05ms 20.0 MB/sec 1.02 6.4±0.03ms 19.5 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.4 MB/sec 1.05 3.9±0.02ms 31.9 MB/sec bool_non_null/parquet_2 1.10 8.5±0.03ms 14.7 MB/sec 1.00 7.7±0.02ms 16.3 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.5 MB/sec 1.04 4.3±0.02ms 29.3 MB/sec bool_non_null/zstd_parquet_2 1.10 8.9±0.03ms 14.0 MB/sec 1.00 8.1±0.02ms 15.4 MB/sec bool_ree/bloom_filter 1.00 30.0±0.07ms 7.1 MB/sec 1.01 30.2±0.10ms 7.0 MB/sec bool_ree/cdc 1.00 31.6±0.08ms 6.7 MB/sec 1.00 31.4±0.11ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.08ms 7.8 MB/sec 1.01 27.5±0.11ms 7.7 MB/sec bool_ree/parquet_2 1.00 28.9±0.10ms 7.4 MB/sec 1.00 29.0±0.10ms 7.3 MB/sec bool_ree/zstd 1.00 28.0±0.11ms 7.6 MB/sec 1.01 28.1±0.10ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.09ms 7.3 MB/sec 1.00 29.3±0.10ms 7.3 MB/sec decimal/bloom_filter 1.27 148.2±0.48ms 404.7 MB/sec 1.00 116.6±1.13ms 514.4 MB/sec decimal/cdc 1.01 101.2±0.37ms 592.7 MB/sec 1.00 100.0±0.38ms 600.0 MB/sec decimal/default 1.37 106.8±0.40ms 561.8 MB/sec 1.00 77.7±1.89ms 772.2 MB/sec decimal/parquet_2 1.17 205.2±1.83ms 292.4 MB/sec 1.00 175.5±1.54ms 341.9 MB/sec decimal/zstd 1.37 121.4±8.32ms 494.3 MB/sec 1.00 88.4±0.29ms 678.7 MB/sec decimal/zstd_parquet_2 1.18 230.8±8.61ms 260.0 MB/sec 1.00 195.6±1.52ms 306.7 MB/sec fixed_size_binary_ree/bloom_filter 1.27 74.3±0.39ms 13.6 MB/sec 1.00 58.3±0.93ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.00 61.5±0.22ms 16.4 MB/sec 1.00 61.5±0.24ms 16.4 MB/sec fixed_size_binary_ree/default 1.30 67.6±0.32ms 14.9 MB/sec 1.00 51.9±1.00ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.26 81.9±0.40ms 12.3 MB/sec 1.00 65.0±0.30ms 15.5 MB/sec fixed_size_binary_ree/zstd 1.27 73.5±0.32ms 13.7 MB/sec 1.00 57.9±1.64ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.27 82.7±1.10ms 12.2 MB/sec 1.00 65.3±0.27ms 15.4 MB/sec float_with_nans/bloom_filter 1.14 89.1±0.32ms 157.1 MB/sec 1.00 78.4±0.27ms 178.5 MB/sec float_with_nans/cdc 1.02 70.1±0.41ms 199.6 MB/sec 1.00 68.9±0.44ms 203.1 MB/sec float_with_nans/default 1.16 71.3±0.22ms 196.4 MB/sec 1.00 61.6±1.06ms 227.4 MB/sec float_with_nans/parquet_2 1.16 89.1±0.23ms 157.1 MB/sec 1.00 76.9±0.24ms 182.0 MB/sec float_with_nans/zstd 1.10 109.7±1.50ms 127.6 MB/sec 1.00 99.6±0.23ms 140.6 MB/sec float_with_nans/zstd_parquet_2 1.11 126.5±0.38ms 110.7 MB/sec 1.00 113.9±1.53ms 123.0 MB/sec fsb/bloom_filter 1.00 8.0±0.03ms 2008.8 MB/sec 1.00 8.0±0.06ms 2004.4 MB/sec fsb/cdc 1.00 10.4±0.04ms 1557.8 MB/sec 1.00 10.4±0.05ms 1551.5 MB/sec fsb/default 1.00 6.9±0.06ms 2.3 GB/sec 1.00 7.0±0.07ms 2.3 GB/sec fsb/parquet_2 1.02 13.3±0.06ms 1215.4 MB/sec 1.00 13.0±0.08ms 1243.5 MB/sec fsb/zstd 1.01 9.4±0.04ms 1707.8 MB/sec 1.00 9.3±0.05ms 1725.1 MB/sec fsb/zstd_parquet_2 1.02 14.2±0.06ms 1138.2 MB/sec 1.00 13.9±0.08ms 1161.5 MB/sec int32_ree/bloom_filter 1.02 40.0±0.12ms 10.2 MB/sec 1.00 39.1±0.15ms 10.4 MB/sec int32_ree/cdc 1.02 40.1±0.09ms 10.1 MB/sec 1.00 39.2±0.13ms 10.4 MB/sec int32_ree/default 1.03 36.4±0.08ms 11.2 MB/sec 1.00 35.4±0.12ms 11.5 MB/sec int32_ree/parquet_2 1.03 36.4±0.09ms 11.2 MB/sec 1.00 35.4±0.11ms 11.5 MB/sec int32_ree/zstd 1.03 36.9±0.09ms 11.0 MB/sec 1.00 35.9±0.11ms 11.3 MB/sec int32_ree/zstd_parquet_2 1.03 36.9±0.10ms 11.0 MB/sec 1.00 35.8±0.12ms 11.4 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.03ms 18.6 MB/sec 1.00 21.8±0.08ms 18.7 MB/sec int32_ree_95pct_null/cdc 1.00 23.8±0.06ms 17.1 MB/sec 1.01 24.0±0.04ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.5±0.03ms 18.9 MB/sec 1.00 21.5±0.04ms 19.0 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.02ms 18.9 MB/sec 1.00 21.5±0.02ms 19.0 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.03ms 18.7 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.02ms 18.7 MB/sec 1.00 21.6±0.03ms 18.8 MB/sec large_string_distinct/delta_byte_array 1.00 63.9±0.58ms 3.9 GB/sec 1.16 74.0±0.84ms 3.4 GB/sec large_string_distinct/plain 1.02 60.2±0.67ms 4.2 GB/sec 1.00 59.1±0.27ms 4.2 GB/sec large_string_non_null/bloom_filter 1.00 72.1±0.14ms 3.5 GB/sec 1.00 72.4±0.32ms 3.5 GB/sec large_string_non_null/cdc 1.01 243.8±1.12ms 1050.0 MB/sec 1.00 241.4±0.94ms 1060.5 MB/sec large_string_non_null/default 1.00 54.3±0.13ms 4.6 GB/sec 1.00 54.1±0.36ms 4.6 GB/sec large_string_non_null/parquet_2 1.01 54.3±0.13ms 4.6 GB/sec 1.00 53.9±0.35ms 4.6 GB/sec large_string_non_null/zstd 1.01 54.3±0.12ms 4.6 GB/sec 1.00 54.0±0.36ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.01 54.3±0.12ms 4.6 GB/sec 1.00 54.1±0.33ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 55.4±0.29ms 4.5 GB/sec 1.91 105.8±0.63ms 2.4 GB/sec large_string_shared_prefix/plain 1.02 93.0±0.92ms 2.7 GB/sec 1.00 91.5±0.51ms 2.7 GB/sec list_nested/bloom_filter 1.01 145.4±0.21ms 198.4 MB/sec 1.00 144.0±0.21ms 200.3 MB/sec list_nested/cdc 1.01 162.1±0.18ms 178.0 MB/sec 1.00 160.7±0.20ms 179.6 MB/sec list_nested/default 1.01 131.0±0.16ms 220.3 MB/sec 1.00 129.4±0.20ms 223.1 MB/sec list_nested/parquet_2 1.01 144.1±0.17ms 200.2 MB/sec 1.00 142.5±0.21ms 202.5 MB/sec list_nested/zstd 1.01 140.2±0.18ms 205.9 MB/sec 1.00 138.5±0.19ms 208.3 MB/sec list_nested/zstd_parquet_2 1.01 156.8±0.16ms 184.0 MB/sec 1.00 155.3±0.22ms 185.8 MB/sec list_primitive/bloom_filter 1.12 325.0±17.50ms 1678.3 MB/sec 1.00 290.4±2.67ms 1878.2 MB/sec list_primitive/cdc 1.00 317.6±9.29ms 1717.4 MB/sec 1.00 317.2±6.03ms 1719.3 MB/sec list_primitive/default 1.12 241.6±21.97ms 2.2 GB/sec 1.00 216.1±2.06ms 2.5 GB/sec list_primitive/parquet_2 1.03 242.3±13.01ms 2.2 GB/sec 1.00 235.5±0.52ms 2.3 GB/sec list_primitive/zstd 1.07 483.7±11.66ms 1127.4 MB/sec 1.00 453.1±1.42ms 1203.7 MB/sec list_primitive/zstd_parquet_2 1.06 479.1±5.17ms 1138.4 MB/sec 1.00 453.9±2.34ms 1201.5 MB/sec list_primitive_non_null/bloom_filter 1.05 417.0±28.32ms 1305.0 MB/sec 1.00 396.4±10.56ms 1373.1 MB/sec list_primitive_non_null/cdc 1.00 386.2±6.15ms 1409.2 MB/sec 1.01 391.8±8.71ms 1389.2 MB/sec list_primitive_non_null/default 1.10 288.7±24.34ms 1885.2 MB/sec 1.00 263.1±10.84ms 2.0 GB/sec list_primitive_non_null/parquet_2 1.00 269.6±22.71ms 2019.0 MB/sec 1.02 275.6±17.91ms 1974.6 MB/sec list_primitive_non_null/zstd 1.05 724.6±21.45ms 751.1 MB/sec 1.00 688.6±3.75ms 790.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 648.8±20.64ms 838.9 MB/sec 1.04 673.9±0.48ms 807.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.07ms 2.9 GB/sec 1.00 12.6±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.2±0.09ms 1543.6 MB/sec 1.00 23.9±0.07ms 1562.9 MB/sec list_primitive_sparse_99pct_null/default 1.01 12.4±0.05ms 2.9 GB/sec 1.00 12.3±0.06ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.02 12.5±0.06ms 2.9 GB/sec 1.00 12.3±0.03ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 14.3±0.06ms 2.5 GB/sec 1.00 14.1±0.05ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.6±0.07ms 2.9 GB/sec 1.00 12.4±0.04ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 281.2±0.42ms 162.2 MB/sec 1.00 278.8±0.45ms 163.5 MB/sec list_struct_with_list/cdc 1.01 319.5±0.80ms 142.7 MB/sec 1.00 316.9±0.46ms 143.9 MB/sec list_struct_with_list/default 1.01 253.7±0.37ms 179.7 MB/sec 1.00 251.8±0.38ms 181.1 MB/sec list_struct_with_list/parquet_2 1.01 271.1±0.47ms 168.2 MB/sec 1.00 269.0±0.41ms 169.5 MB/sec list_struct_with_list/zstd 1.01 275.7±0.44ms 165.4 MB/sec 1.00 273.5±0.43ms 166.7 MB/sec list_struct_with_list/zstd_parquet_2 1.01 294.2±0.43ms 155.0 MB/sec 1.00 292.7±0.91ms 155.8 MB/sec primitive/bloom_filter 1.03 144.9±0.52ms 309.7 MB/sec 1.00 141.1±0.67ms 318.0 MB/sec primitive/cdc 1.02 154.3±0.55ms 290.9 MB/sec 1.00 151.0±0.66ms 297.1 MB/sec primitive/default 1.03 113.4±0.28ms 395.9 MB/sec 1.00 110.3±0.39ms 406.9 MB/sec primitive/parquet_2 1.02 128.3±0.37ms 349.7 MB/sec 1.00 125.4±0.50ms 358.0 MB/sec primitive/zstd 1.02 143.0±0.35ms 313.8 MB/sec 1.00 139.8±0.35ms 320.9 MB/sec primitive/zstd_parquet_2 1.02 161.2±0.34ms 278.3 MB/sec 1.00 158.0±0.34ms 284.0 MB/sec primitive_all_null/bloom_filter 1.01 892.6±2.47µs 49.1 GB/sec 1.00 884.5±4.84µs 49.5 GB/sec primitive_all_null/cdc 1.00 18.3±0.38ms 2.4 GB/sec 1.17 21.5±0.55ms 2.0 GB/sec primitive_all_null/default 1.00 276.0±1.24µs 158.8 GB/sec 1.00 274.6±1.96µs 159.6 GB/sec primitive_all_null/parquet_2 1.00 284.4±1.23µs 154.1 GB/sec 1.00 284.5±1.97µs 154.0 GB/sec primitive_all_null/zstd 1.00 424.6±1.29µs 103.2 GB/sec 1.00 425.5±1.98µs 103.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 384.9±1.26µs 113.9 GB/sec 1.00 384.5±2.10µs 114.0 GB/sec primitive_non_null/bloom_filter 1.05 100.9±0.40ms 436.3 MB/sec 1.00 95.9±0.43ms 458.9 MB/sec primitive_non_null/cdc 1.05 84.8±0.23ms 519.0 MB/sec 1.00 80.6±0.38ms 546.0 MB/sec primitive_non_null/default 1.07 62.2±0.28ms 707.3 MB/sec 1.00 57.9±0.27ms 759.9 MB/sec primitive_non_null/parquet_2 1.04 83.7±0.18ms 525.8 MB/sec 1.00 80.1±1.21ms 549.0 MB/sec primitive_non_null/zstd 1.04 92.4±0.22ms 476.4 MB/sec 1.00 88.4±0.23ms 497.9 MB/sec primitive_non_null/zstd_parquet_2 1.03 116.5±0.25ms 377.7 MB/sec 1.00 112.7±0.22ms 390.5 MB/sec primitive_sparse_99pct_null/bloom_filter 1.02 12.2±0.10ms 3.6 GB/sec 1.00 11.9±0.08ms 3.7 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.3±0.32ms 1531.3 MB/sec 1.02 30.0±0.29ms 1494.7 MB/sec primitive_sparse_99pct_null/default 1.02 10.7±0.05ms 4.1 GB/sec 1.00 10.5±0.05ms 4.2 GB/sec primitive_sparse_99pct_null/parquet_2 1.02 10.8±0.04ms 4.1 GB/sec 1.00 10.5±0.04ms 4.2 GB/sec primitive_sparse_99pct_null/zstd 1.02 14.1±0.08ms 3.1 GB/sec 1.00 13.9±0.08ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.02 12.7±0.06ms 3.5 GB/sec 1.00 12.4±0.04ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 27.0±0.09ms 444.5 MB/sec 1.00 26.9±0.07ms 446.4 MB/sec short_string_non_null/cdc 1.00 19.7±0.05ms 610.4 MB/sec 1.00 19.7±0.04ms 610.6 MB/sec short_string_non_null/default 1.00 15.6±0.07ms 771.2 MB/sec 1.00 15.6±0.06ms 771.7 MB/sec short_string_non_null/parquet_2 1.00 25.6±0.05ms 468.1 MB/sec 1.01 25.8±0.06ms 465.6 MB/sec short_string_non_null/zstd 1.00 35.8±0.08ms 335.6 MB/sec 1.00 35.8±0.13ms 335.1 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.6±0.09ms 419.9 MB/sec 1.01 28.9±0.19ms 415.9 MB/sec small_string_distinct/delta_byte_array 1.03 960.3±8.41µs 8.2 GB/sec 1.00 934.2±8.38µs 8.4 GB/sec small_string_distinct/plain 1.02 756.8±4.84µs 10.4 GB/sec 1.00 744.3±4.16µs 10.5 GB/sec small_string_partial_prefix/delta_byte_array 1.00 989.4±3.46µs 7.9 GB/sec 1.00 984.7±5.56µs 8.0 GB/sec small_string_partial_prefix/plain 1.02 1005.3±5.58µs 7.8 GB/sec 1.00 989.0±4.56µs 7.9 GB/sec small_string_shared_prefix/delta_byte_array 1.00 981.2±1.58µs 8.0 GB/sec 1.00 977.6±1.83µs 8.0 GB/sec small_string_shared_prefix/plain 1.01 1113.1±6.74µs 7.0 GB/sec 1.00 1100.0±8.08µs 7.1 GB/sec string/bloom_filter 1.06 202.1±19.31ms 2.5 GB/sec 1.00 191.1±8.06ms 2.7 GB/sec string/cdc 1.00 206.4±7.28ms 2.5 GB/sec 1.01 207.6±9.93ms 2.5 GB/sec string/default 1.00 109.7±14.52ms 4.7 GB/sec 1.08 118.8±21.74ms 4.3 GB/sec string/parquet_2 1.34 161.8±0.90ms 3.2 GB/sec 1.00 120.3±12.31ms 4.3 GB/sec string/zstd 1.05 455.2±15.72ms 1151.7 MB/sec 1.00 431.6±3.06ms 1214.6 MB/sec string/zstd_parquet_2 1.00 404.2±0.75ms 1297.0 MB/sec 1.02 411.9±0.34ms 1272.7 MB/sec string_and_binary_view/bloom_filter 1.01 63.9±0.30ms 504.6 MB/sec 1.00 63.1±0.30ms 511.2 MB/sec string_and_binary_view/cdc 1.01 58.8±0.17ms 548.2 MB/sec 1.00 58.4±0.18ms 552.1 MB/sec string_and_binary_view/default 1.00 47.9±0.14ms 672.7 MB/sec 1.00 47.7±0.14ms 675.5 MB/sec string_and_binary_view/parquet_2 1.00 59.2±0.18ms 544.6 MB/sec 1.00 58.9±0.19ms 547.1 MB/sec string_and_binary_view/zstd 1.00 84.9±0.17ms 379.8 MB/sec 1.00 85.3±0.29ms 378.3 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.1±0.17ms 440.9 MB/sec 1.00 72.9±0.18ms 442.6 MB/sec string_dictionary/bloom_filter 1.00 82.7±0.49ms 3.1 GB/sec 1.02 84.0±0.45ms 3.1 GB/sec string_dictionary/cdc 1.00 45.2±0.46ms 5.7 GB/sec 1.03 46.3±0.37ms 5.6 GB/sec string_dictionary/default 1.00 41.3±1.06ms 6.2 GB/sec 1.03 42.6±0.43ms 6.1 GB/sec string_dictionary/parquet_2 1.01 48.1±0.22ms 5.4 GB/sec 1.00 47.6±0.21ms 5.4 GB/sec string_dictionary/zstd 1.00 204.6±1.03ms 1290.7 MB/sec 1.01 205.7±0.59ms 1283.8 MB/sec string_dictionary/zstd_parquet_2 1.00 192.1±0.15ms 1374.8 MB/sec 1.00 191.2±0.19ms 1381.1 MB/sec string_non_null/bloom_filter 1.00 227.6±16.48ms 2.2 GB/sec 1.02 232.8±24.66ms 2.2 GB/sec string_non_null/cdc 1.01 247.7±3.50ms 2.1 GB/sec 1.00 244.5±8.70ms 2.1 GB/sec string_non_null/default 1.00 115.6±15.34ms 4.4 GB/sec 1.08 125.2±19.59ms 4.1 GB/sec string_non_null/parquet_2 1.00 123.1±13.23ms 4.2 GB/sec 1.02 125.9±16.37ms 4.1 GB/sec string_non_null/zstd 1.05 554.2±7.35ms 945.4 MB/sec 1.00 528.8±2.22ms 991.0 MB/sec string_non_null/zstd_parquet_2 1.03 500.2±12.35ms 1047.5 MB/sec 1.00 487.7±4.95ms 1074.4 MB/sec string_ree/bloom_filter 1.00 150.7±0.74ms 108.9 MB/sec 1.03 155.5±0.75ms 105.5 MB/sec string_ree/cdc 1.00 224.4±0.59ms 73.1 MB/sec 1.00 225.0±0.68ms 72.9 MB/sec string_ree/default 1.00 120.2±1.94ms 136.5 MB/sec 1.06 127.8±1.23ms 128.4 MB/sec string_ree/parquet_2 1.00 129.8±0.51ms 126.4 MB/sec 1.00 129.7±0.50ms 126.5 MB/sec string_ree/zstd 1.00 185.6±0.65ms 88.4 MB/sec 1.00 185.8±0.89ms 88.3 MB/sec string_ree/zstd_parquet_2 1.00 143.9±0.49ms 114.0 MB/sec 1.00 144.4±0.46ms 113.6 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.2±0.11ms 53.8 MB/sec 1.00 26.1±0.10ms 54.0 MB/sec string_ree_95pct_null/cdc 1.00 32.2±0.10ms 43.7 MB/sec 1.01 32.5±0.10ms 43.3 MB/sec string_ree_95pct_null/default 1.00 24.7±0.08ms 57.0 MB/sec 1.00 24.6±0.07ms 57.2 MB/sec string_ree_95pct_null/parquet_2 1.01 24.8±0.06ms 56.7 MB/sec 1.00 24.6±0.09ms 57.1 MB/sec string_ree_95pct_null/zstd 1.01 25.6±0.11ms 55.0 MB/sec 1.00 25.4±0.09ms 55.4 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.5±0.11ms 55.3 MB/sec 1.00 25.3±0.07ms 55.6 MB/sec struct_all_null/bloom_filter 1.01 376.7±1.65µs 41.8 GB/sec 1.00 371.6±2.07µs 42.4 GB/sec struct_all_null/cdc 1.00 7.4±0.12ms 2.1 GB/sec 1.06 7.8±0.08ms 2.0 GB/sec struct_all_null/default 1.01 118.2±0.67µs 133.2 GB/sec 1.00 117.3±0.82µs 134.3 GB/sec struct_all_null/parquet_2 1.01 122.1±0.56µs 128.9 GB/sec 1.00 121.1±0.81µs 130.0 GB/sec struct_all_null/zstd 1.00 181.9±0.54µs 86.6 GB/sec 1.00 181.4±0.93µs 86.8 GB/sec struct_all_null/zstd_parquet_2 1.01 165.8±0.50µs 95.0 GB/sec 1.00 163.9±0.94µs 96.1 GB/sec struct_non_null/bloom_filter 1.06 43.9±0.18ms 364.1 MB/sec 1.00 41.5±0.18ms 385.7 MB/sec struct_non_null/cdc 1.06 43.3±0.97ms 369.8 MB/sec 1.00 40.9±0.13ms 391.2 MB/sec struct_non_null/default 1.08 29.7±0.11ms 538.9 MB/sec 1.00 27.5±0.13ms 581.6 MB/sec struct_non_null/parquet_2 1.06 38.4±0.11ms 416.5 MB/sec 1.00 36.2±0.11ms 442.6 MB/sec struct_non_null/zstd 1.07 38.3±0.12ms 417.2 MB/sec 1.00 36.0±0.11ms 444.4 MB/sec struct_non_null/zstd_parquet_2 1.05 52.1±0.14ms 307.0 MB/sec 1.00 49.9±0.11ms 320.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.02 6.5±0.03ms 2.4 GB/sec 1.00 6.4±0.04ms 2.5 GB/sec struct_sparse_99pct_null/cdc 1.00 13.3±0.13ms 1211.1 MB/sec 1.04 13.9±0.09ms 1163.4 MB/sec struct_sparse_99pct_null/default 1.02 6.0±0.02ms 2.6 GB/sec 1.00 5.9±0.01ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.02 6.0±0.02ms 2.6 GB/sec 1.00 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.02 7.4±0.03ms 2.1 GB/sec 1.00 7.2±0.02ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.02 6.7±0.02ms 2.3 GB/sec 1.00 6.6±0.02ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3025.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.5 GiB | | CPU user | 2908.1s | | CPU sys | 112.4s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3070.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.5 GiB | | CPU user | 2895.4s | | CPU sys | 171.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
