adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5188511745
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187771116) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.6±0.04ms 19.9 MB/sec 1.03 12.9±0.10ms 19.4 MB/sec bool/cdc 1.00 15.4±0.03ms 16.2 MB/sec 1.01 15.5±0.08ms 16.1 MB/sec bool/default 1.00 10.5±0.03ms 23.9 MB/sec 1.03 10.8±0.07ms 23.2 MB/sec bool/parquet_2 1.00 14.3±0.04ms 17.5 MB/sec 1.02 14.6±0.08ms 17.1 MB/sec bool/zstd 1.00 11.0±0.03ms 22.7 MB/sec 1.03 11.3±0.08ms 22.2 MB/sec bool/zstd_parquet_2 1.00 14.6±0.04ms 17.1 MB/sec 1.02 14.9±0.08ms 16.7 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.3 MB/sec 1.02 6.6±0.03ms 18.9 MB/sec bool_non_null/cdc 1.00 6.2±0.03ms 20.1 MB/sec 1.01 6.3±0.02ms 19.8 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.4 MB/sec 1.02 3.8±0.02ms 32.6 MB/sec bool_non_null/parquet_2 1.00 8.5±0.02ms 14.7 MB/sec 1.02 8.6±0.05ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.5 MB/sec 1.03 4.2±0.02ms 29.6 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.03ms 14.0 MB/sec 1.01 9.0±0.03ms 13.9 MB/sec bool_ree/bloom_filter 1.00 30.0±0.08ms 7.1 MB/sec 1.02 30.6±0.13ms 7.0 MB/sec bool_ree/cdc 1.00 31.4±0.06ms 6.8 MB/sec 1.01 31.9±0.16ms 6.7 MB/sec bool_ree/default 1.00 27.3±0.08ms 7.8 MB/sec 1.01 27.7±0.13ms 7.7 MB/sec bool_ree/parquet_2 1.00 28.9±0.07ms 7.4 MB/sec 1.02 29.4±0.13ms 7.2 MB/sec bool_ree/zstd 1.00 27.9±0.07ms 7.6 MB/sec 1.02 28.4±0.14ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.07ms 7.3 MB/sec 1.02 29.6±0.14ms 7.2 MB/sec decimal/bloom_filter 1.00 121.0±2.03ms 496.1 MB/sec 1.04 125.3±1.56ms 478.8 MB/sec decimal/cdc 1.00 101.4±0.51ms 591.7 MB/sec 1.03 104.0±0.52ms 576.9 MB/sec decimal/default 1.00 79.5±2.19ms 754.4 MB/sec 1.03 82.2±0.63ms 729.7 MB/sec decimal/parquet_2 1.00 177.9±1.98ms 337.3 MB/sec 1.02 181.9±1.54ms 329.9 MB/sec decimal/zstd 1.00 90.3±1.73ms 664.8 MB/sec 1.04 93.4±0.77ms 642.2 MB/sec decimal/zstd_parquet_2 1.00 198.0±2.83ms 303.0 MB/sec 1.02 201.5±1.18ms 297.8 MB/sec fixed_size_binary_ree/bloom_filter 1.00 57.5±0.84ms 17.5 MB/sec 1.09 62.6±0.57ms 16.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.5±0.28ms 16.4 MB/sec 1.03 63.0±0.29ms 16.0 MB/sec fixed_size_binary_ree/default 1.00 51.2±0.82ms 19.7 MB/sec 1.05 53.7±1.58ms 18.8 MB/sec fixed_size_binary_ree/parquet_2 1.00 65.4±0.84ms 15.4 MB/sec 1.07 70.1±0.40ms 14.4 MB/sec fixed_size_binary_ree/zstd 1.00 57.0±0.82ms 17.7 MB/sec 1.04 59.4±0.98ms 17.0 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.3±0.86ms 15.2 MB/sec 1.07 71.0±1.33ms 14.2 MB/sec float_with_nans/bloom_filter 1.00 80.5±0.90ms 173.9 MB/sec 1.06 85.5±0.98ms 163.7 MB/sec float_with_nans/cdc 1.00 70.1±0.24ms 199.8 MB/sec 1.05 73.9±0.70ms 189.6 MB/sec float_with_nans/default 1.00 62.7±0.88ms 223.4 MB/sec 1.05 65.6±1.13ms 213.4 MB/sec float_with_nans/parquet_2 1.00 80.4±0.89ms 174.2 MB/sec 1.04 83.7±1.48ms 167.2 MB/sec float_with_nans/zstd 1.00 100.8±0.88ms 138.9 MB/sec 1.03 104.1±0.46ms 134.5 MB/sec float_with_nans/zstd_parquet_2 1.00 117.1±0.86ms 119.6 MB/sec 1.03 120.8±0.58ms 115.9 MB/sec fsb/bloom_filter 1.01 8.0±0.11ms 2015.4 MB/sec 1.00 7.9±0.06ms 2031.8 MB/sec fsb/cdc 1.00 10.3±0.04ms 1560.3 MB/sec 1.00 10.3±0.02ms 1567.2 MB/sec fsb/default 1.00 6.9±0.10ms 2.3 GB/sec 1.00 6.8±0.06ms 2.3 GB/sec fsb/parquet_2 1.01 13.2±0.10ms 1219.6 MB/sec 1.00 13.1±0.06ms 1227.8 MB/sec fsb/zstd 1.01 9.3±0.10ms 1730.3 MB/sec 1.00 9.2±0.06ms 1745.5 MB/sec fsb/zstd_parquet_2 1.00 14.1±0.12ms 1144.9 MB/sec 1.00 14.0±0.07ms 1150.4 MB/sec int32_ree/bloom_filter 1.00 39.9±0.05ms 10.2 MB/sec 1.01 40.3±0.14ms 10.1 MB/sec int32_ree/cdc 1.00 40.1±0.05ms 10.1 MB/sec 1.03 41.3±0.17ms 9.8 MB/sec int32_ree/default 1.00 36.4±0.06ms 11.2 MB/sec 1.00 36.5±0.13ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.6±0.15ms 11.1 MB/sec 1.00 36.5±0.12ms 11.1 MB/sec int32_ree/zstd 1.00 37.0±0.17ms 11.0 MB/sec 1.03 37.9±0.15ms 10.7 MB/sec int32_ree/zstd_parquet_2 1.00 36.8±0.07ms 11.0 MB/sec 1.03 37.8±0.13ms 10.7 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.8±0.02ms 18.6 MB/sec 1.02 22.3±0.04ms 18.2 MB/sec int32_ree_95pct_null/cdc 1.00 23.7±0.04ms 17.1 MB/sec 1.03 24.5±0.06ms 16.6 MB/sec int32_ree_95pct_null/default 1.00 21.5±0.04ms 18.9 MB/sec 1.01 21.7±0.04ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.01ms 18.9 MB/sec 1.01 21.7±0.04ms 18.7 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.04ms 18.7 MB/sec 1.01 22.0±0.03ms 18.5 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.02ms 18.8 MB/sec 1.01 21.9±0.04ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.00 64.2±0.35ms 3.9 GB/sec 1.00 64.2±0.28ms 3.9 GB/sec large_string_distinct/plain 1.00 59.7±0.34ms 4.2 GB/sec 1.01 60.1±0.73ms 4.2 GB/sec large_string_non_null/bloom_filter 1.00 72.1±0.11ms 3.5 GB/sec 1.04 74.9±0.72ms 3.3 GB/sec large_string_non_null/cdc 1.00 243.4±1.16ms 1051.7 MB/sec 1.01 245.0±2.60ms 1045.1 MB/sec large_string_non_null/default 1.00 54.3±0.07ms 4.6 GB/sec 1.04 56.3±0.69ms 4.4 GB/sec large_string_non_null/parquet_2 1.00 54.4±0.08ms 4.6 GB/sec 1.00 54.4±0.49ms 4.6 GB/sec large_string_non_null/zstd 1.00 54.4±0.08ms 4.6 GB/sec 1.01 54.8±0.77ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.4±0.08ms 4.6 GB/sec 1.01 55.0±0.90ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 55.1±0.08ms 4.5 GB/sec 1.00 55.2±0.08ms 4.5 GB/sec large_string_shared_prefix/plain 1.00 92.7±0.46ms 2.7 GB/sec 1.00 93.0±1.07ms 2.7 GB/sec list_nested/bloom_filter 1.02 146.7±0.47ms 196.7 MB/sec 1.00 143.7±0.18ms 200.9 MB/sec list_nested/cdc 1.00 162.1±0.13ms 178.0 MB/sec 1.00 161.6±0.16ms 178.6 MB/sec list_nested/default 1.01 131.2±0.37ms 219.9 MB/sec 1.00 130.2±0.13ms 221.6 MB/sec list_nested/parquet_2 1.01 144.3±0.36ms 200.0 MB/sec 1.00 143.4±0.17ms 201.2 MB/sec list_nested/zstd 1.01 140.3±0.30ms 205.7 MB/sec 1.00 139.4±0.15ms 207.0 MB/sec list_nested/zstd_parquet_2 1.01 157.0±0.29ms 183.8 MB/sec 1.00 156.2±0.16ms 184.8 MB/sec list_primitive/bloom_filter 1.00 277.4±0.64ms 1966.2 MB/sec 1.12 310.7±4.84ms 1755.3 MB/sec list_primitive/cdc 1.00 311.3±1.53ms 1751.8 MB/sec 1.05 325.4±1.64ms 1675.9 MB/sec list_primitive/default 1.00 200.6±1.22ms 2.7 GB/sec 1.07 213.8±1.75ms 2.5 GB/sec list_primitive/parquet_2 1.00 224.6±0.53ms 2.4 GB/sec 1.03 231.2±0.88ms 2.3 GB/sec list_primitive/zstd 1.00 453.8±0.89ms 1201.9 MB/sec 1.06 482.5±2.32ms 1130.3 MB/sec list_primitive/zstd_parquet_2 1.00 447.0±0.52ms 1219.9 MB/sec 1.02 457.3±1.36ms 1192.7 MB/sec list_primitive_non_null/bloom_filter 1.00 374.0±4.67ms 1455.4 MB/sec 1.14 425.9±20.11ms 1277.7 MB/sec list_primitive_non_null/cdc 1.00 391.5±8.87ms 1390.2 MB/sec 1.01 394.3±8.67ms 1380.2 MB/sec list_primitive_non_null/default 1.00 243.5±4.16ms 2.2 GB/sec 1.11 271.3±4.68ms 2006.0 MB/sec list_primitive_non_null/parquet_2 1.01 272.0±10.74ms 2001.1 MB/sec 1.00 268.4±12.56ms 2027.5 MB/sec list_primitive_non_null/zstd 1.00 664.5±2.14ms 819.0 MB/sec 1.01 668.0±1.09ms 814.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 640.6±10.55ms 849.6 MB/sec 1.00 639.0±5.29ms 851.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.02ms 2.9 GB/sec 1.00 12.6±0.03ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.2±0.09ms 1545.1 MB/sec 1.00 23.9±0.07ms 1565.3 MB/sec list_primitive_sparse_99pct_null/default 1.01 12.4±0.02ms 2.9 GB/sec 1.00 12.3±0.05ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.4±0.02ms 2.9 GB/sec 1.00 12.4±0.03ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 14.2±0.03ms 2.6 GB/sec 1.00 14.1±0.06ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.6±0.04ms 2.9 GB/sec 1.00 12.5±0.02ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 281.5±0.35ms 162.0 MB/sec 1.00 279.9±0.35ms 162.9 MB/sec list_struct_with_list/cdc 1.00 319.7±0.99ms 142.6 MB/sec 1.00 318.4±0.39ms 143.2 MB/sec list_struct_with_list/default 1.00 253.7±0.37ms 179.7 MB/sec 1.00 252.9±0.34ms 180.3 MB/sec list_struct_with_list/parquet_2 1.00 271.2±0.37ms 168.1 MB/sec 1.00 270.9±0.79ms 168.3 MB/sec list_struct_with_list/zstd 1.00 275.8±0.44ms 165.4 MB/sec 1.00 274.8±0.34ms 165.9 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.3±0.38ms 154.9 MB/sec 1.00 293.5±0.37ms 155.3 MB/sec primitive/bloom_filter 1.00 144.5±0.35ms 310.6 MB/sec 1.04 150.1±0.95ms 299.1 MB/sec primitive/cdc 1.00 153.6±0.40ms 292.2 MB/sec 1.04 160.3±1.18ms 279.9 MB/sec primitive/default 1.00 113.1±0.17ms 396.8 MB/sec 1.03 116.4±0.66ms 385.5 MB/sec primitive/parquet_2 1.00 127.9±0.18ms 350.7 MB/sec 1.05 134.0±1.70ms 334.9 MB/sec primitive/zstd 1.00 143.2±0.49ms 313.4 MB/sec 1.05 150.1±1.46ms 299.0 MB/sec primitive/zstd_parquet_2 1.00 160.8±0.21ms 279.0 MB/sec 1.04 167.7±1.10ms 267.7 MB/sec primitive_all_null/bloom_filter 1.00 891.2±2.31µs 49.2 GB/sec 1.00 887.2±1.39µs 49.4 GB/sec primitive_all_null/cdc 1.00 18.2±0.35ms 2.4 GB/sec 1.05 19.1±0.33ms 2.3 GB/sec primitive_all_null/default 1.01 274.0±1.30µs 159.9 GB/sec 1.00 270.2±1.26µs 162.2 GB/sec primitive_all_null/parquet_2 1.02 285.3±1.19µs 153.6 GB/sec 1.00 279.4±1.32µs 156.8 GB/sec primitive_all_null/zstd 1.01 424.7±1.72µs 103.2 GB/sec 1.00 420.3±1.44µs 104.3 GB/sec primitive_all_null/zstd_parquet_2 1.02 386.9±1.66µs 113.3 GB/sec 1.00 379.5±1.52µs 115.5 GB/sec primitive_non_null/bloom_filter 1.00 101.3±0.26ms 434.6 MB/sec 1.01 102.3±0.43ms 430.1 MB/sec primitive_non_null/cdc 1.00 84.6±0.24ms 519.9 MB/sec 1.00 84.7±0.27ms 519.6 MB/sec primitive_non_null/default 1.00 61.7±0.16ms 712.9 MB/sec 1.01 62.6±0.66ms 702.8 MB/sec primitive_non_null/parquet_2 1.00 83.5±0.14ms 526.9 MB/sec 1.01 84.2±0.64ms 522.8 MB/sec primitive_non_null/zstd 1.00 92.2±0.16ms 477.1 MB/sec 1.01 93.6±1.44ms 470.1 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.1±0.17ms 378.9 MB/sec 1.01 116.8±0.18ms 376.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.0±0.05ms 3.6 GB/sec 1.00 12.0±0.04ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.2±0.34ms 1536.5 MB/sec 1.03 30.1±0.23ms 1488.9 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.02ms 4.1 GB/sec 1.00 10.7±0.02ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.03ms 4.1 GB/sec 1.00 10.8±0.02ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.0±0.03ms 3.1 GB/sec 1.00 14.1±0.11ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.03ms 3.5 GB/sec 1.00 12.6±0.04ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 27.5±0.05ms 437.1 MB/sec 1.05 28.7±0.11ms 417.5 MB/sec short_string_non_null/cdc 1.00 19.6±0.04ms 611.2 MB/sec 1.03 20.2±0.06ms 595.5 MB/sec short_string_non_null/default 1.00 15.5±0.03ms 773.5 MB/sec 1.04 16.1±0.04ms 746.2 MB/sec short_string_non_null/parquet_2 1.00 25.6±0.04ms 468.8 MB/sec 1.03 26.2±0.06ms 457.3 MB/sec short_string_non_null/zstd 1.00 35.7±0.05ms 336.6 MB/sec 1.02 36.3±0.12ms 330.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.5±0.04ms 421.0 MB/sec 1.02 29.1±0.07ms 411.8 MB/sec small_string_distinct/delta_byte_array 1.01 954.4±5.56µs 8.2 GB/sec 1.00 942.6±6.05µs 8.3 GB/sec small_string_distinct/plain 1.02 762.8±2.27µs 10.3 GB/sec 1.00 746.5±1.91µs 10.5 GB/sec small_string_partial_prefix/delta_byte_array 1.00 995.6±3.67µs 7.9 GB/sec 1.00 990.8±2.64µs 7.9 GB/sec small_string_partial_prefix/plain 1.00 1012.4±2.80µs 7.7 GB/sec 1.00 1009.4±2.60µs 7.8 GB/sec small_string_shared_prefix/delta_byte_array 1.01 987.6±1.14µs 7.9 GB/sec 1.00 975.2±0.79µs 8.0 GB/sec small_string_shared_prefix/plain 1.02 1115.9±5.36µs 7.0 GB/sec 1.00 1088.8±3.60µs 7.2 GB/sec string/bloom_filter 1.00 210.4±21.72ms 2.4 GB/sec 1.04 219.0±23.57ms 2.3 GB/sec string/cdc 1.00 203.7±4.27ms 2.5 GB/sec 1.06 216.2±12.42ms 2.4 GB/sec string/default 1.00 115.1±18.50ms 4.4 GB/sec 1.02 117.0±17.84ms 4.4 GB/sec string/parquet_2 1.11 113.4±0.65ms 4.5 GB/sec 1.00 102.4±8.80ms 5.0 GB/sec string/zstd 1.11 461.5±9.75ms 1136.0 MB/sec 1.00 414.7±3.78ms 1264.1 MB/sec string/zstd_parquet_2 1.00 389.0±5.62ms 1347.7 MB/sec 1.01 391.1±7.96ms 1340.5 MB/sec string_and_binary_view/bloom_filter 1.00 64.1±0.16ms 503.1 MB/sec 1.17 74.7±1.84ms 431.9 MB/sec string_and_binary_view/cdc 1.00 60.1±1.62ms 536.2 MB/sec 1.04 62.6±0.80ms 514.9 MB/sec string_and_binary_view/default 1.00 47.8±0.10ms 674.9 MB/sec 1.12 53.5±1.06ms 603.3 MB/sec string_and_binary_view/parquet_2 1.00 59.0±0.22ms 546.6 MB/sec 1.10 64.6±1.70ms 499.0 MB/sec string_and_binary_view/zstd 1.00 84.8±0.16ms 380.2 MB/sec 1.07 90.6±1.36ms 356.1 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.4±0.18ms 439.3 MB/sec 1.05 76.9±0.96ms 419.5 MB/sec string_dictionary/bloom_filter 1.00 83.6±0.82ms 3.1 GB/sec 1.21 101.2±3.06ms 2.5 GB/sec string_dictionary/cdc 1.00 45.1±0.64ms 5.7 GB/sec 1.18 53.1±1.44ms 4.9 GB/sec string_dictionary/default 1.00 41.0±0.94ms 6.3 GB/sec 1.21 49.6±1.09ms 5.2 GB/sec string_dictionary/parquet_2 1.00 48.4±0.38ms 5.3 GB/sec 1.08 52.3±0.50ms 4.9 GB/sec string_dictionary/zstd 1.00 205.5±1.27ms 1285.2 MB/sec 1.08 221.4±3.07ms 1192.9 MB/sec string_dictionary/zstd_parquet_2 1.00 193.0±0.90ms 1368.8 MB/sec 1.02 196.3±1.22ms 1345.5 MB/sec string_non_null/bloom_filter 1.00 221.4±12.55ms 2.3 GB/sec 1.25 276.4±20.24ms 1895.6 MB/sec string_non_null/cdc 1.00 248.3±3.31ms 2.1 GB/sec 1.02 254.0±9.38ms 2.0 GB/sec string_non_null/default 1.00 112.1±11.22ms 4.6 GB/sec 1.27 142.1±15.71ms 3.6 GB/sec string_non_null/parquet_2 1.00 120.4±4.67ms 4.3 GB/sec 1.08 129.5±12.62ms 4.0 GB/sec string_non_null/zstd 1.00 534.3±2.34ms 980.8 MB/sec 1.07 572.2±10.09ms 915.7 MB/sec string_non_null/zstd_parquet_2 1.01 505.2±4.24ms 1037.2 MB/sec 1.00 497.8±8.44ms 1052.7 MB/sec string_ree/bloom_filter 1.00 151.0±0.90ms 108.6 MB/sec 1.02 154.4±1.42ms 106.3 MB/sec string_ree/cdc 1.00 222.4±2.00ms 73.8 MB/sec 1.02 226.1±0.90ms 72.6 MB/sec string_ree/default 1.00 124.1±0.98ms 132.2 MB/sec 1.01 125.4±0.75ms 130.9 MB/sec string_ree/parquet_2 1.00 126.9±1.08ms 129.3 MB/sec 1.02 130.0±0.43ms 126.2 MB/sec string_ree/zstd 1.00 183.6±3.39ms 89.4 MB/sec 1.02 187.4±0.62ms 87.6 MB/sec string_ree/zstd_parquet_2 1.00 141.2±0.40ms 116.2 MB/sec 1.03 145.2±0.46ms 113.0 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.0±0.04ms 54.0 MB/sec 1.05 27.4±0.09ms 51.3 MB/sec string_ree_95pct_null/cdc 1.00 32.1±0.10ms 43.8 MB/sec 1.03 33.2±0.42ms 42.4 MB/sec string_ree_95pct_null/default 1.00 24.6±0.04ms 57.1 MB/sec 1.04 25.6±0.06ms 54.9 MB/sec string_ree_95pct_null/parquet_2 1.00 24.6±0.04ms 57.1 MB/sec 1.04 25.7±0.06ms 54.8 MB/sec string_ree_95pct_null/zstd 1.00 25.4±0.05ms 55.3 MB/sec 1.01 25.6±0.24ms 55.0 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.4±0.04ms 55.5 MB/sec 1.00 25.3±0.08ms 55.7 MB/sec struct_all_null/bloom_filter 1.01 375.9±1.96µs 41.9 GB/sec 1.00 372.3±1.45µs 42.3 GB/sec struct_all_null/cdc 1.00 7.3±0.13ms 2.1 GB/sec 1.06 7.8±0.06ms 2.0 GB/sec struct_all_null/default 1.02 118.4±0.81µs 133.0 GB/sec 1.00 116.4±0.57µs 135.3 GB/sec struct_all_null/parquet_2 1.01 122.1±0.68µs 128.9 GB/sec 1.00 121.0±0.58µs 130.2 GB/sec struct_all_null/zstd 1.02 183.2±0.73µs 86.0 GB/sec 1.00 179.7±0.57µs 87.6 GB/sec struct_all_null/zstd_parquet_2 1.02 165.4±0.57µs 95.2 GB/sec 1.00 162.5±0.76µs 96.9 GB/sec struct_non_null/bloom_filter 1.03 44.1±0.12ms 363.2 MB/sec 1.00 42.9±0.13ms 372.7 MB/sec struct_non_null/cdc 1.00 42.9±0.13ms 372.8 MB/sec 1.00 42.8±0.11ms 373.7 MB/sec struct_non_null/default 1.01 29.7±0.07ms 539.4 MB/sec 1.00 29.4±0.09ms 544.1 MB/sec struct_non_null/parquet_2 1.01 38.3±0.09ms 418.1 MB/sec 1.00 38.1±0.10ms 420.3 MB/sec struct_non_null/zstd 1.01 38.3±0.10ms 417.8 MB/sec 1.00 38.0±0.10ms 421.3 MB/sec struct_non_null/zstd_parquet_2 1.01 52.2±0.22ms 306.6 MB/sec 1.00 51.8±0.12ms 309.0 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.02ms 2.4 GB/sec 1.00 6.5±0.01ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.2±0.10ms 1219.6 MB/sec 1.06 14.0±0.05ms 1153.9 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.01ms 2.6 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.03ms 2.1 GB/sec 1.00 7.3±0.01ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.00 6.7±0.01ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3030.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2938.7s | | CPU sys | 86.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2990.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2896.0s | | CPU sys | 89.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
