adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5188511895
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187770940) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.6±0.05ms 19.9 MB/sec 1.01 12.7±0.07ms 19.6 MB/sec bool/cdc 1.00 15.4±0.04ms 16.2 MB/sec 1.00 15.4±0.07ms 16.3 MB/sec bool/default 1.00 10.4±0.03ms 23.9 MB/sec 1.01 10.6±0.05ms 23.6 MB/sec bool/parquet_2 1.00 14.2±0.04ms 17.6 MB/sec 1.01 14.4±0.06ms 17.4 MB/sec bool/zstd 1.00 11.0±0.04ms 22.7 MB/sec 1.01 11.1±0.05ms 22.5 MB/sec bool/zstd_parquet_2 1.00 14.6±0.04ms 17.1 MB/sec 1.01 14.8±0.07ms 16.9 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.3 MB/sec 1.02 6.6±0.03ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.03ms 20.0 MB/sec 1.02 6.3±0.04ms 19.7 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.5 MB/sec 1.03 3.8±0.04ms 32.6 MB/sec bool_non_null/parquet_2 1.00 8.5±0.02ms 14.7 MB/sec 1.01 8.6±0.03ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.6 MB/sec 1.02 4.2±0.04ms 29.8 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.03ms 14.1 MB/sec 1.01 9.0±0.02ms 13.9 MB/sec bool_ree/bloom_filter 1.00 30.2±0.09ms 7.1 MB/sec 1.00 30.1±0.10ms 7.1 MB/sec bool_ree/cdc 1.01 31.6±0.08ms 6.7 MB/sec 1.00 31.3±0.11ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.09ms 7.8 MB/sec 1.01 27.5±0.09ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.07ms 7.4 MB/sec 1.00 29.0±0.08ms 7.3 MB/sec bool_ree/zstd 1.00 28.0±0.08ms 7.6 MB/sec 1.00 28.0±0.09ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.08ms 7.3 MB/sec 1.00 29.3±0.10ms 7.3 MB/sec decimal/bloom_filter 1.00 121.5±0.42ms 493.8 MB/sec 1.00 121.2±1.19ms 494.9 MB/sec decimal/cdc 1.00 101.8±0.49ms 589.1 MB/sec 1.00 101.5±0.35ms 591.2 MB/sec decimal/default 1.00 79.6±0.41ms 754.2 MB/sec 1.01 80.5±1.47ms 744.9 MB/sec decimal/parquet_2 1.00 177.3±1.32ms 338.4 MB/sec 1.00 177.8±1.53ms 337.5 MB/sec decimal/zstd 1.00 90.6±0.41ms 661.9 MB/sec 1.00 90.6±1.95ms 661.9 MB/sec decimal/zstd_parquet_2 1.00 197.7±2.63ms 303.4 MB/sec 1.00 197.7±1.67ms 303.5 MB/sec fixed_size_binary_ree/bloom_filter 1.00 59.0±0.92ms 17.1 MB/sec 1.00 59.1±0.28ms 17.0 MB/sec fixed_size_binary_ree/cdc 1.00 61.7±0.27ms 16.3 MB/sec 1.00 61.9±0.29ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.7±0.21ms 19.5 MB/sec 1.01 52.0±0.23ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.8±0.46ms 15.1 MB/sec 1.01 67.3±1.79ms 15.0 MB/sec fixed_size_binary_ree/zstd 1.00 57.4±0.96ms 17.5 MB/sec 1.01 57.9±1.00ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.9±0.27ms 15.1 MB/sec 1.01 67.2±0.26ms 15.0 MB/sec float_with_nans/bloom_filter 1.01 81.9±1.02ms 171.0 MB/sec 1.00 80.9±0.24ms 173.1 MB/sec float_with_nans/cdc 1.00 71.1±0.47ms 197.0 MB/sec 1.01 72.0±0.76ms 194.6 MB/sec float_with_nans/default 1.01 63.4±0.23ms 220.8 MB/sec 1.00 62.8±1.12ms 222.9 MB/sec float_with_nans/parquet_2 1.01 81.3±0.38ms 172.3 MB/sec 1.00 80.4±0.27ms 174.2 MB/sec float_with_nans/zstd 1.00 102.0±1.04ms 137.3 MB/sec 1.01 103.5±1.46ms 135.3 MB/sec float_with_nans/zstd_parquet_2 1.00 118.0±0.30ms 118.6 MB/sec 1.02 119.9±1.16ms 116.8 MB/sec fsb/bloom_filter 1.00 8.0±0.04ms 2010.6 MB/sec 1.00 8.0±0.03ms 2010.6 MB/sec fsb/cdc 1.00 10.4±0.03ms 1554.7 MB/sec 1.00 10.4±0.03ms 1553.8 MB/sec fsb/default 1.00 6.9±0.03ms 2.3 GB/sec 1.00 6.9±0.03ms 2.3 GB/sec fsb/parquet_2 1.00 13.3±0.05ms 1208.7 MB/sec 1.00 13.3±0.06ms 1212.9 MB/sec fsb/zstd 1.00 9.4±0.04ms 1721.0 MB/sec 1.00 9.3±0.03ms 1728.1 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.04ms 1136.5 MB/sec 1.00 14.2±0.06ms 1133.1 MB/sec int32_ree/bloom_filter 1.01 41.1±0.16ms 9.9 MB/sec 1.00 40.7±0.15ms 10.0 MB/sec int32_ree/cdc 1.00 40.3±0.09ms 10.1 MB/sec 1.02 41.0±0.13ms 9.9 MB/sec int32_ree/default 1.01 36.8±0.08ms 11.1 MB/sec 1.00 36.6±0.18ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.7±0.12ms 11.1 MB/sec 1.01 37.0±0.14ms 11.0 MB/sec int32_ree/zstd 1.00 37.1±0.08ms 11.0 MB/sec 1.01 37.5±0.11ms 10.8 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.11ms 11.0 MB/sec 1.01 37.5±0.13ms 10.8 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.0±0.06ms 18.5 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.00 23.9±0.07ms 17.0 MB/sec 1.00 24.1±0.06ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.03ms 18.8 MB/sec 1.00 21.6±0.05ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.03ms 18.8 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.04ms 18.6 MB/sec 1.00 21.9±0.02ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 21.8±0.03ms 18.7 MB/sec 1.00 21.6±0.03ms 18.8 MB/sec large_string_distinct/delta_byte_array 1.00 65.0±0.43ms 3.8 GB/sec 1.02 66.4±2.12ms 3.8 GB/sec large_string_distinct/plain 1.00 60.6±0.72ms 4.1 GB/sec 1.02 61.5±1.31ms 4.1 GB/sec large_string_non_null/bloom_filter 1.00 72.8±0.19ms 3.4 GB/sec 1.07 78.1±1.32ms 3.2 GB/sec large_string_non_null/cdc 1.00 245.5±3.83ms 1042.9 MB/sec 1.00 245.6±2.76ms 1042.3 MB/sec large_string_non_null/default 1.00 55.2±0.13ms 4.5 GB/sec 1.06 58.7±0.96ms 4.3 GB/sec large_string_non_null/parquet_2 1.00 54.9±0.12ms 4.6 GB/sec 1.07 58.8±1.22ms 4.2 GB/sec large_string_non_null/zstd 1.00 54.9±0.11ms 4.6 GB/sec 1.01 55.7±1.00ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.3±0.11ms 4.5 GB/sec 1.00 55.5±1.01ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 55.6±0.16ms 4.5 GB/sec 1.05 58.4±3.16ms 4.3 GB/sec large_string_shared_prefix/plain 1.00 93.4±0.71ms 2.7 GB/sec 1.01 94.2±0.69ms 2.7 GB/sec list_nested/bloom_filter 1.00 145.1±0.15ms 198.9 MB/sec 1.00 144.4±0.21ms 199.8 MB/sec list_nested/cdc 1.00 162.4±0.24ms 177.6 MB/sec 1.00 162.1±0.44ms 178.0 MB/sec list_nested/default 1.01 131.2±0.16ms 220.0 MB/sec 1.00 130.2±0.14ms 221.7 MB/sec list_nested/parquet_2 1.01 144.3±0.15ms 199.9 MB/sec 1.00 143.4±0.17ms 201.2 MB/sec list_nested/zstd 1.01 140.4±0.16ms 205.5 MB/sec 1.00 139.5±0.16ms 206.9 MB/sec list_nested/zstd_parquet_2 1.01 157.2±0.79ms 183.5 MB/sec 1.00 156.2±0.15ms 184.7 MB/sec list_primitive/bloom_filter 1.00 279.6±1.18ms 1950.6 MB/sec 1.00 279.4±0.74ms 1952.2 MB/sec list_primitive/cdc 1.00 312.5±2.28ms 1745.4 MB/sec 1.00 311.9±1.38ms 1748.5 MB/sec list_primitive/default 1.00 199.1±1.70ms 2.7 GB/sec 1.01 201.4±1.18ms 2.6 GB/sec list_primitive/parquet_2 1.00 224.9±0.28ms 2.4 GB/sec 1.00 224.1±0.29ms 2.4 GB/sec list_primitive/zstd 1.00 453.3±2.62ms 1203.1 MB/sec 1.01 459.4±5.51ms 1187.2 MB/sec list_primitive/zstd_parquet_2 1.00 447.1±0.36ms 1219.8 MB/sec 1.00 446.5±0.30ms 1221.4 MB/sec list_primitive_non_null/bloom_filter 1.00 376.3±5.74ms 1446.2 MB/sec 1.00 378.2±3.83ms 1439.0 MB/sec list_primitive_non_null/cdc 1.01 391.3±6.56ms 1390.9 MB/sec 1.00 387.2±9.29ms 1405.6 MB/sec list_primitive_non_null/default 1.01 241.9±4.11ms 2.2 GB/sec 1.00 238.5±4.42ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.00 266.3±10.07ms 2043.7 MB/sec 1.00 265.3±10.14ms 2.0 GB/sec list_primitive_non_null/zstd 1.01 665.5±4.13ms 817.7 MB/sec 1.00 656.8±0.63ms 828.6 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 651.0±9.61ms 836.1 MB/sec 1.00 650.4±8.63ms 836.8 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 13.1±0.19ms 2.8 GB/sec 1.00 12.7±0.04ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.1±0.06ms 1548.8 MB/sec 1.00 24.1±0.05ms 1553.3 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.17ms 3.0 GB/sec 1.01 12.4±0.03ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.4±0.06ms 2.9 GB/sec 1.00 12.4±0.02ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.3±0.06ms 2.6 GB/sec 1.00 14.3±0.04ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.06ms 2.9 GB/sec 1.00 12.6±0.03ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 281.8±0.37ms 161.8 MB/sec 1.00 280.0±0.41ms 162.9 MB/sec list_struct_with_list/cdc 1.00 319.3±0.30ms 142.8 MB/sec 1.00 319.1±0.34ms 142.9 MB/sec list_struct_with_list/default 1.01 254.9±1.77ms 178.9 MB/sec 1.00 253.5±0.35ms 179.9 MB/sec list_struct_with_list/parquet_2 1.00 272.0±0.77ms 167.6 MB/sec 1.00 270.9±0.37ms 168.3 MB/sec list_struct_with_list/zstd 1.00 276.1±0.42ms 165.1 MB/sec 1.00 275.4±0.35ms 165.6 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.9±0.46ms 154.6 MB/sec 1.00 294.1±0.34ms 155.0 MB/sec primitive/bloom_filter 1.00 146.7±0.76ms 305.9 MB/sec 1.00 147.4±0.38ms 304.5 MB/sec primitive/cdc 1.00 154.5±0.58ms 290.5 MB/sec 1.01 155.7±0.51ms 288.3 MB/sec primitive/default 1.00 114.1±0.63ms 393.4 MB/sec 1.00 114.6±0.36ms 391.5 MB/sec primitive/parquet_2 1.00 128.9±0.34ms 348.1 MB/sec 1.00 129.3±0.35ms 347.0 MB/sec primitive/zstd 1.00 143.5±0.36ms 312.6 MB/sec 1.00 144.2±0.38ms 311.2 MB/sec primitive/zstd_parquet_2 1.00 161.7±0.27ms 277.6 MB/sec 1.00 162.2±0.35ms 276.7 MB/sec primitive_all_null/bloom_filter 1.00 897.6±1.68µs 48.8 GB/sec 1.00 895.8±2.94µs 48.9 GB/sec primitive_all_null/cdc 1.00 18.4±0.41ms 2.4 GB/sec 1.04 19.2±0.35ms 2.3 GB/sec primitive_all_null/default 1.01 275.2±1.26µs 159.3 GB/sec 1.00 272.4±2.83µs 160.9 GB/sec primitive_all_null/parquet_2 1.01 284.6±1.11µs 154.0 GB/sec 1.00 281.6±2.79µs 155.6 GB/sec primitive_all_null/zstd 1.01 425.8±1.34µs 102.9 GB/sec 1.00 421.5±2.63µs 104.0 GB/sec primitive_all_null/zstd_parquet_2 1.01 386.1±0.98µs 113.5 GB/sec 1.00 382.1±2.60µs 114.7 GB/sec primitive_non_null/bloom_filter 1.00 102.1±0.38ms 431.1 MB/sec 1.00 102.5±0.37ms 429.1 MB/sec primitive_non_null/cdc 1.00 85.3±0.40ms 515.7 MB/sec 1.00 85.2±0.27ms 516.4 MB/sec primitive_non_null/default 1.00 62.2±0.19ms 707.4 MB/sec 1.00 62.3±0.15ms 706.1 MB/sec primitive_non_null/parquet_2 1.00 84.0±0.19ms 523.7 MB/sec 1.00 84.0±0.16ms 523.6 MB/sec primitive_non_null/zstd 1.00 92.7±0.17ms 474.8 MB/sec 1.00 93.0±0.17ms 473.1 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.8±0.25ms 376.7 MB/sec 1.01 117.4±0.41ms 374.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.1±0.06ms 3.6 GB/sec 1.01 12.2±0.05ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.7±0.42ms 1512.4 MB/sec 1.03 30.5±0.32ms 1469.8 MB/sec primitive_sparse_99pct_null/default 1.01 10.8±0.03ms 4.0 GB/sec 1.00 10.7±0.03ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.03ms 4.1 GB/sec 1.00 10.8±0.03ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.04ms 3.1 GB/sec 1.00 14.1±0.04ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.7±0.06ms 3.4 GB/sec 1.00 12.7±0.03ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 27.6±0.06ms 434.3 MB/sec 1.01 28.0±0.14ms 428.0 MB/sec short_string_non_null/cdc 1.00 19.9±0.07ms 602.1 MB/sec 1.01 20.2±0.10ms 594.8 MB/sec short_string_non_null/default 1.00 15.7±0.07ms 763.9 MB/sec 1.01 15.8±0.26ms 759.0 MB/sec short_string_non_null/parquet_2 1.00 26.0±0.07ms 462.3 MB/sec 1.01 26.2±0.60ms 457.4 MB/sec short_string_non_null/zstd 1.00 35.9±0.06ms 334.4 MB/sec 1.01 36.2±0.56ms 331.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.9±0.08ms 415.0 MB/sec 1.01 29.3±0.55ms 410.2 MB/sec small_string_distinct/delta_byte_array 1.00 940.8±5.38µs 8.3 GB/sec 1.03 965.3±4.94µs 8.1 GB/sec small_string_distinct/plain 1.00 752.0±2.64µs 10.4 GB/sec 1.01 758.5±3.63µs 10.3 GB/sec small_string_partial_prefix/delta_byte_array 1.00 989.1±3.25µs 7.9 GB/sec 1.03 1016.2±4.48µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 1004.8±3.03µs 7.8 GB/sec 1.01 1016.3±3.18µs 7.7 GB/sec small_string_shared_prefix/delta_byte_array 1.00 982.6±0.92µs 8.0 GB/sec 1.00 984.5±3.22µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1111.7±6.33µs 7.1 GB/sec 1.00 1115.1±4.31µs 7.0 GB/sec string/bloom_filter 1.01 211.9±20.94ms 2.4 GB/sec 1.00 210.3±21.83ms 2.4 GB/sec string/cdc 1.00 203.2±5.89ms 2.5 GB/sec 1.07 216.8±6.99ms 2.4 GB/sec string/default 1.03 116.8±19.04ms 4.4 GB/sec 1.00 113.3±15.23ms 4.5 GB/sec string/parquet_2 1.00 99.2±4.82ms 5.2 GB/sec 1.00 99.7±6.48ms 5.1 GB/sec string/zstd 1.00 413.9±5.56ms 1266.7 MB/sec 1.01 418.1±4.08ms 1253.8 MB/sec string/zstd_parquet_2 1.00 382.5±0.70ms 1370.6 MB/sec 1.02 391.8±4.65ms 1338.1 MB/sec string_and_binary_view/bloom_filter 1.00 65.9±0.29ms 489.7 MB/sec 1.06 70.1±2.09ms 460.4 MB/sec string_and_binary_view/cdc 1.01 59.7±0.21ms 540.5 MB/sec 1.00 59.0±0.16ms 546.4 MB/sec string_and_binary_view/default 1.00 48.5±0.22ms 664.5 MB/sec 1.05 51.1±1.34ms 631.2 MB/sec string_and_binary_view/parquet_2 1.00 59.8±0.15ms 539.1 MB/sec 1.03 61.8±1.09ms 522.3 MB/sec string_and_binary_view/zstd 1.00 85.8±0.22ms 375.9 MB/sec 1.04 88.9±2.17ms 362.9 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.9±0.19ms 436.5 MB/sec 1.00 73.8±1.03ms 436.8 MB/sec string_dictionary/bloom_filter 1.00 86.2±1.18ms 3.0 GB/sec 1.00 86.2±2.52ms 3.0 GB/sec string_dictionary/cdc 1.00 47.1±1.40ms 5.5 GB/sec 1.10 52.0±2.59ms 5.0 GB/sec string_dictionary/default 1.01 44.1±4.37ms 5.9 GB/sec 1.00 43.8±0.74ms 5.9 GB/sec string_dictionary/parquet_2 1.00 49.2±0.20ms 5.2 GB/sec 1.03 50.7±1.01ms 5.1 GB/sec string_dictionary/zstd 1.00 207.6±1.77ms 1272.5 MB/sec 1.06 219.9±2.74ms 1200.9 MB/sec string_dictionary/zstd_parquet_2 1.00 192.6±0.31ms 1371.4 MB/sec 1.01 194.7±1.61ms 1356.8 MB/sec string_non_null/bloom_filter 1.00 236.1±14.36ms 2.2 GB/sec 1.07 253.6±22.79ms 2.0 GB/sec string_non_null/cdc 1.03 253.5±4.66ms 2.0 GB/sec 1.00 245.2±3.18ms 2.1 GB/sec string_non_null/default 1.00 116.7±12.89ms 4.4 GB/sec 1.01 118.1±13.78ms 4.3 GB/sec string_non_null/parquet_2 1.00 120.0±13.40ms 4.3 GB/sec 1.16 139.0±7.76ms 3.7 GB/sec string_non_null/zstd 1.00 559.6±6.33ms 936.5 MB/sec 1.01 562.5±11.03ms 931.6 MB/sec string_non_null/zstd_parquet_2 1.01 504.2±3.11ms 1039.2 MB/sec 1.00 498.9±3.68ms 1050.4 MB/sec string_ree/bloom_filter 1.00 152.6±1.73ms 107.5 MB/sec 1.06 162.1±3.30ms 101.2 MB/sec string_ree/cdc 1.00 224.2±0.61ms 73.2 MB/sec 1.03 231.5±3.49ms 70.9 MB/sec string_ree/default 1.00 125.0±1.21ms 131.3 MB/sec 1.07 133.6±1.70ms 122.8 MB/sec string_ree/parquet_2 1.00 126.1±0.42ms 130.1 MB/sec 1.08 136.6±2.95ms 120.2 MB/sec string_ree/zstd 1.00 187.1±1.80ms 87.7 MB/sec 1.10 206.3±2.49ms 79.5 MB/sec string_ree/zstd_parquet_2 1.00 141.7±0.47ms 115.8 MB/sec 1.07 151.3±2.14ms 108.4 MB/sec string_ree_95pct_null/bloom_filter 1.01 26.6±0.15ms 52.9 MB/sec 1.00 26.3±0.06ms 53.4 MB/sec string_ree_95pct_null/cdc 1.00 32.7±0.14ms 43.0 MB/sec 1.00 32.7±0.06ms 43.0 MB/sec string_ree_95pct_null/default 1.01 25.0±0.08ms 56.2 MB/sec 1.00 24.8±0.05ms 56.8 MB/sec string_ree_95pct_null/parquet_2 1.01 24.9±0.08ms 56.5 MB/sec 1.00 24.8±0.04ms 56.8 MB/sec string_ree_95pct_null/zstd 1.01 25.9±0.07ms 54.3 MB/sec 1.00 25.7±0.06ms 54.8 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.8±0.08ms 54.5 MB/sec 1.00 25.6±0.06ms 55.0 MB/sec struct_all_null/bloom_filter 1.01 379.8±1.39µs 41.5 GB/sec 1.00 375.0±1.88µs 42.0 GB/sec struct_all_null/cdc 1.00 7.4±0.10ms 2.1 GB/sec 1.06 7.8±0.07ms 2.0 GB/sec struct_all_null/default 1.01 118.2±0.62µs 133.2 GB/sec 1.00 117.0±1.37µs 134.5 GB/sec struct_all_null/parquet_2 1.01 121.5±0.53µs 129.6 GB/sec 1.00 120.6±1.30µs 130.5 GB/sec struct_all_null/zstd 1.01 182.1±0.68µs 86.5 GB/sec 1.00 180.2±1.07µs 87.4 GB/sec struct_all_null/zstd_parquet_2 1.03 166.1±0.59µs 94.8 GB/sec 1.00 162.0±1.41µs 97.2 GB/sec struct_non_null/bloom_filter 1.01 44.3±0.15ms 361.0 MB/sec 1.00 43.9±0.10ms 364.7 MB/sec struct_non_null/cdc 1.00 43.2±0.18ms 370.8 MB/sec 1.00 43.2±0.14ms 370.1 MB/sec struct_non_null/default 1.00 29.8±0.08ms 536.9 MB/sec 1.00 29.8±0.09ms 537.3 MB/sec struct_non_null/parquet_2 1.00 38.6±0.12ms 414.2 MB/sec 1.00 38.7±0.20ms 413.7 MB/sec struct_non_null/zstd 1.00 38.4±0.07ms 416.9 MB/sec 1.00 38.4±0.15ms 416.6 MB/sec struct_non_null/zstd_parquet_2 1.00 52.3±0.11ms 306.0 MB/sec 1.00 52.2±0.16ms 306.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.02ms 2.4 GB/sec 1.00 6.5±0.02ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.4±0.10ms 1206.9 MB/sec 1.05 14.0±0.09ms 1149.9 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.01ms 2.6 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.01ms 2.6 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.01ms 2.1 GB/sec 1.00 7.3±0.01ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.01ms 2.3 GB/sec 1.00 6.7±0.01ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3010.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2919.2s | | CPU sys | 85.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3005.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2919.3s | | CPU sys | 80.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
