adriangbot commented on PR #25187: URL: https://github.com/apache/datafusion/pull/25187#issuecomment-6085097362
🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25187#issuecomment-6084784942) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing 8aea24b85b1e16e0c0e13773935b130e67160853 (8aea24b85b1e16e0c0e13773935b130e67160853) to 31a333da6952047803dcd93b7a80e59ef056ce8e [diff](https://github.com/apache/datafusion/compare/31a333da6952047803dcd93b7a80e59ef056ce8e..8aea24b85b1e16e0c0e13773935b130e67160853) <details><summary>Run configuration</summary> ```yaml run benchmark in_list_rewrite env: BENCH_FILTER: "^in_list_rewrite/.*/list=2$" baseline: ref: "31a333da6952047803dcd93b7a80e59ef056ce8e" changed: ref: "8aea24b85b1e16e0c0e13773935b130e67160853" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group HEAD codex_in-list-short-rewrite ----- ---- --------------------------- in_list_rewrite/fixed_size_binary_1/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 10.64 23.5±0.16µs 332.6 MElem/sec 1.00 2.2±0.02µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_1/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 10.36 23.5±0.15µs 332.6 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced/batch=8192/nulls=0%/match=50%/in/list=2 21.50 47.4±0.56µs 164.7 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 20.76 47.1±0.33µs 165.8 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 21.10 48.5±1.78µs 161.0 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 20.07 47.7±0.12µs 163.7 MElem/sec 1.00 2.4±0.01µs 3.2 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.85 1999.2±62.80ns 30.5 MElem/sec 1.00 291.7±2.29ns 209.3 MElem/sec in_list_rewrite/fixed_size_binary_1/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.22 1782.4±58.28ns 34.2 MElem/sec 1.00 341.5±2.99ns 178.7 MElem/sec in_list_rewrite/fixed_size_binary_1/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 12.93 27.1±0.37µs 288.4 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_1/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 11.34 24.4±0.09µs 319.9 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_1/miss/batch=8192/nulls=0%/match=0%/in/list=2 21.28 46.9±0.28µs 166.5 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_1/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 20.78 47.1±0.25µs 165.7 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.26 638.4±21.89ns 1529.7 KElem/sec 1.00 281.9±2.90ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_1/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.97 655.3±22.85ns 1490.3 KElem/sec 1.00 332.7±2.04ns 2.9 MElem/sec in_list_rewrite/fixed_size_binary_1/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.47 1252.8±50.04ns 779.5 KElem/sec 1.00 280.1±1.60ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_1/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.29 1430.4±55.81ns 682.7 KElem/sec 1.00 333.5±2.06ns 2.9 MElem/sec in_list_rewrite/fixed_size_binary_1/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 11.34 25.0±0.28µs 311.9 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_1/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 20.78 47.2±0.34µs 165.5 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_16/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 2.14 15.9±0.11µs 491.9 MElem/sec 1.00 7.4±0.03µs 1051.7 MElem/sec in_list_rewrite/fixed_size_binary_16/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 2.12 15.9±0.12µs 491.6 MElem/sec 1.00 7.5±0.05µs 1041.8 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced/batch=8192/nulls=0%/match=50%/in/list=2 4.39 32.6±0.29µs 239.9 MElem/sec 1.00 7.4±0.02µs 1052.7 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 4.27 32.0±0.46µs 244.3 MElem/sec 1.00 7.5±0.02µs 1042.7 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 4.31 32.5±0.51µs 240.5 MElem/sec 1.00 7.5±0.02µs 1036.4 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 4.31 32.8±0.47µs 238.1 MElem/sec 1.00 7.6±0.02µs 1027.4 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 5.99 1895.9±63.92ns 32.2 MElem/sec 1.00 316.6±1.35ns 192.8 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 4.55 1675.1±49.03ns 36.4 MElem/sec 1.00 368.4±3.03ns 165.7 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_unaligned/batch=8192/nulls=0%/match=50%/in/list=2 3.55 33.2±0.28µs 235.3 MElem/sec 1.00 9.3±0.03µs 835.9 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_unaligned/batch=8192/nulls=0%/match=50%/not_in/list=2 3.48 32.9±0.30µs 237.4 MElem/sec 1.00 9.4±0.03µs 827.0 MElem/sec in_list_rewrite/fixed_size_binary_16/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 3.93 17.0±0.07µs 458.9 MElem/sec 1.00 4.3±0.01µs 1802.8 MElem/sec in_list_rewrite/fixed_size_binary_16/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 3.83 16.8±0.14µs 463.7 MElem/sec 1.00 4.4±0.01µs 1774.6 MElem/sec in_list_rewrite/fixed_size_binary_16/miss/batch=8192/nulls=0%/match=0%/in/list=2 4.29 31.9±0.35µs 245.0 MElem/sec 1.00 7.4±0.02µs 1052.0 MElem/sec in_list_rewrite/fixed_size_binary_16/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 4.26 31.9±0.24µs 244.6 MElem/sec 1.00 7.5±0.03µs 1041.8 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.34 635.8±18.29ns 1536.0 KElem/sec 1.00 271.3±1.66ns 3.5 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 2.07 658.9±20.66ns 1482.2 KElem/sec 1.00 318.4±2.08ns 3.0 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.62 1246.9±48.10ns 783.2 KElem/sec 1.00 270.2±2.63ns 3.5 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.55 1446.8±46.38ns 675.0 KElem/sec 1.00 318.2±1.96ns 3.0 MElem/sec in_list_rewrite/fixed_size_binary_16/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 2.32 17.2±0.09µs 453.9 MElem/sec 1.00 7.4±0.03µs 1051.7 MElem/sec in_list_rewrite/fixed_size_binary_16/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 4.24 31.8±0.25µs 245.5 MElem/sec 1.00 7.5±0.13µs 1041.7 MElem/sec in_list_rewrite/fixed_size_binary_2/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 9.80 20.7±0.15µs 377.4 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 9.53 20.7±0.15µs 377.4 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced/batch=8192/nulls=0%/match=50%/in/list=2 28.90 61.0±0.49µs 128.1 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 27.70 60.5±0.43µs 129.1 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 29.36 65.1±0.32µs 120.0 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 28.31 65.3±0.40µs 119.6 MElem/sec 1.00 2.3±0.32µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.68 1970.6±60.91ns 31.0 MElem/sec 1.00 294.8±1.73ns 207.0 MElem/sec in_list_rewrite/fixed_size_binary_2/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.07 1747.2±58.29ns 34.9 MElem/sec 1.00 344.3±1.79ns 177.3 MElem/sec in_list_rewrite/fixed_size_binary_2/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 19.95 39.3±0.32µs 198.6 MElem/sec 1.00 1971.7±9.35ns 3.9 GElem/sec in_list_rewrite/fixed_size_binary_2/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 19.46 39.3±0.20µs 198.7 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/fixed_size_binary_2/miss/batch=8192/nulls=0%/match=0%/in/list=2 19.65 41.5±0.60µs 188.2 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 19.14 41.6±0.28µs 187.7 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_2/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.24 647.7±21.60ns 1507.7 KElem/sec 1.00 289.4±3.06ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_2/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.93 659.5±22.62ns 1480.8 KElem/sec 1.00 341.7±1.58ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_2/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.33 1239.3±49.79ns 788.0 KElem/sec 1.00 286.0±2.12ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_2/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.25 1445.0±52.47ns 675.8 KElem/sec 1.00 340.3±4.05ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_2/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 10.68 22.6±0.24µs 346.0 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 20.23 44.0±0.71µs 177.6 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_4/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 8.79 18.3±0.61µs 427.8 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 8.39 18.0±0.14µs 433.9 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced/batch=8192/nulls=0%/match=50%/in/list=2 17.52 36.5±0.43µs 214.2 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 16.93 36.2±0.29µs 215.9 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 16.85 36.9±0.12µs 211.9 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 16.41 36.8±0.40µs 212.6 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.47 1928.9±58.08ns 31.6 MElem/sec 1.00 298.0±1.82ns 204.8 MElem/sec in_list_rewrite/fixed_size_binary_4/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 4.93 1715.1±53.13ns 35.6 MElem/sec 1.00 347.9±2.08ns 175.4 MElem/sec in_list_rewrite/fixed_size_binary_4/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 11.18 19.0±0.06µs 412.0 MElem/sec 1.00 1695.6±5.45ns 4.5 GElem/sec in_list_rewrite/fixed_size_binary_4/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 10.69 18.9±0.06µs 414.2 MElem/sec 1.00 1763.6±5.48ns 4.3 GElem/sec in_list_rewrite/fixed_size_binary_4/miss/batch=8192/nulls=0%/match=0%/in/list=2 17.32 35.9±0.29µs 217.5 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 16.92 36.2±0.28µs 216.0 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_4/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.27 648.4±22.17ns 1506.0 KElem/sec 1.00 285.1±1.57ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_4/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.93 659.0±23.04ns 1481.8 KElem/sec 1.00 341.1±4.43ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_4/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.39 1251.7±48.10ns 780.2 KElem/sec 1.00 284.9±1.64ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_4/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.26 1440.6±49.50ns 677.9 KElem/sec 1.00 338.1±2.49ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_4/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 9.46 19.6±0.48µs 397.9 MElem/sec 1.00 2.1±0.02µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 16.92 36.2±0.28µs 215.8 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_8/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 7.02 15.4±0.12µs 507.7 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 6.89 15.7±0.38µs 498.3 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced/batch=8192/nulls=0%/match=50%/in/list=2 14.22 31.3±0.65µs 249.8 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 13.89 31.4±0.80µs 248.8 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 13.65 31.6±0.15µs 247.0 MElem/sec 1.00 2.3±0.02µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 13.32 31.4±0.08µs 248.5 MElem/sec 1.00 2.4±0.01µs 3.2 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.50 1897.3±55.05ns 32.2 MElem/sec 1.00 291.8±2.00ns 209.2 MElem/sec in_list_rewrite/fixed_size_binary_8/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 4.89 1675.3±52.78ns 36.4 MElem/sec 1.00 342.3±1.92ns 178.3 MElem/sec in_list_rewrite/fixed_size_binary_8/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 10.04 16.4±0.06µs 475.0 MElem/sec 1.00 1638.1±8.55ns 4.7 GElem/sec in_list_rewrite/fixed_size_binary_8/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 9.63 16.3±0.06µs 480.1 MElem/sec 1.00 1690.6±6.77ns 4.5 GElem/sec in_list_rewrite/fixed_size_binary_8/miss/batch=8192/nulls=0%/match=0%/in/list=2 13.96 30.7±0.28µs 254.2 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 13.69 31.0±0.27µs 252.3 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_8/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.21 636.5±21.63ns 1534.2 KElem/sec 1.00 288.0±4.28ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_8/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.93 654.0±23.02ns 1493.2 KElem/sec 1.00 338.9±3.02ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_8/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.43 1255.8±44.75ns 777.7 KElem/sec 1.00 283.5±2.00ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_8/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.19 1445.4±49.27ns 675.7 KElem/sec 1.00 344.8±4.88ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_8/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 7.69 16.9±0.37µs 461.5 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 13.69 31.0±0.25µs 252.2 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/float32/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 2.38 4.7±0.04µs 1678.2 MElem/sec 1.00 1956.6±7.16ns 3.9 GElem/sec in_list_rewrite/float32/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 2.31 4.7±0.02µs 1669.3 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float32/balanced/batch=8192/nulls=0%/match=50%/in/list=2 4.99 9.8±0.04µs 801.0 MElem/sec 1.00 1952.9±7.89ns 3.9 GElem/sec in_list_rewrite/float32/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 4.70 9.5±0.03µs 823.5 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float32/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 4.97 10.1±0.12µs 770.5 MElem/sec 1.00 2.0±0.00µs 3.7 GElem/sec in_list_rewrite/float32/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 4.75 10.1±0.06µs 774.4 MElem/sec 1.00 2.1±0.02µs 3.6 GElem/sec in_list_rewrite/float32/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 7.38 1293.8±6.87ns 47.2 MElem/sec 1.00 175.4±3.06ns 348.1 MElem/sec in_list_rewrite/float32/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 4.90 1095.6±7.12ns 55.7 MElem/sec 1.00 223.4±3.61ns 273.2 MElem/sec in_list_rewrite/float32/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 3.64 5.8±0.03µs 1357.4 MElem/sec 1.00 1582.0±6.34ns 4.8 GElem/sec in_list_rewrite/float32/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 3.44 5.7±0.03µs 1376.5 MElem/sec 1.00 1651.6±7.96ns 4.6 GElem/sec in_list_rewrite/float32/miss/batch=8192/nulls=0%/match=0%/in/list=2 4.76 9.3±0.04µs 841.4 MElem/sec 1.00 1952.0±5.33ns 3.9 GElem/sec in_list_rewrite/float32/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 4.84 9.8±0.19µs 794.9 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float32/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.39 421.2±2.38ns 2.3 MElem/sec 1.00 176.1±4.25ns 5.4 MElem/sec in_list_rewrite/float32/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 2.03 442.3±3.71ns 2.2 MElem/sec 1.00 218.3±3.99ns 4.4 MElem/sec in_list_rewrite/float32/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.49 790.9±30.17ns 1234.7 KElem/sec 1.00 176.0±4.37ns 5.4 MElem/sec in_list_rewrite/float32/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.58 990.0±4.57ns 986.5 KElem/sec 1.00 216.2±4.50ns 4.4 MElem/sec in_list_rewrite/float32/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 2.92 5.7±0.06µs 1367.7 MElem/sec 1.00 1954.4±7.07ns 3.9 GElem/sec in_list_rewrite/float32/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 4.72 9.5±0.04µs 818.5 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float64/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 2.25 4.7±0.02µs 1675.4 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 2.19 4.7±0.02µs 1668.9 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/float64/balanced/batch=8192/nulls=0%/match=50%/in/list=2 4.89 10.1±0.51µs 770.1 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 4.43 9.5±0.03µs 823.8 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/float64/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 4.68 10.2±0.04µs 767.7 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/float64/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 4.51 10.1±0.05µs 775.4 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/float64/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 7.21 1287.4±8.74ns 47.4 MElem/sec 1.00 178.6±5.24ns 341.8 MElem/sec in_list_rewrite/float64/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 4.96 1105.4±7.42ns 55.2 MElem/sec 1.00 222.7±2.15ns 274.1 MElem/sec in_list_rewrite/float64/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 3.79 5.8±0.02µs 1353.4 MElem/sec 1.00 1523.1±6.68ns 5.0 GElem/sec in_list_rewrite/float64/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 3.52 5.6±0.03µs 1404.6 MElem/sec 1.00 1581.4±5.49ns 4.8 GElem/sec in_list_rewrite/float64/miss/batch=8192/nulls=0%/match=0%/in/list=2 4.67 9.7±0.60µs 805.9 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 4.43 9.5±0.03µs 824.4 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/float64/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.35 432.6±3.33ns 2.2 MElem/sec 1.00 184.2±1.44ns 5.2 MElem/sec in_list_rewrite/float64/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 2.08 454.7±4.21ns 2.1 MElem/sec 1.00 218.2±5.10ns 4.4 MElem/sec in_list_rewrite/float64/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.53 784.5±5.67ns 1244.9 KElem/sec 1.00 173.2±2.14ns 5.5 MElem/sec in_list_rewrite/float64/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.54 1004.9±9.11ns 971.8 KElem/sec 1.00 221.2±7.25ns 4.3 MElem/sec in_list_rewrite/float64/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 2.76 5.7±0.02µs 1370.2 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 4.92 10.6±0.27µs 737.9 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/int32/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 1866.8±6.03ns 4.1 GElem/sec 1.05 1962.2±17.75ns 3.9 GElem/sec in_list_rewrite/int32/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 1865.5±5.55ns 4.1 GElem/sec 1.09 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/int32/balanced/batch=8192/nulls=0%/match=50%/in/list=2 2.08 4.1±0.02µs 1906.9 MElem/sec 1.00 1971.2±7.26ns 3.9 GElem/sec in_list_rewrite/int32/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.93 3.9±0.02µs 2005.9 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/int32/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.86 3.6±0.04µs 2.1 GElem/sec 1.00 1954.2±12.77ns 3.9 GElem/sec in_list_rewrite/int32/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.91 3.9±0.01µs 2016.6 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/int32/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.44 2.8±0.01µs 2.7 GElem/sec 1.00 1963.4±19.62ns 3.9 GElem/sec in_list_rewrite/int32/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.93 3.9±0.01µs 1999.7 MElem/sec 1.00 2.0±0.02µs 3.8 GElem/sec in_list_rewrite/int64/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 1798.7±10.42ns 4.2 GElem/sec 1.15 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 1801.0±7.63ns 4.2 GElem/sec 1.19 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/int64/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.92 4.0±0.04µs 1952.3 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.75 3.8±0.02µs 2.0 GElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/int64/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.70 3.5±0.02µs 2.2 GElem/sec 1.00 2.1±0.02µs 3.7 GElem/sec in_list_rewrite/int64/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.76 3.8±0.05µs 2.0 GElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/int64/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.37 2.8±0.04µs 2.7 GElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.77 3.8±0.02µs 2.0 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 1791.3±8.97ns 4.3 GElem/sec 1.16 2.1±0.03µs 3.7 GElem/sec in_list_rewrite/uint64/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 1802.7±8.52ns 4.2 GElem/sec 1.19 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.92 4.0±0.03µs 1963.8 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/uint64/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.76 3.8±0.02µs 2.0 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.70 3.5±0.03µs 2.2 GElem/sec 1.00 2.1±0.04µs 3.7 GElem/sec in_list_rewrite/uint64/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.76 3.8±0.02µs 2.0 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.35 2.8±0.02µs 2.7 GElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/uint64/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.76 3.8±0.01µs 2.0 GElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/utf8/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 17.7±0.19µs 441.3 MElem/sec 1.01 18.0±0.10µs 435.2 MElem/sec in_list_rewrite/utf8/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 17.7±0.16µs 440.4 MElem/sec 1.00 17.7±0.20µs 440.5 MElem/sec in_list_rewrite/utf8/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.00 36.0±0.72µs 217.1 MElem/sec 1.00 35.9±0.64µs 217.5 MElem/sec in_list_rewrite/utf8/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.00 35.6±0.37µs 219.5 MElem/sec 1.02 36.2±0.26µs 215.9 MElem/sec in_list_rewrite/utf8/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.00 35.3±0.26µs 221.0 MElem/sec 1.00 35.3±0.14µs 221.1 MElem/sec in_list_rewrite/utf8/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.00 35.7±0.41µs 219.0 MElem/sec 1.01 36.1±0.19µs 216.4 MElem/sec in_list_rewrite/utf8/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.01 19.5±0.29µs 399.9 MElem/sec 1.00 19.4±0.16µs 403.1 MElem/sec in_list_rewrite/utf8/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.00 35.7±0.31µs 218.9 MElem/sec 1.01 36.2±0.70µs 215.9 MElem/sec in_list_rewrite/utf8view_inline/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 4.6±0.02µs 1715.7 MElem/sec 1.00 4.6±0.01µs 1713.3 MElem/sec in_list_rewrite/utf8view_inline/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 4.5±0.02µs 1717.8 MElem/sec 1.00 4.6±0.02µs 1716.4 MElem/sec in_list_rewrite/utf8view_inline/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.00 9.6±0.04µs 817.7 MElem/sec 1.00 9.5±0.04µs 818.1 MElem/sec in_list_rewrite/utf8view_inline/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.00 9.3±0.03µs 841.0 MElem/sec 1.00 9.3±0.04µs 841.1 MElem/sec in_list_rewrite/utf8view_inline/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.00 9.1±0.04µs 861.7 MElem/sec 1.00 9.1±0.06µs 862.5 MElem/sec in_list_rewrite/utf8view_inline/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.00 9.3±0.02µs 841.5 MElem/sec 1.00 9.3±0.04µs 841.2 MElem/sec in_list_rewrite/utf8view_inline/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.00 5.8±0.06µs 1344.6 MElem/sec 1.00 5.8±0.02µs 1345.6 MElem/sec in_list_rewrite/utf8view_inline/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.00 9.3±0.03µs 838.8 MElem/sec 1.00 9.3±0.05µs 838.0 MElem/sec ``` </p> </details> <details><summary>Resource Usage</summary> **in_list_rewrite — base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 465.1s | | Peak memory | 65.5 MiB | | Avg memory | 21.6 MiB | | CPU user | 594.2s | | CPU sys | 1.8s | | Peak spill | 0 B | **in_list_rewrite — branch** | Metric | Value | |--------|-------| | Wall time | 460.1s | | Peak memory | 67.6 MiB | | Avg memory | 21.0 MiB | | CPU user | 584.5s | | CPU sys | 1.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
