adriangbot commented on PR #25187: URL: https://github.com/apache/datafusion/pull/25187#issuecomment-6063670279
🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25187#issuecomment-6063390961) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing 61e15e2249467a07ecc592fdcb5d932beabac1d9 (61e15e2249467a07ecc592fdcb5d932beabac1d9) to 0c427448bb90240023770c81ecbbe1e3bb9129d6 [diff](https://github.com/apache/datafusion/compare/0c427448bb90240023770c81ecbbe1e3bb9129d6..61e15e2249467a07ecc592fdcb5d932beabac1d9) <details><summary>Run configuration</summary> ```yaml run benchmark in_list_rewrite env: BENCH_FILTER: "^in_list_rewrite/.*/list=2$" baseline: ref: "0c427448bb90240023770c81ecbbe1e3bb9129d6" changed: ref: "61e15e2249467a07ecc592fdcb5d932beabac1d9" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group HEAD codex_in-list-short-rewrite ----- ---- --------------------------- in_list_rewrite/fixed_size_binary_1/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 10.58 23.6±0.16µs 331.5 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 10.32 23.6±0.14µs 331.4 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced/batch=8192/nulls=0%/match=50%/in/list=2 21.40 47.6±0.52µs 164.1 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 20.79 47.6±0.39µs 164.2 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 20.82 48.4±0.40µs 161.6 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 20.45 48.7±1.31µs 160.4 MElem/sec 1.00 2.4±0.01µs 3.2 GElem/sec in_list_rewrite/fixed_size_binary_1/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 7.02 2.0±0.42µs 29.9 MElem/sec 1.00 290.9±1.68ns 209.8 MElem/sec in_list_rewrite/fixed_size_binary_1/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.81 2.0±0.07µs 30.5 MElem/sec 1.00 344.2±1.78ns 177.3 MElem/sec in_list_rewrite/fixed_size_binary_1/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 12.42 26.0±0.87µs 300.1 MElem/sec 1.00 2.1±0.00µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_1/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 11.45 24.7±0.07µs 316.9 MElem/sec 1.00 2.2±0.00µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_1/miss/batch=8192/nulls=0%/match=0%/in/list=2 21.18 47.1±0.44µs 165.8 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 20.53 47.1±0.27µs 166.0 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_1/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.32 651.2±27.53ns 1499.7 KElem/sec 1.00 280.2±1.40ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_1/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.95 646.2±26.86ns 1511.2 KElem/sec 1.00 332.2±1.78ns 2.9 MElem/sec in_list_rewrite/fixed_size_binary_1/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.48 1260.1±47.99ns 775.0 KElem/sec 1.00 281.2±1.49ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_1/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 3.78 1267.5±57.21ns 770.4 KElem/sec 1.00 335.2±2.36ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_1/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 11.35 25.2±0.35µs 309.8 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_1/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 11.20 25.6±1.17µs 304.7 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_16/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 2.14 15.9±0.12µs 492.7 MElem/sec 1.00 7.4±0.02µs 1054.0 MElem/sec in_list_rewrite/fixed_size_binary_16/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 2.12 15.9±0.16µs 491.7 MElem/sec 1.00 7.5±0.02µs 1041.0 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced/batch=8192/nulls=0%/match=50%/in/list=2 4.33 32.2±0.32µs 242.9 MElem/sec 1.00 7.4±0.02µs 1051.9 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 4.29 32.1±0.24µs 243.2 MElem/sec 1.00 7.5±0.02µs 1042.4 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 4.31 32.5±0.08µs 240.7 MElem/sec 1.00 7.5±0.01µs 1036.1 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 4.27 32.5±0.07µs 240.6 MElem/sec 1.00 7.6±0.04µs 1026.5 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 5.95 1883.0±67.11ns 32.4 MElem/sec 1.00 316.7±1.87ns 192.7 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.15 1900.7±64.22ns 32.1 MElem/sec 1.00 368.8±2.01ns 165.5 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_unaligned/batch=8192/nulls=0%/match=50%/in/list=2 3.53 32.9±0.32µs 237.3 MElem/sec 1.00 9.3±0.02µs 837.1 MElem/sec in_list_rewrite/fixed_size_binary_16/balanced_unaligned/batch=8192/nulls=0%/match=50%/not_in/list=2 3.51 32.9±0.30µs 237.4 MElem/sec 1.00 9.4±0.02µs 833.5 MElem/sec in_list_rewrite/fixed_size_binary_16/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 3.88 16.8±0.08µs 463.7 MElem/sec 1.00 4.3±0.01µs 1799.8 MElem/sec in_list_rewrite/fixed_size_binary_16/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 3.84 16.9±0.04µs 461.7 MElem/sec 1.00 4.4±0.02µs 1772.0 MElem/sec in_list_rewrite/fixed_size_binary_16/miss/batch=8192/nulls=0%/match=0%/in/list=2 4.29 31.7±0.39µs 246.6 MElem/sec 1.00 7.4±0.02µs 1057.2 MElem/sec in_list_rewrite/fixed_size_binary_16/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 4.22 31.7±0.26µs 246.6 MElem/sec 1.00 7.5±0.02µs 1041.2 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.38 647.9±29.14ns 1507.4 KElem/sec 1.00 272.3±1.69ns 3.5 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 2.06 651.5±29.22ns 1498.9 KElem/sec 1.00 315.6±2.38ns 3.0 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.66 1271.5±64.36ns 768.1 KElem/sec 1.00 272.9±4.05ns 3.5 MElem/sec in_list_rewrite/fixed_size_binary_16/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 4.01 1280.5±63.87ns 762.6 KElem/sec 1.00 319.0±1.95ns 3.0 MElem/sec in_list_rewrite/fixed_size_binary_16/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 2.35 17.4±0.05µs 450.0 MElem/sec 1.00 7.4±0.02µs 1056.6 MElem/sec in_list_rewrite/fixed_size_binary_16/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 2.31 17.3±0.04µs 452.3 MElem/sec 1.00 7.5±0.03µs 1045.2 MElem/sec in_list_rewrite/fixed_size_binary_2/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 9.80 20.7±0.15µs 376.6 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 9.51 20.7±0.15µs 376.5 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced/batch=8192/nulls=0%/match=50%/in/list=2 28.90 61.2±0.56µs 127.7 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 28.00 61.0±0.69µs 128.1 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 29.61 65.7±0.47µs 118.9 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 28.73 65.3±0.39µs 119.6 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_2/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.55 1988.6±73.58ns 30.7 MElem/sec 1.00 303.8±5.46ns 200.9 MElem/sec in_list_rewrite/fixed_size_binary_2/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.75 1989.7±73.10ns 30.7 MElem/sec 1.00 346.1±2.42ns 176.4 MElem/sec in_list_rewrite/fixed_size_binary_2/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 20.34 40.0±0.17µs 195.5 MElem/sec 1.00 1964.3±7.02ns 3.9 GElem/sec in_list_rewrite/fixed_size_binary_2/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 19.70 39.8±0.28µs 196.4 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/fixed_size_binary_2/miss/batch=8192/nulls=0%/match=0%/in/list=2 19.98 42.3±0.93µs 184.6 MElem/sec 1.00 2.1±0.00µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 19.00 41.4±0.28µs 188.5 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_2/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.29 654.9±26.39ns 1491.1 KElem/sec 1.00 285.9±1.47ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_2/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.88 639.2±27.65ns 1527.8 KElem/sec 1.00 339.2±1.99ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_2/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.54 1301.6±320.72ns 750.3 KElem/sec 1.00 286.8±1.98ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_2/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 3.65 1266.3±59.71ns 771.2 KElem/sec 1.00 346.8±5.23ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_2/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 10.73 22.7±0.43µs 343.6 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_2/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 10.40 22.6±0.44µs 344.9 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_4/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 9.05 18.8±0.14µs 416.4 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 8.43 18.0±0.17µs 433.5 MElem/sec 1.00 2.1±0.00µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced/batch=8192/nulls=0%/match=50%/in/list=2 17.56 36.5±0.28µs 214.2 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 17.08 36.5±0.32µs 214.1 MElem/sec 1.00 2.1±0.00µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 16.95 36.9±0.11µs 211.8 MElem/sec 1.00 2.2±0.00µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 17.12 38.4±0.90µs 203.4 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_4/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.47 1922.0±66.71ns 31.8 MElem/sec 1.00 297.0±1.68ns 205.5 MElem/sec in_list_rewrite/fixed_size_binary_4/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.54 1927.6±73.52ns 31.7 MElem/sec 1.00 348.1±1.70ns 175.3 MElem/sec in_list_rewrite/fixed_size_binary_4/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 11.33 19.4±0.54µs 403.1 MElem/sec 1.00 1710.2±9.77ns 4.5 GElem/sec in_list_rewrite/fixed_size_binary_4/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 10.79 19.0±0.05µs 410.9 MElem/sec 1.00 1761.9±5.30ns 4.3 GElem/sec in_list_rewrite/fixed_size_binary_4/miss/batch=8192/nulls=0%/match=0%/in/list=2 17.37 36.0±0.35µs 216.9 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 17.34 37.1±1.10µs 210.8 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_4/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.27 645.6±29.08ns 1512.7 KElem/sec 1.00 284.4±1.57ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_4/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.93 650.4±31.65ns 1501.6 KElem/sec 1.00 336.4±1.59ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_4/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.40 1255.4±55.79ns 777.9 KElem/sec 1.00 285.1±1.57ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_4/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 3.78 1263.7±59.79ns 772.8 KElem/sec 1.00 334.5±3.51ns 2.9 MElem/sec in_list_rewrite/fixed_size_binary_4/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 9.47 19.6±0.30µs 398.6 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/fixed_size_binary_4/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 9.14 19.5±0.43µs 399.7 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/fixed_size_binary_8/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 7.16 15.6±0.12µs 499.3 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 6.80 15.4±0.13µs 506.3 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced/batch=8192/nulls=0%/match=50%/in/list=2 14.25 31.3±0.26µs 249.5 MElem/sec 1.00 2.2±0.00µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 13.84 31.3±0.25µs 249.4 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 13.73 31.6±0.09µs 247.0 MElem/sec 1.00 2.3±0.01µs 3.3 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 13.40 31.7±0.14µs 246.7 MElem/sec 1.00 2.4±0.01µs 3.2 GElem/sec in_list_rewrite/fixed_size_binary_8/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.50 1904.9±75.32ns 32.0 MElem/sec 1.00 293.1±1.87ns 208.2 MElem/sec in_list_rewrite/fixed_size_binary_8/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.53 1897.8±68.87ns 32.2 MElem/sec 1.00 343.4±1.49ns 177.7 MElem/sec in_list_rewrite/fixed_size_binary_8/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 10.13 16.5±0.05µs 472.3 MElem/sec 1.00 1633.1±6.15ns 4.7 GElem/sec in_list_rewrite/fixed_size_binary_8/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 10.33 17.4±0.10µs 448.9 MElem/sec 1.00 1683.9±9.55ns 4.5 GElem/sec in_list_rewrite/fixed_size_binary_8/miss/batch=8192/nulls=0%/match=0%/in/list=2 14.01 30.8±0.27µs 253.3 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 13.67 30.8±0.31µs 253.3 MElem/sec 1.00 2.3±0.00µs 3.4 GElem/sec in_list_rewrite/fixed_size_binary_8/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.29 649.9±26.46ns 1502.7 KElem/sec 1.00 284.3±1.26ns 3.4 MElem/sec in_list_rewrite/fixed_size_binary_8/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.87 647.3±31.00ns 1508.7 KElem/sec 1.00 345.7±4.84ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_8/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.39 1267.6±65.58ns 770.4 KElem/sec 1.00 289.1±6.51ns 3.3 MElem/sec in_list_rewrite/fixed_size_binary_8/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 3.74 1269.3±66.26ns 769.4 KElem/sec 1.00 339.0±2.10ns 2.8 MElem/sec in_list_rewrite/fixed_size_binary_8/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 7.74 17.0±0.25µs 459.5 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/fixed_size_binary_8/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 7.48 16.9±0.27µs 461.7 MElem/sec 1.00 2.3±0.01µs 3.4 GElem/sec in_list_rewrite/float32/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 2.38 4.7±0.02µs 1675.3 MElem/sec 1.00 1957.0±4.78ns 3.9 GElem/sec in_list_rewrite/float32/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 2.38 4.8±0.26µs 1625.6 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float32/balanced/batch=8192/nulls=0%/match=50%/in/list=2 4.96 9.7±0.03µs 806.7 MElem/sec 1.00 1953.5±3.97ns 3.9 GElem/sec in_list_rewrite/float32/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 4.77 9.7±0.04µs 809.1 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float32/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 4.98 10.1±0.04µs 770.9 MElem/sec 1.00 2.0±0.00µs 3.8 GElem/sec in_list_rewrite/float32/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 4.85 10.2±0.13µs 764.0 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/float32/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 7.07 1249.2±12.07ns 48.9 MElem/sec 1.00 176.8±1.63ns 345.2 MElem/sec in_list_rewrite/float32/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.69 1255.4±10.08ns 48.6 MElem/sec 1.00 220.7±1.91ns 276.6 MElem/sec in_list_rewrite/float32/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 3.60 5.7±0.05µs 1370.6 MElem/sec 1.00 1583.0±5.21ns 4.8 GElem/sec in_list_rewrite/float32/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 3.47 5.7±0.02µs 1370.3 MElem/sec 1.00 1642.3±6.93ns 4.6 GElem/sec in_list_rewrite/float32/miss/batch=8192/nulls=0%/match=0%/in/list=2 4.72 9.2±0.03µs 846.0 MElem/sec 1.00 1956.6±4.26ns 3.9 GElem/sec in_list_rewrite/float32/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 4.56 9.2±0.04µs 845.2 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float32/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.31 420.4±2.94ns 2.3 MElem/sec 1.00 182.2±6.99ns 5.2 MElem/sec in_list_rewrite/float32/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.91 420.2±3.26ns 2.3 MElem/sec 1.00 220.0±6.26ns 4.3 MElem/sec in_list_rewrite/float32/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.59 793.4±8.95ns 1230.8 KElem/sec 1.00 172.7±1.55ns 5.5 MElem/sec in_list_rewrite/float32/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 3.61 793.3±7.06ns 1231.0 KElem/sec 1.00 219.5±7.68ns 4.3 MElem/sec in_list_rewrite/float32/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 2.90 5.7±0.05µs 1377.7 MElem/sec 1.00 1952.6±6.08ns 3.9 GElem/sec in_list_rewrite/float32/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 2.77 5.6±0.03µs 1396.4 MElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/float64/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 2.28 4.7±0.19µs 1663.8 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 2.16 4.6±0.02µs 1696.8 MElem/sec 1.00 2.1±0.02µs 3.6 GElem/sec in_list_rewrite/float64/balanced/batch=8192/nulls=0%/match=50%/in/list=2 4.69 9.6±0.05µs 811.2 MElem/sec 1.00 2.1±0.00µs 3.7 GElem/sec in_list_rewrite/float64/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 4.52 9.6±0.09µs 812.4 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/float64/balanced_nullable/batch=8192/nulls=20%/match=50%/in/list=2 4.64 10.1±0.04µs 776.6 MElem/sec 1.00 2.2±0.01µs 3.5 GElem/sec in_list_rewrite/float64/balanced_nullable/batch=8192/nulls=20%/match=50%/not_in/list=2 4.52 10.1±0.06µs 773.9 MElem/sec 1.00 2.2±0.01µs 3.4 GElem/sec in_list_rewrite/float64/balanced_small_batch/batch=64/nulls=0%/match=50%/in/list=2 6.97 1233.1±8.35ns 49.5 MElem/sec 1.00 176.8±1.71ns 345.1 MElem/sec in_list_rewrite/float64/balanced_small_batch/batch=64/nulls=0%/match=50%/not_in/list=2 5.58 1251.8±15.94ns 48.8 MElem/sec 1.00 224.3±5.82ns 272.1 MElem/sec in_list_rewrite/float64/list_null_balanced/batch=8192/nulls=0%/match=50%/in/list=2 3.78 5.8±0.03µs 1357.1 MElem/sec 1.00 1524.4±4.42ns 5.0 GElem/sec in_list_rewrite/float64/list_null_balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 3.66 5.8±0.06µs 1355.3 MElem/sec 1.00 1576.8±6.12ns 4.8 GElem/sec in_list_rewrite/float64/miss/batch=8192/nulls=0%/match=0%/in/list=2 4.43 9.1±0.03µs 856.7 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 4.30 9.2±0.09µs 853.6 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/float64/single_row_hit/batch=1/nulls=0%/match=100%/in/list=2 2.37 408.6±2.70ns 2.3 MElem/sec 1.00 172.5±1.65ns 5.5 MElem/sec in_list_rewrite/float64/single_row_hit/batch=1/nulls=0%/match=100%/not_in/list=2 1.92 412.4±5.14ns 2.3 MElem/sec 1.00 215.0±1.32ns 4.4 MElem/sec in_list_rewrite/float64/single_row_miss/batch=1/nulls=0%/match=0%/in/list=2 4.34 750.0±6.68ns 1302.2 KElem/sec 1.00 172.7±1.64ns 5.5 MElem/sec in_list_rewrite/float64/single_row_miss/batch=1/nulls=0%/match=0%/not_in/list=2 3.40 748.8±7.15ns 1304.1 KElem/sec 1.00 220.0±3.11ns 4.3 MElem/sec in_list_rewrite/float64/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 2.76 5.7±0.03µs 1377.3 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/float64/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 2.61 5.6±0.09µs 1399.0 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/int32/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 1864.3±6.11ns 4.1 GElem/sec 1.06 1967.9±6.40ns 3.9 GElem/sec in_list_rewrite/int32/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 1860.5±26.50ns 4.1 GElem/sec 1.09 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/int32/balanced/batch=8192/nulls=0%/match=50%/in/list=2 2.08 4.1±0.01µs 1924.5 MElem/sec 1.00 1953.7±5.13ns 3.9 GElem/sec in_list_rewrite/int32/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 2.02 4.1±0.02µs 1908.3 MElem/sec 1.00 2.0±0.02µs 3.8 GElem/sec in_list_rewrite/int32/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.85 3.6±0.01µs 2.1 GElem/sec 1.00 1952.7±4.44ns 3.9 GElem/sec in_list_rewrite/int32/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.81 3.6±0.04µs 2.1 GElem/sec 1.00 2.0±0.00µs 3.8 GElem/sec in_list_rewrite/int32/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.45 2.8±0.02µs 2.7 GElem/sec 1.00 1958.7±3.70ns 3.9 GElem/sec in_list_rewrite/int32/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.37 2.8±0.02µs 2.8 GElem/sec 1.00 2.0±0.01µs 3.8 GElem/sec in_list_rewrite/int64/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 1793.6±4.38ns 4.3 GElem/sec 1.15 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 1788.6±6.86ns 4.3 GElem/sec 1.20 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/int64/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.92 4.0±0.01µs 1974.8 MElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.85 4.0±0.01µs 1973.5 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/int64/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.71 3.5±0.01µs 2.2 GElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.64 3.5±0.01µs 2.2 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/int64/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.35 2.8±0.01µs 2.7 GElem/sec 1.00 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/int64/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.28 2.7±0.02µs 2.8 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 1780.1±4.60ns 4.3 GElem/sec 1.16 2.1±0.01µs 3.7 GElem/sec in_list_rewrite/uint64/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 1785.5±5.30ns 4.3 GElem/sec 1.19 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.93 4.0±0.02µs 1976.4 MElem/sec 1.00 2.1±0.00µs 3.7 GElem/sec in_list_rewrite/uint64/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.86 3.9±0.02µs 1978.9 MElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.71 3.5±0.01µs 2.2 GElem/sec 1.00 2.1±0.00µs 3.7 GElem/sec in_list_rewrite/uint64/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.65 3.5±0.01µs 2.2 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/uint64/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.36 2.8±0.02µs 2.7 GElem/sec 1.00 2.1±0.00µs 3.7 GElem/sec in_list_rewrite/uint64/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.28 2.7±0.02µs 2.8 GElem/sec 1.00 2.1±0.01µs 3.6 GElem/sec in_list_rewrite/utf8/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.01 17.8±0.25µs 438.9 MElem/sec 1.00 17.7±0.07µs 442.4 MElem/sec in_list_rewrite/utf8/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.02 18.1±0.34µs 432.5 MElem/sec 1.00 17.7±0.24µs 441.5 MElem/sec in_list_rewrite/utf8/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.00 35.9±0.33µs 217.7 MElem/sec 1.00 35.8±0.20µs 218.2 MElem/sec in_list_rewrite/utf8/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.00 35.9±0.32µs 217.9 MElem/sec 1.00 35.8±0.31µs 218.2 MElem/sec in_list_rewrite/utf8/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.00 35.4±0.39µs 220.4 MElem/sec 1.00 35.3±0.19µs 221.3 MElem/sec in_list_rewrite/utf8/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.00 35.3±0.23µs 221.1 MElem/sec 1.00 35.3±0.18µs 221.4 MElem/sec in_list_rewrite/utf8/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.00 19.5±0.18µs 401.4 MElem/sec 1.00 19.5±0.18µs 401.6 MElem/sec in_list_rewrite/utf8/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.00 19.4±0.21µs 403.0 MElem/sec 1.00 19.4±0.18µs 403.0 MElem/sec in_list_rewrite/utf8view_inline/all_first_hit/batch=8192/nulls=0%/match=100%/in/list=2 1.00 4.6±0.01µs 1714.1 MElem/sec 1.00 4.6±0.02µs 1712.5 MElem/sec in_list_rewrite/utf8view_inline/all_first_hit/batch=8192/nulls=0%/match=100%/not_in/list=2 1.00 4.6±0.01µs 1714.7 MElem/sec 1.00 4.6±0.01µs 1711.9 MElem/sec in_list_rewrite/utf8view_inline/balanced/batch=8192/nulls=0%/match=50%/in/list=2 1.00 9.5±0.02µs 820.2 MElem/sec 1.00 9.5±0.06µs 818.6 MElem/sec in_list_rewrite/utf8view_inline/balanced/batch=8192/nulls=0%/match=50%/not_in/list=2 1.00 9.5±0.04µs 818.3 MElem/sec 1.00 9.5±0.06µs 819.1 MElem/sec in_list_rewrite/utf8view_inline/miss/batch=8192/nulls=0%/match=0%/in/list=2 1.00 9.1±0.03µs 861.4 MElem/sec 1.00 9.1±0.04µs 861.3 MElem/sec in_list_rewrite/utf8view_inline/miss/batch=8192/nulls=0%/match=0%/not_in/list=2 1.00 9.1±0.02µs 860.9 MElem/sec 1.00 9.1±0.02µs 860.8 MElem/sec in_list_rewrite/utf8view_inline/skewed_hit/batch=8192/nulls=0%/match=99%/in/list=2 1.00 5.8±0.02µs 1354.5 MElem/sec 1.00 5.8±0.05µs 1348.8 MElem/sec in_list_rewrite/utf8view_inline/skewed_hit/batch=8192/nulls=0%/match=99%/not_in/list=2 1.00 5.7±0.02µs 1367.4 MElem/sec 1.00 5.7±0.03µs 1372.8 MElem/sec ``` </p> </details> <details><summary>Resource Usage</summary> **in_list_rewrite — base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 335.1s | | Peak memory | 67.2 MiB | | Avg memory | 30.4 MiB | | CPU user | 591.1s | | CPU sys | 1.8s | | Peak spill | 0 B | **in_list_rewrite — branch** | Metric | Value | |--------|-------| | Wall time | 325.1s | | Peak memory | 64.0 MiB | | Avg memory | 28.3 MiB | | CPU user | 587.5s | | CPU sys | 1.8s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
