adriangbot commented on PR #11462: URL: https://github.com/apache/arrow-rs/pull/11462#issuecomment-6068119141
🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/11462#issuecomment-6067335802) **Target:** arrow_reader_string_encoding Comparing rich-T-kid/parquet-dict-lowcard-reader-1 (55d9957a8d41647209bb4f341fff23d03c22985f) to c7f60c6 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/c7f60c612bd16ca5485cc9acddfd216c10ea9765..55d9957a8d41647209bb4f341fff23d03c22985f) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_reader_string_encoding shards: 1 ``` </details> <details><summary>Details</summary> ``` group base changed ----- ---- ------- RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.00/len=24 2.28 1100.8±0.98µs 866.4 MElem/sec 1.00 483.2±0.59µs 1973.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.00/len=8 2.27 1098.5±0.55µs 868.2 MElem/sec 1.00 484.4±1.12µs 1968.9 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.50/len=24 1.52 1769.8±0.58µs 538.9 MElem/sec 1.00 1167.0±0.97µs 817.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.50/len=8 1.52 1767.6±1.13µs 539.5 MElem/sec 1.00 1161.6±0.96µs 821.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.00/len=24 2.11 1161.7±0.82µs 820.9 MElem/sec 1.00 549.3±0.52µs 1736.1 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.00/len=8 2.12 1160.7±0.37µs 821.7 MElem/sec 1.00 547.9±0.21µs 1740.5 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.50/len=24 1.50 1823.1±7.42µs 523.1 MElem/sec 1.00 1218.5±1.33µs 782.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.50/len=8 1.49 1817.0±1.98µs 524.9 MElem/sec 1.00 1218.0±0.98µs 783.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.00/len=24 2.01 1246.6±4.90µs 765.0 MElem/sec 1.00 620.8±0.27µs 1536.3 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.00/len=8 1.99 1245.0±5.38µs 766.0 MElem/sec 1.00 627.0±0.36µs 1521.1 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.50/len=24 1.49 1851.3±2.34µs 515.1 MElem/sec 1.00 1245.0±0.58µs 766.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.50/len=8 1.49 1850.1±1.86µs 515.5 MElem/sec 1.00 1244.6±1.18µs 766.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.00/len=24 1.79 1398.0±4.82µs 682.2 MElem/sec 1.00 781.9±0.88µs 1219.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.00/len=8 1.78 1387.6±1.20µs 687.3 MElem/sec 1.00 781.1±2.64µs 1221.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.50/len=24 1.45 1987.4±2.91µs 479.9 MElem/sec 1.00 1374.9±0.60µs 693.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.50/len=8 1.45 1978.5±1.25µs 482.0 MElem/sec 1.00 1368.5±3.30µs 696.9 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.00/len=24 2.25 5.5±0.00ms 872.0 MElem/sec 1.00 2.4±0.00ms 1960.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.00/len=8 2.27 5.5±0.00ms 869.2 MElem/sec 1.00 2.4±0.00ms 1972.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.50/len=24 1.52 8.9±0.00ms 536.3 MElem/sec 1.00 5.9±0.01ms 812.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.50/len=8 1.51 8.9±0.01ms 536.4 MElem/sec 1.00 5.9±0.00ms 809.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.00/len=24 2.11 5.8±0.00ms 823.8 MElem/sec 1.00 2.7±0.01ms 1737.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.00/len=8 2.12 5.8±0.00ms 823.7 MElem/sec 1.00 2.7±0.00ms 1749.8 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.50/len=24 1.50 9.2±0.03ms 518.0 MElem/sec 1.00 6.2±0.02ms 774.7 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.50/len=8 1.49 9.2±0.00ms 521.0 MElem/sec 1.00 6.1±0.01ms 776.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.00/len=24 2.01 6.2±0.03ms 768.4 MElem/sec 1.00 3.1±0.00ms 1546.7 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.00/len=8 1.99 6.2±0.02ms 767.9 MElem/sec 1.00 3.1±0.00ms 1531.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.50/len=24 1.48 9.3±0.01ms 511.8 MElem/sec 1.00 6.3±0.01ms 755.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.50/len=8 1.48 9.3±0.01ms 512.7 MElem/sec 1.00 6.3±0.01ms 758.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.00/len=24 1.79 7.0±0.02ms 681.9 MElem/sec 1.00 3.9±0.00ms 1219.9 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.00/len=8 1.78 6.9±0.01ms 689.1 MElem/sec 1.00 3.9±0.02ms 1226.5 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.50/len=24 1.44 10.0±0.02ms 477.4 MElem/sec 1.00 6.9±0.00ms 689.4 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.50/len=8 1.43 9.9±0.01ms 480.9 MElem/sec 1.00 6.9±0.02ms 689.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.00/len=24 1.00 1011.7±0.60µs 942.7 MElem/sec 1.00 1007.4±0.52µs 946.6 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.00/len=8 1.00 1011.1±4.94µs 943.2 MElem/sec 1.00 1006.2±1.53µs 947.8 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.50/len=24 1.00 1411.9±0.53µs 675.4 MElem/sec 1.00 1414.2±1.38µs 674.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.50/len=8 1.00 1408.7±0.39µs 677.0 MElem/sec 1.00 1412.0±1.26µs 675.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.00/len=24 1.00 1072.8±1.77µs 889.0 MElem/sec 1.00 1074.5±1.18µs 887.5 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.00/len=8 1.00 1071.3±0.64µs 890.2 MElem/sec 1.00 1072.7±0.58µs 889.0 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.50/len=24 1.00 1445.6±5.33µs 659.7 MElem/sec 1.00 1448.7±1.38µs 658.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.50/len=8 1.00 1440.6±3.67µs 662.0 MElem/sec 1.00 1444.2±2.06µs 660.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.00/len=24 1.00 1145.5±0.65µs 832.6 MElem/sec 1.00 1146.5±0.29µs 831.8 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.00/len=8 1.00 1146.2±0.91µs 832.0 MElem/sec 1.00 1145.3±0.42µs 832.7 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.50/len=24 1.00 1488.1±0.83µs 640.8 MElem/sec 1.00 1493.9±1.09µs 638.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.50/len=8 1.00 1489.8±0.28µs 640.1 MElem/sec 1.00 1489.8±2.22µs 640.1 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.00/len=24 1.04 1545.0±1.95µs 617.3 MElem/sec 1.00 1483.7±1.16µs 642.8 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.00/len=8 1.04 1528.2±1.62µs 624.1 MElem/sec 1.00 1475.2±1.60µs 646.5 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.50/len=24 1.00 1702.3±1.02µs 560.2 MElem/sec 1.00 1694.0±1.61µs 563.0 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.50/len=8 1.01 1703.6±1.60µs 559.8 MElem/sec 1.00 1686.6±1.63µs 565.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.00/len=24 1.00 5.0±0.00ms 948.1 MElem/sec 1.00 5.0±0.00ms 947.0 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.00/len=8 1.00 5.0±0.00ms 945.6 MElem/sec 1.00 5.0±0.00ms 947.9 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.50/len=24 1.00 7.1±0.00ms 668.9 MElem/sec 1.00 7.1±0.01ms 667.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.50/len=8 1.00 7.1±0.00ms 670.6 MElem/sec 1.01 7.2±0.00ms 666.1 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.00/len=24 1.00 5.4±0.00ms 891.0 MElem/sec 1.00 5.4±0.00ms 889.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.00/len=8 1.00 5.4±0.00ms 891.2 MElem/sec 1.00 5.4±0.00ms 890.7 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.50/len=24 1.00 7.3±0.02ms 653.2 MElem/sec 1.02 7.4±0.02ms 642.0 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.50/len=8 1.00 7.3±0.00ms 652.6 MElem/sec 1.01 7.4±0.01ms 645.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.00/len=24 1.01 5.7±0.00ms 829.9 MElem/sec 1.00 5.7±0.00ms 834.8 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.00/len=8 1.01 5.7±0.00ms 830.2 MElem/sec 1.00 5.7±0.00ms 835.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.50/len=24 1.00 7.5±0.00ms 634.2 MElem/sec 1.01 7.6±0.01ms 628.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.50/len=8 1.00 7.5±0.01ms 633.5 MElem/sec 1.01 7.6±0.00ms 625.5 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.00/len=24 1.03 7.8±0.01ms 613.0 MElem/sec 1.00 7.5±0.01ms 633.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.00/len=8 1.03 7.7±0.02ms 618.2 MElem/sec 1.00 7.5±0.01ms 639.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.50/len=24 1.00 8.7±0.01ms 550.4 MElem/sec 1.00 8.6±0.01ms 552.9 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.50/len=8 1.00 8.6±0.01ms 552.7 MElem/sec 1.00 8.6±0.01ms 555.1 MElem/sec ``` </details> <details><summary>Per-runner information</summary> <details><summary>arrow_reader_string_encoding — shard 1/1</summary> **Node:** gk3-benchmark-cluster-nap-101n84r4-9ad7f920-crw5 **Instance:** c4a-highmem-16 (12 vCPU / 65 GiB) **uname:** ```text Linux bench-c6067335802-3207-9vwwl 6.12.94+ #1 SMP Fri Aug 21 08:00:16 UTC 2026 aarch64 GNU/Linux ``` **BENCH_COMMAND:** ```sh cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_string_encoding ``` <details><summary>CPU Details (lscpu)</summary> ```text Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 625.1s | | Peak memory | 209.4 MiB | | Avg memory | 47.9 MiB | | CPU user | 618.5s | | CPU sys | 0.9s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 610.1s | | Peak memory | 98.6 MiB | | Avg memory | 47.4 MiB | | CPU user | 606.8s | | CPU sys | 0.9s | | Peak spill | 0 B | </details> </details> </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner <!-- benchmark-request:6067335802:finish:8e849daa18b51cf5aef5827a37730310 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
