Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-23 Thread via GitHub


theirix commented on code in PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#discussion_r3133196539


##
datafusion/functions-nested/benches/array_remove.rs:
##
@@ -348,66 +373,6 @@ fn create_args(list_array: ArrayRef, element: ScalarValue) 
-> Vec
 ]
 }
 
-fn create_int64_list_array(
-num_rows: usize,
-array_size: usize,
-null_density: f64,
-) -> ArrayRef {
-let mut rng = StdRng::seed_from_u64(SEED);
-let values = (0..num_rows * array_size)
-.map(|_| {
-if rng.random::() < null_density {
-None
-} else {
-Some(rng.random_range(0..array_size as i64))
-}
-})
-.collect::();
-let offsets = (0..=num_rows)
-.map(|i| (i * array_size) as i32)
-.collect::>();
-
-Arc::new(
-ListArray::try_new(
-Arc::new(Field::new("item", DataType::Int64, true)),
-OffsetBuffer::new(offsets.into()),
-Arc::new(values),
-None,
-)
-.unwrap(),
-)
-}
-
-fn create_f64_list_array(
-num_rows: usize,
-array_size: usize,
-null_density: f64,
-) -> ArrayRef {
-let mut rng = StdRng::seed_from_u64(SEED);
-let values = (0..num_rows * array_size)
-.map(|_| {
-if rng.random::() < null_density {
-None
-} else {
-Some(rng.random_range(0..array_size as i64) as f64)

Review Comment:
   I agree, we should be careful. For this reason, I avoided migrating most 
candidate helpers. Good catch about `array_remove` - I removed it in the linked 
PR @21810



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-23 Thread via GitHub


Jefffrey commented on code in PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#discussion_r3129631052


##
datafusion/functions-nested/benches/array_remove.rs:
##
@@ -348,66 +373,6 @@ fn create_args(list_array: ArrayRef, element: ScalarValue) 
-> Vec
 ]
 }
 
-fn create_int64_list_array(
-num_rows: usize,
-array_size: usize,
-null_density: f64,
-) -> ArrayRef {
-let mut rng = StdRng::seed_from_u64(SEED);
-let values = (0..num_rows * array_size)
-.map(|_| {
-if rng.random::() < null_density {
-None
-} else {
-Some(rng.random_range(0..array_size as i64))
-}
-})
-.collect::();
-let offsets = (0..=num_rows)
-.map(|i| (i * array_size) as i32)
-.collect::>();
-
-Arc::new(
-ListArray::try_new(
-Arc::new(Field::new("item", DataType::Int64, true)),
-OffsetBuffer::new(offsets.into()),
-Arc::new(values),
-None,
-)
-.unwrap(),
-)
-}
-
-fn create_f64_list_array(
-num_rows: usize,
-array_size: usize,
-null_density: f64,
-) -> ArrayRef {
-let mut rng = StdRng::seed_from_u64(SEED);
-let values = (0..num_rows * array_size)
-.map(|_| {
-if rng.random::() < null_density {
-None
-} else {
-Some(rng.random_range(0..array_size as i64) as f64)

Review Comment:
   Looking back at this, I think we lost some functionality, specifically in 
being able to set a range of values to generate, which can affect some of these 
benchmarks 🤔
   
   Might need to revisit this PR to see if we should revert some of these 
changes @theirix 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-19 Thread via GitHub


theirix commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4275902908

   Thank you for the reviews!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-19 Thread via GitHub


Jefffrey merged PR #21544:
URL: https://github.com/apache/datafusion/pull/21544


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-19 Thread via GitHub


Jefffrey commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4275854238

   Thanks @theirix 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


theirix commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4263283323

   > run benchmark array_repeat
   
   Ah, now I remember. When I tried to run this benchmark on main, it was 
already broken since  REPEAT_COUNTS was unsigned. I changed it in this PR so 
the benchmarks can run.
   
   I can't recall whether there is any GHA to run all benchmarks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4262748084

   Benchmark for [this 
request](https://github.com/apache/datafusion/pull/21544#issuecomment-4262700896)
 failed.
   
   Last 20 lines of output:
   Click to expand
   
   ```
* [new ref] refs/pull/21544/head -> use-bench-utils
* branchmain -> FETCH_HEAD
   Switched to branch 'use-bench-utils'
   1f0faf92cc4437ddb806a027a5ea15ebd27effba
   Cloning into '/workspace/datafusion-base'...
   HEAD is now at 1f0faf9 perf : Optimize count distinct using bitmaps instead 
of hashsets for smaller datatypes (#21456)
   rustc 1.94.1 (e408947bf 2026-03-25)
   1d943793b97de9760863f7f0e925a8e09fd55a87
   1f0faf92cc4437ddb806a027a5ea15ebd27effba
   
   Finished `bench` profile [optimized] target(s) in 0.28s
Running benches/array_repeat.rs 
(target/release/deps/array_repeat-07830ea8f6c1c365)
   Gnuplot not found, using plotters backend
   Benchmarking array_repeat_int64/repeat_5_count/100
   Benchmarking array_repeat_int64/repeat_5_count/100: Warming up for 3. s
   
   thread 'main' (31316) panicked at 
datafusion/functions-nested/benches/array_repeat.rs:88:30:
   called `Result::unwrap()` on an `Err` value: Internal("could not cast array 
of type UInt64 to 
arrow_array::array::primitive_array::PrimitiveArray")
   note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
   error: bench failed, to rerun pass `-p datafusion-functions-nested --bench 
array_repeat`
   ```
   
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4262719415

   🤖 Criterion benchmark running (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4262700896)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux 
bench-c4262700896-1397-gscxw 6.12.55+ #1 SMP Sun Feb  1 08:59:41 UTC 2026 
aarch64 GNU/Linux`
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Comparing use-bench-utils (1d943793b97de9760863f7f0e925a8e09fd55a87) to 
1f0faf9 (merge-base) 
[diff](https://github.com/apache/datafusion/compare/1f0faf92cc4437ddb806a027a5ea15ebd27effba..1d943793b97de9760863f7f0e925a8e09fd55a87)
   BENCH_NAME=array_repeat
   BENCH_COMMAND=cargo bench --features=parquet --bench array_repeat
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


alamb commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4262700896

   run benchmark array_repeat


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


alamb commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4262698839

   I think github merges to main when possible, but the bot does not
   I'll rerun


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


theirix commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4262387792

   > > Benchmark for [this 
request](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
 failed.
   > > Last 20 lines of output:
   > > Click to expand
   > > [File an 
issue](https://github.com/adriangb/datafusion-benchmarking/issues?q=sort%3Aupdated-desc+is%3Aissue+is%3Aopen)
 against this benchmark runner
   > 
   > @theirix could you look into this, if this failure is related?
   
   that's strange, because running `cargo bench --bench array_repeat` on this 
branch `use-bench-utils` (211214403dd8b172ebbeb80cd52078b7fd07fe36) works well 
on my computer.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259526950

   🤖 Criterion benchmark completed (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Details
   
   
   ```
   groupmain
   use-bench-utils
   -
   ---
   array_remove_binary/remove/101.00  4.8±0.03ms? 
?/sec1.00  4.8±0.02ms? ?/sec
   array_remove_binary/remove/100   1.00 10.3±0.08ms? 
?/sec1.01 10.4±0.08ms? ?/sec
   array_remove_binary/remove/500   1.01 40.0±0.52ms? 
?/sec1.00 39.7±0.81ms? ?/sec
   array_remove_boolean/remove/10   1.00  3.5±0.02ms? 
?/sec1.00  3.5±0.08ms? ?/sec
   array_remove_boolean/remove/100  1.00  5.7±0.03ms? 
?/sec1.00  5.7±0.06ms? ?/sec
   array_remove_boolean/remove/500  1.00 14.0±0.03ms? 
?/sec1.00 14.0±0.05ms? ?/sec
   array_remove_decimal64/remove/10 1.14  4.2±0.03ms? 
?/sec1.00  3.7±0.02ms? ?/sec
   array_remove_decimal64/remove/1001.38  8.8±0.11ms? 
?/sec1.00  6.3±0.06ms? ?/sec
   array_remove_decimal64/remove/5001.82 39.4±1.17ms? 
?/sec1.00 21.6±0.16ms? ?/sec
   array_remove_f64/remove/10   1.12  4.0±0.02ms? 
?/sec1.00  3.6±0.02ms? ?/sec
   array_remove_f64/remove/100  1.35  6.6±0.07ms? 
?/sec1.00  4.9±0.05ms? ?/sec
   array_remove_f64/remove/500  2.88 24.4±0.18ms? 
?/sec1.00  8.5±0.09ms? ?/sec
   array_remove_fixed_size_binary/remove/10 1.00  3.9±0.05ms? 
?/sec1.03  4.1±0.12ms? ?/sec
   array_remove_fixed_size_binary/remove/1001.00  8.8±0.12ms? 
?/sec1.03  9.1±0.14ms? ?/sec
   array_remove_fixed_size_binary/remove/5001.00 42.9±0.28ms? 
?/sec1.06 45.4±0.27ms? ?/sec
   array_remove_int64/remove/10 1.13  4.1±0.02ms? 
?/sec1.00  3.6±0.02ms? ?

Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


Jefffrey commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259520104

   > Benchmark for [this 
request](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
 failed.
   > 
   > Last 20 lines of output:
   > Click to expand
   > 
   > [File an 
issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this 
benchmark runner
   
   @theirix could you look into this, if this failure is related?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259509997

   🤖 Criterion benchmark completed (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Details
   
   
   ```
   group   main   
use-bench-utils
   -      
---
   array_to_string_float64/100 2.34  6.8±0.01ms? ?/sec
1.00  2.9±0.00ms? ?/sec
   array_to_string_float64/20  2.07   1464.1±5.67µs? ?/sec
1.00706.3±1.21µs? ?/sec
   array_to_string_float64/5   1.69443.7±0.73µs? ?/sec
1.00263.3±0.50µs? ?/sec
   array_to_string_int64/100   1.13819.1±3.75µs? ?/sec
1.00727.2±1.44µs? ?/sec
   array_to_string_int64/201.11258.9±0.76µs? ?/sec
1.00234.2±0.83µs? ?/sec
   array_to_string_int64/5 1.02147.1±0.56µs? ?/sec
1.00143.6±3.15µs? ?/sec
   array_to_string_nested_int64/1001.13851.4±4.27µs? ?/sec
1.00755.0±2.57µs? ?/sec
   array_to_string_nested_int64/20 1.07287.0±0.72µs? ?/sec
1.00267.4±0.71µs? ?/sec
   array_to_string_nested_int64/5  1.01177.4±1.22µs? ?/sec
1.00174.9±0.52µs? ?/sec
   array_to_string_string/100  1.00622.2±1.15µs? ?/sec
1.00624.9±0.79µs? ?/sec
   array_to_string_string/20   1.00225.4±0.80µs? ?/sec
1.01228.4±0.66µs? ?/sec
   array_to_string_string/51.00144.2±0.56µs? ?/sec
1.00144.0±0.49µs? ?/sec
   ```
   
   
   
   
   Resource Usage
   
   **base (merge-base)**
   | Metric | Value |
   ||---|
   | Wall time | 127.6s |
   | Peak memory | 3.6 GiB |
   | Avg memory | 3.6 GiB |
   | CPU user | 156.8s |
   | CPU sys | 0.8s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   ||---|
   | Wall time | 133.3s |
   | Peak memory | 3.6 GiB |
   | Avg memory | 3.6 GiB |
   | CPU user | 163.0s |
   | CPU sys | 0.3s |
   | Peak spill | 0 B |
   
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


--

Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259505022

   🤖 Criterion benchmark completed (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Details
   
   
   ```
   group
  main   use-bench-utils
   -
     ---
   array_agg i64 merge_batch 30% nulls, 0% of nulls point to a zero length 
array  1.00499.0±5.38µs? ?/sec1.01503.7±5.81µs? 
?/sec
   array_agg i64 merge_batch 30% nulls, 100% of nulls point to a zero length 
array1.00  4.6±0.00µs? ?/sec1.00  4.6±0.00µs? 
?/sec
   array_agg i64 merge_batch 30% nulls, 50% of nulls point to a zero length 
array 1.00499.3±5.57µs? ?/sec1.01504.3±5.71µs? 
?/sec
   array_agg i64 merge_batch 30% nulls, 90% of nulls point to a zero length 
array 1.00504.6±5.95µs? ?/sec1.00504.2±6.07µs? 
?/sec
   array_agg i64 merge_batch 30% nulls, 99% of nulls point to a zero length 
array 1.02508.6±5.89µs? ?/sec1.00500.0±5.76µs? 
?/sec
   array_agg i64 merge_batch 70% nulls, 0% of nulls point to a zero length 
array  1.00213.6±2.41µs? ?/sec1.01216.6±2.62µs? 
?/sec
   array_agg i64 merge_batch 70% nulls, 100% of nulls point to a zero length 
array1.00  4.4±0.00µs? ?/sec1.00  4.4±0.00µs? 
?/sec
   array_agg i64 merge_batch 70% nulls, 50% of nulls point to a zero length 
array 1.00217.0±2.48µs? ?/sec1.00218.1±2.48µs? 
?/sec
   array_agg i64 merge_batch 70% nulls, 90% of nulls point to a zero length 
array 1.12242.7±2.15µs? ?/sec1.00217.4±2.47µs? 
?/sec
   array_agg i64 merge_batch 70% nulls, 99% of nulls point to a zero length 
array 1.00217.3±2.47µs? ?/sec1.00217.2±2.47µs? 
?/sec
   array_agg i64 merge_batch all nulls, 100% of nulls point to a zero length 
array1.00 70.8±1.60ns? ?/sec1.11 78.7±4.62ns? 
?/sec
   array_agg i64 merge_batch all nulls, 90% of nulls point to a zero length 
array 1.00 70.8±1.54ns   

Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259496116

   🤖 Criterion benchmark completed (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Details
   
   
   ```
   groupmain   
use-bench-utils
   -   
---
   array_max/no_nulls/list_size=10  1.00 43.6±0.23µs? ?/sec
1.50 65.6±0.72µs? ?/sec
   array_max/no_nulls/list_size=100 1.69   412.3±12.11µs? ?/sec
1.00244.6±0.92µs? ?/sec
   array_max/no_nulls/list_size=10002.29  3.3±0.27ms? ?/sec
1.00  1438.3±33.34µs? ?/sec
   array_max/nulls/list_size=10 1.47135.9±0.55µs? ?/sec
1.00 92.4±0.70µs? ?/sec
   array_max/nulls/list_size=1001.68   1256.6±5.67µs? ?/sec
1.00749.9±1.59µs? ?/sec
   array_max/nulls/list_size=1000   1.94  8.4±0.18ms? ?/sec
1.00  4.4±0.10ms? ?/sec
   ```
   
   
   
   
   Resource Usage
   
   **base (merge-base)**
   | Metric | Value |
   ||---|
   | Wall time | 63.7s |
   | Peak memory | 3.7 GiB |
   | Avg memory | 3.6 GiB |
   | CPU user | 77.2s |
   | CPU sys | 0.9s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   ||---|
   | Wall time | 63.7s |
   | Peak memory | 3.6 GiB |
   | Avg memory | 3.6 GiB |
   | CPU user | 78.6s |
   | CPU sys | 0.2s |
   | Peak spill | 0 B |
   
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259482872

   Benchmark for [this 
request](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
 failed.
   
   Last 20 lines of output:
   Click to expand
   
   ```
* [new ref] refs/pull/21544/head -> use-bench-utils
* branchmain -> FETCH_HEAD
   Switched to branch 'use-bench-utils'
   3911f0cc089a347434cf07202b340b1475df88cc
   Cloning into '/workspace/datafusion-base'...
   HEAD is now at 3911f0c chore: Add array_slice tests for overlapping nulls 
across inputs (#21540)
   rustc 1.94.1 (e408947bf 2026-03-25)
   211214403dd8b172ebbeb80cd52078b7fd07fe36
   3911f0cc089a347434cf07202b340b1475df88cc
   
   Finished `bench` profile [optimized] target(s) in 0.24s
Running benches/array_repeat.rs 
(target/release/deps/array_repeat-720dc2b8b22510f7)
   Gnuplot not found, using plotters backend
   Benchmarking array_repeat_int64/repeat_5_count/100
   Benchmarking array_repeat_int64/repeat_5_count/100: Warming up for 3. s
   
   thread 'main' (30730) panicked at 
datafusion/functions-nested/benches/array_repeat.rs:88:30:
   called `Result::unwrap()` on an `Err` value: Internal("could not cast array 
of type UInt64 to 
arrow_array::array::primitive_array::PrimitiveArray")
   note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
   error: bench failed, to rerun pass `-p datafusion-functions-nested --bench 
array_repeat`
   ```
   
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259465308

   🤖 Criterion benchmark running (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux 
bench-c4259453514-1356-bxxkq 6.12.55+ #1 SMP Sun Feb  1 08:59:41 UTC 2026 
aarch64 GNU/Linux`
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Comparing use-bench-utils (211214403dd8b172ebbeb80cd52078b7fd07fe36) to 
3911f0c (merge-base) 
[diff](https://github.com/apache/datafusion/compare/3911f0cc089a347434cf07202b340b1475df88cc..211214403dd8b172ebbeb80cd52078b7fd07fe36)
   BENCH_NAME=array_min_max
   BENCH_COMMAND=cargo bench --features=parquet --bench array_min_max
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259465980

   🤖 Criterion benchmark running (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux 
bench-c4259453514-1358-v4bsg 6.12.55+ #1 SMP Sun Feb  1 08:59:41 UTC 2026 
aarch64 GNU/Linux`
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Comparing use-bench-utils (211214403dd8b172ebbeb80cd52078b7fd07fe36) to 
3911f0c (merge-base) 
[diff](https://github.com/apache/datafusion/compare/3911f0cc089a347434cf07202b340b1475df88cc..211214403dd8b172ebbeb80cd52078b7fd07fe36)
   BENCH_NAME=array_repeat
   BENCH_COMMAND=cargo bench --features=parquet --bench array_repeat
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259467283

   🤖 Criterion benchmark running (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux 
bench-c4259453514-1357-mzxvb 6.12.55+ #1 SMP Sun Feb  1 08:59:41 UTC 2026 
aarch64 GNU/Linux`
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Comparing use-bench-utils (211214403dd8b172ebbeb80cd52078b7fd07fe36) to 
3911f0c (merge-base) 
[diff](https://github.com/apache/datafusion/compare/3911f0cc089a347434cf07202b340b1475df88cc..211214403dd8b172ebbeb80cd52078b7fd07fe36)
   BENCH_NAME=array_remove
   BENCH_COMMAND=cargo bench --features=parquet --bench array_remove
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259467307

   🤖 Criterion benchmark running (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux 
bench-c4259453514-1355-tzh8v 6.12.55+ #1 SMP Sun Feb  1 08:59:41 UTC 2026 
aarch64 GNU/Linux`
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Comparing use-bench-utils (211214403dd8b172ebbeb80cd52078b7fd07fe36) to 
3911f0c (merge-base) 
[diff](https://github.com/apache/datafusion/compare/3911f0cc089a347434cf07202b340b1475df88cc..211214403dd8b172ebbeb80cd52078b7fd07fe36)
   BENCH_NAME=array_agg
   BENCH_COMMAND=cargo bench --features=parquet --bench array_agg
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


adriangbot commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259464865

   🤖 Criterion benchmark running (GKE) | 
[trigger](https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux 
bench-c4259453514-1359-d4bxd 6.12.55+ #1 SMP Sun Feb  1 08:59:41 UTC 2026 
aarch64 GNU/Linux`
   CPU Details (lscpu)
   
   ```
   Architecture:aarch64
   CPU op-mode(s):  64-bit
   Byte Order:  Little Endian
   CPU(s):  16
   On-line CPU(s) list: 0-15
   Vendor ID:   ARM
   Model name:  Neoverse-V2
   Model:   1
   Thread(s) per core:  1
   Core(s) per cluster: 16
   Socket(s):   -
   Cluster(s):  1
   Stepping:r0p1
   BogoMIPS:2000.00
   Flags:   fp asimd evtstrm aes pmull sha1 
sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 
sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 
sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm 
bf16 dgh rng bti
   L1d cache:   1 MiB (16 instances)
   L1i cache:   1 MiB (16 instances)
   L2 cache:32 MiB (16 instances)
   L3 cache:80 MiB (1 instance)
   NUMA node(s):1
   NUMA node0 CPU(s):   0-15
   Vulnerability Gather data sampling:  Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit: Not affected
   Vulnerability L1tf:  Not affected
   Vulnerability Mds:   Not affected
   Vulnerability Meltdown:  Not affected
   Vulnerability Mmio stale data:   Not affected
   Vulnerability Reg file data sampling:Not affected
   Vulnerability Retbleed:  Not affected
   Vulnerability Spec rstack overflow:  Not affected
   Vulnerability Spec store bypass: Mitigation; Speculative Store 
Bypass disabled via prctl
   Vulnerability Spectre v1:Mitigation; __user pointer 
sanitization
   Vulnerability Spectre v2:Mitigation; CSV2, BHB
   Vulnerability Srbds: Not affected
   Vulnerability Tsa:   Not affected
   Vulnerability Tsx async abort:   Not affected
   Vulnerability Vmscape:   Not affected
   ```
   
   
   
   Comparing use-bench-utils (211214403dd8b172ebbeb80cd52078b7fd07fe36) to 
3911f0c (merge-base) 
[diff](https://github.com/apache/datafusion/compare/3911f0cc089a347434cf07202b340b1475df88cc..211214403dd8b172ebbeb80cd52078b7fd07fe36)
   BENCH_NAME=array_to_string
   BENCH_COMMAND=cargo bench --features=parquet --bench array_to_string
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) 
against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]



Re: [PR] chore: use bench array helpers from Arrow bench_util [datafusion]

2026-04-16 Thread via GitHub


Jefffrey commented on PR #21544:
URL: https://github.com/apache/datafusion/pull/21544#issuecomment-4259453514

   run benchmarks array_agg array_min_max array_remove array_repeat 
array_to_string


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


-
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]