sqlbenchmark commented on PR #1434:
URL:
https://github.com/apache/datafusion-ballista/pull/1434#issuecomment-3829482713
## Ballista Criterion Benchmark Results
**PR:** #1434 - chore: format benchmarks Cargo.toml
**PR Commit:** `9f786fc`
**Base Commit:** `4fe9e1d` (main)
**Bench:** sort_shuffle
### Main branch
```
ic-build v0.14.3
Downloaded tinystr v0.8.2
Downloaded ring v0.17.14
Downloaded fs_extra v1.3.0
Downloaded foldhash v0.1.5
Downloaded deranged v0.5.5
Downloaded thread_local v1.1.9
Downloaded thiserror v2.0.18
Downloaded textwrap v0.11.0
Downloaded synstructure v0.13.2
Downloaded humantime v2.3.0
Downloaded strum_macros v0.27.2
Downloaded serde_with_macros v3.16.1
Downloaded serde_derive v1.0.228
Downloaded datafusion-session v52.1.0
Downloaded schemars v0.8.22
Downloaded nibble_vec v0.1.0
Downloaded ipnet v2.11.0
Downloaded rstest_macros v0.26.1
Downloaded dtor v0.1.1
Downloaded structopt-derive v0.4.18
Downloaded datafusion-functions-nested v52.1.0
Downloaded darling_core v0.21.3
Downloaded glob v0.3.3
Downloaded aws-smithy-runtime v1.9.8
Downloaded aws-sdk-sso v1.92.0
Downloaded async-compression v0.4.37
Downloaded foldhash v0.2.0
Downloaded parse-display-derive v0.9.1
Downloaded sha2 v0.10.9
Downloaded nu-ansi-term v0.50.3
Downloaded mime v0.3.17
Downloaded bon-macros v3.8.2
Downloaded bollard-stubs v1.49.1-rc.28.4.0
Downloaded pin-project-internal v1.1.10
Downloaded prost-derive v0.14.3
Downloaded rand_chacha v0.9.0
Downloaded aws-lc-sys v0.37.0
Downloaded tracing-log v0.2.0
Downloaded simd-adler32 v0.3.8
Downloaded rustversion v1.0.22
Downloaded litemap v0.8.1
Downloaded hyper-rustls v0.27.7
Downloaded http-body-util v0.1.3
Downloaded liblzma v0.4.5
Downloaded matchit v0.8.4
Downloaded hyper-timeout v0.5.2
Downloaded httparse v1.10.1
Downloaded hmac v0.12.1
Downloaded datafusion-pruning v52.1.0
Downloaded icu_provider v2.1.1
Downloaded ferroid v0.8.9
Downloaded libbz2-rs-sys v0.2.2
Downloaded datafusion-proto-common v52.1.0
Downloaded icu_locale_core v2.1.1
Downloaded icu_properties v2.1.2
Downloaded icu_normalizer v2.1.1
Downloaded indexmap v1.9.3
Downloaded icu_normalizer_data v2.1.1
Downloaded schemars v0.9.0
Downloaded substrait v0.62.2
Downloaded toml_edit v0.23.10+spec-1.0.0
Downloaded icu_collections v2.1.1
Downloaded miniz_oxide v0.8.9
Downloaded http v1.4.0
Downloaded http v0.2.12
Downloaded hyper-util v0.1.19
Downloaded rand v0.9.2
Downloaded hashbrown v0.12.3
Downloaded hashbrown v0.14.5
Downloaded hashbrown v0.15.5
Downloaded idna v1.1.0
Downloaded libm v0.2.16
Downloaded iri-string v0.7.10
Downloaded hyper v1.8.1
Downloaded datafusion-substrait v52.1.0
Downloaded datafusion-sql v52.1.0
Downloaded itertools v0.14.0
Downloaded icu_properties_data v2.1.2
Downloaded h2 v0.4.13
Downloaded datafusion-proto v52.1.0
Downloaded quinn-proto v0.11.13
Downloaded object_store v0.12.5
Downloaded object v0.32.2
Downloaded nix v0.30.1
Downloaded sqlparser v0.59.0
Downloaded libmimalloc-sys v0.1.44
Downloaded datafusion-physical-plan v52.1.0
Downloaded liblzma-sys v0.4.5
Downloaded linux-raw-sys v0.11.0
error: no bench target named `sort_shuffle` in default-run packages
```
### PR branch
```
.2.2
Compiling plotters-backend v0.3.7
Compiling plotters-svg v0.3.7
Compiling ciborium-ll v0.2.2
Compiling itertools v0.10.5
Compiling cast v0.3.0
Compiling criterion-plot v0.5.0
Compiling rayon v1.11.0
Compiling ciborium v0.2.2
Compiling plotters v0.3.7
Compiling tinytemplate v1.2.1
Compiling is-terminal v0.4.17
Compiling anes v0.1.6
Compiling oorandom v11.1.5
Compiling criterion v0.5.1
Compiling ballista-benchmarks v52.0.0 (/app/ballista/benchmarks)
Finished `bench` profile [optimized] target(s) in 5m 59s
Running benches/sort_shuffle.rs
(target/release/deps/sort_shuffle-b1db7a23d64cf131)
Gnuplot not found, using plotters backend
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Warming up for
3.0000 s
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Collecting 10
samples in estimated 6.0223 s (30 iterations)
Benchmarking sort_shuffle_no_spill/10_batches_200_partitions: Analyzing
sort_shuffle_no_spill/10_batches_200_partitions
time: [201.66 ms 202.21 ms 202.81 ms]
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Warming up for
3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 17.3s.
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Collecting 10
samples in estimated 17.273 s (10 iterations)
Benchmarking sort_shuffle_no_spill/50_batches_200_partitions: Analyzing
sort_shuffle_no_spill/50_batches_200_partitions
time: [1.7599 s 1.8089 s 1.8631 s]
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) low mild
1 (10.00%) high mild
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 21.4s.
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Collecting 10 samples in estimated 21.393 s (10 iterations)
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit:
Analyzing
sort_shuffle_with_spill/50_batches_200_partitions_8mb_limit
time: [2.1870 s 2.1999 s 2.2132 s]
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase
target time to 23.7s.
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Collecting 10 samples in estimated 23.732 s (10 iterations)
Benchmarking sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit:
Analyzing
sort_shuffle_with_spill/50_batches_200_partitions_2mb_limit
time: [2.3685 s 2.3996 s 2.4271 s]
```
---
*Automated benchmark run by dfbench*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
