HaoYang670 commented on PR #2127:
URL: https://github.com/apache/arrow-rs/pull/2127#issuecomment-1193001246
I can reproduce all the regressions on Intel Ubuntu:
```
(base) remziy@remzi-desktop:~/learning/Arrow$ cargo bench --bench builder --
--baseline master
Compiling arrow v18.0.0 (/home/remziy/learning/Arrow/arrow)
Finished bench [optimized] target(s) in 37.52s
Running benches/builder.rs
(target/release/deps/builder-2cea1707400a3af5)
WARNING: HTML report generation will become a non-default optional feature
in Criterion.rs 0.4.0.
This feature is being moved to cargo-criterion
(https://github.com/bheisler/cargo-criterion) and will be optional in a future
version of Criterion.rs. To silence this warning, either switch to
cargo-criterion or enable the 'html_reports' feature in your Cargo.toml.
WARNING: In Criterion.rs 0.4.0, running criterion benchmarks outside of
cargo-criterion will become a default optional feature.
The statistical analysis and reporting is being moved to cargo-criterion
(https://github.com/bheisler/cargo-criterion) and will be optional in a future
version of Criterion.rs. To silence this warning, either switch to
cargo-criterion or enable the 'cargo_bench_support' feature in your Cargo.toml.
Gnuplot not found, using plotters backend
bench_primitive/bench_primitive
time: [196.37 us 196.46 us 196.59 us]
thrpt: [19.870 GiB/s 19.883 GiB/s 19.893 GiB/s]
change:
time: [-6.0712% -5.9337% -5.8025%] (p = 0.00 <
0.05)
thrpt: [+6.1599% +6.3080% +6.4637%]
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) high mild
8 (8.00%) high severe
Benchmarking bench_primitive_nulls/bench_primitive_nulls: Warming up for
3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase
target time to 7.3s, enable flat sampling, or reduce sample count to 50.
bench_primitive_nulls/bench_primitive_nulls
time: [1.4484 ms 1.4497 ms 1.4514 ms]
change: [+82.679% +83.105% +83.671%] (p = 0.00 <
0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low mild
2 (2.00%) high mild
8 (8.00%) high severe
bench_bool/bench_bool time: [680.40 us 718.81 us 763.42 us]
thrpt: [654.95 MiB/s 695.59 MiB/s 734.86 MiB/s]
change:
time: [+125.17% +134.83% +144.58%] (p = 0.00 <
0.05)
thrpt: [-59.113% -57.417% -55.590%]
Performance has regressed.
Found 21 outliers among 100 measurements (21.00%)
1 (1.00%) high mild
20 (20.00%) high severe
bench_primitive/bench_string
time: [3.4884 ms 3.4953 ms 3.5028 ms]
thrpt: [1.8122 GiB/s 1.8161 GiB/s 1.8197 GiB/s]
change:
time: [+77.994% +78.687% +79.272%] (p = 0.00 <
0.05)
thrpt: [-44.219% -44.036% -43.818%]
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
7 (7.00%) high mild
```
Will take some time to have a look
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
