alamb commented on PR #9120:
URL: https://github.com/apache/arrow-rs/pull/9120#issuecomment-3738313279

   Here are my measurements on my machine
   
   ```shell
   cargo bench --features="arrow async" --bench  arrow_reader_clickbench -- Q21
   
   ```
   
   Merge base
   ```
   arrow_reader_clickbench/sync/Q21
                           time:   [119.27 ms 119.51 ms 119.77 ms]
   Found 6 outliers among 100 measurements (6.00%)
     5 (5.00%) high mild
     1 (1.00%) high severe
   
   Benchmarking arrow_reader_clickbench/async/Q21: Warming up for 3.0000 s
   Warning: Unable to complete 100 samples in 5.0s. You may wish to increase 
target time to 6.9s, or reduce sample count to 70.
   arrow_reader_clickbench/async/Q21
                           time:   [69.156 ms 69.354 ms 69.559 ms]
   Found 2 outliers among 100 measurements (2.00%)
     2 (2.00%) high mild
   ```
   
   This branch
   ```
   arrow_reader_clickbench/sync/Q21
                           time:   [118.80 ms 119.31 ms 119.89 ms]
                           change: [−0.6606% −0.1639% +0.3667%] (p = 0.53 > 
0.05)
                           No change in performance detected.
   Found 21 outliers among 100 measurements (21.00%)
     6 (6.00%) high mild
     15 (15.00%) high severe
   
   Benchmarking arrow_reader_clickbench/async/Q21: Warming up for 3.0000 s
   Warning: Unable to complete 100 samples in 5.0s. You may wish to increase 
target time to 6.8s, or reduce sample count to 70.
   arrow_reader_clickbench/async/Q21
                           time:   [68.356 ms 68.459 ms 68.577 ms]
                           change: [−1.6200% −1.2901% −0.9603%] (p = 0.00 < 
0.05)
                           Change within noise threshold.
   Found 11 outliers among 100 measurements (11.00%)
     7 (7.00%) high mild
     4 (4.00%) high severe
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to