github-actions[bot] commented on PR #6889:
URL: https://github.com/apache/texera/pull/6889#issuecomment-5077610346

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 2 better · 🔴 0 worse · ⚪ 13 noise (<±5%) · 0 without baseline
   
   > Compared against main `81d4612` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/30150149900)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | 🟢 | bs=10 sw=10 sl=64 | 390 | 0.238 | 24,610/33,132/33,132 us | 🟢 -10.6% / 
🔴 +99.7% |
   | ⚪ | bs=100 sw=10 sl=64 | 805 | 0.491 | 122,892/150,946/150,946 us | ⚪ 
within ±5% / 🔴 +38.4% |
   | ⚪ | bs=1000 sw=10 sl=64 | 910 | 0.555 | 1,092,755/1,181,846/1,181,846 us | 
⚪ within ±5% / 🔴 +12.9% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `81d4612` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 390 tuples/sec | 406 tuples/sec | 754.55 
tuples/sec | -3.9% | -48.3% |
   | bs=10 sw=10 sl=64 | MB/s | 0.238 MB/s | 0.248 MB/s | 0.461 MB/s | -4.0% | 
-48.3% |
   | bs=10 sw=10 sl=64 | p50 | 24,610 us | 24,396 us | 12,816 us | +0.9% | 
+92.0% |
   | bs=10 sw=10 sl=64 | p95 | 33,132 us | 37,073 us | 16,594 us | -10.6% | 
+99.7% |
   | bs=10 sw=10 sl=64 | p99 | 33,132 us | 37,073 us | 19,806 us | -10.6% | 
+67.3% |
   | bs=100 sw=10 sl=64 | throughput | 805 tuples/sec | 795 tuples/sec | 969.38 
tuples/sec | +1.3% | -17.0% |
   | bs=100 sw=10 sl=64 | MB/s | 0.491 MB/s | 0.485 MB/s | 0.592 MB/s | +1.2% | 
-17.0% |
   | bs=100 sw=10 sl=64 | p50 | 122,892 us | 121,842 us | 103,584 us | +0.9% | 
+18.6% |
   | bs=100 sw=10 sl=64 | p95 | 150,946 us | 154,169 us | 109,097 us | -2.1% | 
+38.4% |
   | bs=100 sw=10 sl=64 | p99 | 150,946 us | 154,169 us | 117,304 us | -2.1% | 
+28.7% |
   | bs=1000 sw=10 sl=64 | throughput | 910 tuples/sec | 914 tuples/sec | 1,004 
tuples/sec | -0.4% | -9.3% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.555 MB/s | 0.558 MB/s | 0.613 MB/s | -0.5% 
| -9.4% |
   | bs=1000 sw=10 sl=64 | p50 | 1,092,755 us | 1,101,059 us | 1,002,357 us | 
-0.8% | +9.0% |
   | bs=1000 sw=10 sl=64 | p95 | 1,181,846 us | 1,144,270 us | 1,046,463 us | 
+3.3% | +12.9% |
   | bs=1000 sw=10 sl=64 | p99 | 1,181,846 us | 1,144,270 us | 1,073,661 us | 
+3.3% | +10.1% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,512.49,200,128000,390,0.238,24609.62,33131.68,33131.68
   1,100,10,64,20,2484.20,2000,1280000,805,0.491,122892.49,150946.05,150946.05
   
2,1000,10,64,20,21980.04,20000,12800000,910,0.555,1092754.56,1181846.35,1181846.35
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to