github-actions[bot] commented on PR #6037:
URL: https://github.com/apache/texera/pull/6037#issuecomment-4847218880

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 2 better · 🔴 0 worse · ⚪ 13 noise (<±5%) · 0 without baseline
   
   > Compared against main `1073b22` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/28470136356)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | ⚪ | bs=10 sw=10 sl=64 | 434 | 0.265 | 22,651/30,494/30,494 us | ⚪ within 
±5% / 🔴 +102.3% |
   | 🟢 | bs=100 sw=10 sl=64 | 947 | 0.578 | 103,885/126,514/126,514 us | 🟢 
-5.9% / 🔴 +17.6% |
   | ⚪ | bs=1000 sw=10 sl=64 | 1,104 | 0.674 | 902,294/983,172/983,172 us | ⚪ 
within ±5% / 🟢 -8.6% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `1073b22` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 434 tuples/sec | 448 tuples/sec | 777.62 
tuples/sec | -3.1% | -44.2% |
   | bs=10 sw=10 sl=64 | MB/s | 0.265 MB/s | 0.273 MB/s | 0.475 MB/s | -2.9% | 
-44.2% |
   | bs=10 sw=10 sl=64 | p50 | 22,651 us | 21,941 us | 12,612 us | +3.2% | 
+79.6% |
   | bs=10 sw=10 sl=64 | p95 | 30,494 us | 31,392 us | 15,070 us | -2.9% | 
+102.3% |
   | bs=10 sw=10 sl=64 | p99 | 30,494 us | 31,392 us | 18,360 us | -2.9% | 
+66.1% |
   | bs=100 sw=10 sl=64 | throughput | 947 tuples/sec | 948 tuples/sec | 988.31 
tuples/sec | -0.1% | -4.2% |
   | bs=100 sw=10 sl=64 | MB/s | 0.578 MB/s | 0.579 MB/s | 0.603 MB/s | -0.2% | 
-4.2% |
   | bs=100 sw=10 sl=64 | p50 | 103,885 us | 103,711 us | 101,066 us | +0.2% | 
+2.8% |
   | bs=100 sw=10 sl=64 | p95 | 126,514 us | 134,452 us | 107,594 us | -5.9% | 
+17.6% |
   | bs=100 sw=10 sl=64 | p99 | 126,514 us | 134,452 us | 115,830 us | -5.9% | 
+9.2% |
   | bs=1000 sw=10 sl=64 | throughput | 1,104 tuples/sec | 1,104 tuples/sec | 
1,019 tuples/sec | 0.0% | +8.3% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.674 MB/s | 0.674 MB/s | 0.622 MB/s | 0.0% | 
+8.3% |
   | bs=1000 sw=10 sl=64 | p50 | 902,294 us | 909,145 us | 986,982 us | -0.8% | 
-8.6% |
   | bs=1000 sw=10 sl=64 | p95 | 983,172 us | 962,135 us | 1,028,491 us | +2.2% 
| -4.4% |
   | bs=1000 sw=10 sl=64 | p99 | 983,172 us | 962,135 us | 1,058,493 us | +2.2% 
| -7.1% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,460.32,200,128000,434,0.265,22650.84,30494.12,30494.12
   1,100,10,64,20,2111.21,2000,1280000,947,0.578,103884.71,126513.91,126513.91
   
2,1000,10,64,20,18112.69,20000,12800000,1104,0.674,902294.37,983171.73,983171.73
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to