github-actions[bot] commented on PR #8690:
URL: https://github.com/apache/texera/pull/8690#issuecomment-5844570395

   <!-- texera-benchmarks-comment -->
   ## ✅ No material benchmark regressions detected
   
   🟢 6 better · 🔴 0 worse · ⚪ 9 noise (<±5%) · 0 without baseline
   
   > Compared against main `33bd07b` benchmarked on **this same runner**, so 
the delta is largely free of cross-runner hardware noise. The "7d avg" column 
still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated.
   
   [Dashboard](https://apache.github.io/texera/dev/bench/) · 
[Run](https://github.com/apache/texera/actions/runs/36229239249)
   
   | | config | throughput | MB/s | latency | max Δ latest / 7d |
   |---|---|---:|---:|---:|---:|
   | 🟢 | bs=10 sw=10 sl=64 | 424 | 0.259 | 23,091/28,194/28,194 us | 🟢 -34.4% / 
🔴 +75.3% |
   | 🟢 | bs=100 sw=10 sl=64 | 876 | 0.535 | 114,179/126,747/126,747 us | 🟢 
-12.6% / 🔴 +13.0% |
   | ⚪ | bs=1000 sw=10 sl=64 | 1,012 | 0.618 | 981,461/1,038,945/1,038,945 us | 
⚪ within ±5% / 🟢 -5.8% |
   
   <details><summary>Baseline details</summary>
   
   Latest main `33bd07b` from same runner
   
   | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d |
   |---|---|---:|---:|---:|---:|---:|
   | bs=10 sw=10 sl=64 | throughput | 424 tuples/sec | 397 tuples/sec | 736.99 
tuples/sec | +6.8% | -42.5% |
   | bs=10 sw=10 sl=64 | MB/s | 0.259 MB/s | 0.242 MB/s | 0.45 MB/s | +7.0% | 
-42.4% |
   | bs=10 sw=10 sl=64 | p50 | 23,091 us | 23,837 us | 13,174 us | -3.1% | 
+75.3% |
   | bs=10 sw=10 sl=64 | p95 | 28,194 us | 42,993 us | 16,900 us | -34.4% | 
+66.8% |
   | bs=10 sw=10 sl=64 | p99 | 28,194 us | 42,993 us | 19,889 us | -34.4% | 
+41.8% |
   | bs=100 sw=10 sl=64 | throughput | 876 tuples/sec | 894 tuples/sec | 946.47 
tuples/sec | -2.0% | -7.4% |
   | bs=100 sw=10 sl=64 | MB/s | 0.535 MB/s | 0.546 MB/s | 0.578 MB/s | -2.0% | 
-7.4% |
   | bs=100 sw=10 sl=64 | p50 | 114,179 us | 108,953 us | 105,257 us | +4.8% | 
+8.5% |
   | bs=100 sw=10 sl=64 | p95 | 126,747 us | 145,004 us | 112,150 us | -12.6% | 
+13.0% |
   | bs=100 sw=10 sl=64 | p99 | 126,747 us | 145,004 us | 125,962 us | -12.6% | 
+0.6% |
   | bs=1000 sw=10 sl=64 | throughput | 1,012 tuples/sec | 1,016 tuples/sec | 
973.64 tuples/sec | -0.4% | +3.9% |
   | bs=1000 sw=10 sl=64 | MB/s | 0.618 MB/s | 0.62 MB/s | 0.594 MB/s | -0.3% | 
+4.0% |
   | bs=1000 sw=10 sl=64 | p50 | 981,461 us | 978,935 us | 1,032,217 us | +0.3% 
| -4.9% |
   | bs=1000 sw=10 sl=64 | p95 | 1,038,945 us | 1,029,563 us | 1,072,497 us | 
+0.9% | -3.1% |
   | bs=1000 sw=10 sl=64 | p99 | 1,038,945 us | 1,029,563 us | 1,102,623 us | 
+0.9% | -5.8% |
   
   </details>
   
   <details><summary>Raw CSV</summary>
   
   ```csv
   
config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us
   0,10,10,64,20,471.41,200,128000,424,0.259,23091.20,28194.27,28194.27
   1,100,10,64,20,2283.12,2000,1280000,876,0.535,114178.93,126747.43,126747.43
   
2,1000,10,64,20,19753.59,20000,12800000,1012,0.618,981461.48,1038944.56,1038944.56
   ```
   
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to