github-actions[bot] commented on PR #8111: URL: https://github.com/apache/texera/pull/8111#issuecomment-5463502571
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 8 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `04b213d` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/33262412588) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 478 | 0.292 | 20,046/27,998/27,998 us | 🔴 -13.9% / 🔴 +89.6% | | 🔴 | bs=100 sw=10 sl=64 | 1,017 | 0.62 | 93,281/134,840/134,840 us | 🔴 +21.2% / 🔴 +33.5% | | ⚪ | bs=1000 sw=10 sl=64 | 1,219 | 0.744 | 820,197/898,800/898,800 us | ⚪ within ±5% / 🟢 -11.9% | <details><summary>Baseline details</summary> Latest main `04b213d` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 478 tuples/sec | 555 tuples/sec | 842.25 tuples/sec | -13.9% | -43.2% | | bs=10 sw=10 sl=64 | MB/s | 0.292 MB/s | 0.339 MB/s | 0.514 MB/s | -13.9% | -43.2% | | bs=10 sw=10 sl=64 | p50 | 20,046 us | 19,279 us | 11,860 us | +4.0% | +69.0% | | bs=10 sw=10 sl=64 | p95 | 27,998 us | 24,586 us | 14,764 us | +13.9% | +89.6% | | bs=10 sw=10 sl=64 | p99 | 27,998 us | 24,586 us | 17,870 us | +13.9% | +56.7% | | bs=100 sw=10 sl=64 | throughput | 1,017 tuples/sec | 1,079 tuples/sec | 1,084 tuples/sec | -5.7% | -6.2% | | bs=100 sw=10 sl=64 | MB/s | 0.62 MB/s | 0.659 MB/s | 0.662 MB/s | -5.9% | -6.3% | | bs=100 sw=10 sl=64 | p50 | 93,281 us | 90,008 us | 94,616 us | +3.6% | -1.4% | | bs=100 sw=10 sl=64 | p95 | 134,840 us | 111,256 us | 100,981 us | +21.2% | +33.5% | | bs=100 sw=10 sl=64 | p99 | 134,840 us | 111,256 us | 108,141 us | +21.2% | +24.7% | | bs=1000 sw=10 sl=64 | throughput | 1,219 tuples/sec | 1,242 tuples/sec | 1,112 tuples/sec | -1.9% | +9.6% | | bs=1000 sw=10 sl=64 | MB/s | 0.744 MB/s | 0.758 MB/s | 0.679 MB/s | -1.8% | +9.6% | | bs=1000 sw=10 sl=64 | p50 | 820,197 us | 803,481 us | 930,623 us | +2.1% | -11.9% | | bs=1000 sw=10 sl=64 | p95 | 898,800 us | 877,119 us | 974,308 us | +2.5% | -7.7% | | bs=1000 sw=10 sl=64 | p99 | 898,800 us | 877,119 us | 1,002,806 us | +2.5% | -10.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,417.98,200,128000,478,0.292,20045.84,27997.92,27997.92 1,100,10,64,20,1967.31,2000,1280000,1017,0.620,93281.36,134840.22,134840.22 2,1000,10,64,20,16400.25,20000,12800000,1219,0.744,820196.72,898800.47,898800.47 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
