github-actions[bot] commented on PR #7099: URL: https://github.com/apache/texera/pull/7099#issuecomment-5125778738
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 6 better · 🔴 2 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `f28d8ec` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30509075045) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 436 | 0.266 | 21,435/31,839/31,839 us | 🔴 +10.5% / 🔴 +101.8% | | 🔴 | bs=100 sw=10 sl=64 | 927 | 0.566 | 107,891/126,326/126,326 us | 🟢 -24.5% / 🔴 +17.7% | | 🟢 | bs=1000 sw=10 sl=64 | 1,102 | 0.673 | 900,786/962,663/962,663 us | 🟢 -9.7% / 🟢 -8.7% | <details><summary>Baseline details</summary> Latest main `f28d8ec` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 436 tuples/sec | 455 tuples/sec | 786.12 tuples/sec | -4.2% | -44.5% | | bs=10 sw=10 sl=64 | MB/s | 0.266 MB/s | 0.278 MB/s | 0.48 MB/s | -4.3% | -44.6% | | bs=10 sw=10 sl=64 | p50 | 21,435 us | 19,396 us | 12,305 us | +10.5% | +74.2% | | bs=10 sw=10 sl=64 | p95 | 31,839 us | 33,670 us | 15,774 us | -5.4% | +101.8% | | bs=10 sw=10 sl=64 | p99 | 31,839 us | 33,670 us | 18,978 us | -5.4% | +67.8% | | bs=100 sw=10 sl=64 | throughput | 927 tuples/sec | 920 tuples/sec | 999.71 tuples/sec | +0.8% | -7.3% | | bs=100 sw=10 sl=64 | MB/s | 0.566 MB/s | 0.562 MB/s | 0.61 MB/s | +0.7% | -7.2% | | bs=100 sw=10 sl=64 | p50 | 107,891 us | 102,477 us | 100,616 us | +5.3% | +7.2% | | bs=100 sw=10 sl=64 | p95 | 126,326 us | 167,339 us | 107,356 us | -24.5% | +17.7% | | bs=100 sw=10 sl=64 | p99 | 126,326 us | 167,339 us | 113,255 us | -24.5% | +11.5% | | bs=1000 sw=10 sl=64 | throughput | 1,102 tuples/sec | 1,063 tuples/sec | 1,031 tuples/sec | +3.7% | +6.8% | | bs=1000 sw=10 sl=64 | MB/s | 0.673 MB/s | 0.649 MB/s | 0.63 MB/s | +3.7% | +6.9% | | bs=1000 sw=10 sl=64 | p50 | 900,786 us | 933,800 us | 980,328 us | -3.5% | -8.1% | | bs=1000 sw=10 sl=64 | p95 | 962,663 us | 1,065,984 us | 1,027,528 us | -9.7% | -6.3% | | bs=1000 sw=10 sl=64 | p99 | 962,663 us | 1,065,984 us | 1,054,298 us | -9.7% | -8.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,458.51,200,128000,436,0.266,21434.80,31838.98,31838.98 1,100,10,64,20,2157.19,2000,1280000,927,0.566,107890.96,126325.50,126325.50 2,1000,10,64,20,18144.66,20000,12800000,1102,0.673,900785.55,962662.53,962662.53 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
