github-actions[bot] commented on PR #6890: URL: https://github.com/apache/texera/pull/6890#issuecomment-5077607167
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `81d4612` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30150150761) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 415 | 0.253 | 24,385/35,297/35,297 us | 🔴 +8.0% / 🔴 +112.7% | | 🟢 | bs=100 sw=10 sl=64 | 939 | 0.573 | 105,195/124,576/124,576 us | 🟢 -9.5% / 🔴 +14.2% | | ⚪ | bs=1000 sw=10 sl=64 | 1,097 | 0.67 | 909,681/1,010,573/1,010,573 us | ⚪ within ±5% / 🟢 +9.4% | <details><summary>Baseline details</summary> Latest main `81d4612` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 415 tuples/sec | 440 tuples/sec | 754.55 tuples/sec | -5.7% | -45.0% | | bs=10 sw=10 sl=64 | MB/s | 0.253 MB/s | 0.268 MB/s | 0.461 MB/s | -5.6% | -45.1% | | bs=10 sw=10 sl=64 | p50 | 24,385 us | 22,791 us | 12,816 us | +7.0% | +90.3% | | bs=10 sw=10 sl=64 | p95 | 35,297 us | 32,695 us | 16,594 us | +8.0% | +112.7% | | bs=10 sw=10 sl=64 | p99 | 35,297 us | 32,695 us | 19,806 us | +8.0% | +78.2% | | bs=100 sw=10 sl=64 | throughput | 939 tuples/sec | 943 tuples/sec | 969.38 tuples/sec | -0.4% | -3.1% | | bs=100 sw=10 sl=64 | MB/s | 0.573 MB/s | 0.576 MB/s | 0.592 MB/s | -0.5% | -3.2% | | bs=100 sw=10 sl=64 | p50 | 105,195 us | 103,939 us | 103,584 us | +1.2% | +1.6% | | bs=100 sw=10 sl=64 | p95 | 124,576 us | 137,717 us | 109,097 us | -9.5% | +14.2% | | bs=100 sw=10 sl=64 | p99 | 124,576 us | 137,717 us | 117,304 us | -9.5% | +6.2% | | bs=1000 sw=10 sl=64 | throughput | 1,097 tuples/sec | 1,099 tuples/sec | 1,004 tuples/sec | -0.2% | +9.3% | | bs=1000 sw=10 sl=64 | MB/s | 0.67 MB/s | 0.671 MB/s | 0.613 MB/s | -0.1% | +9.4% | | bs=1000 sw=10 sl=64 | p50 | 909,681 us | 909,724 us | 1,002,357 us | -0.0% | -9.2% | | bs=1000 sw=10 sl=64 | p95 | 1,010,573 us | 971,965 us | 1,046,463 us | +4.0% | -3.4% | | bs=1000 sw=10 sl=64 | p99 | 1,010,573 us | 971,965 us | 1,073,661 us | +4.0% | -5.9% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,482.34,200,128000,415,0.253,24385.09,35296.68,35296.68 1,100,10,64,20,2129.23,2000,1280000,939,0.573,105195.28,124576.06,124576.06 2,1000,10,64,20,18228.13,20000,12800000,1097,0.670,909681.30,1010573.31,1010573.31 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
