github-actions[bot] commented on PR #8671: URL: https://github.com/apache/texera/pull/8671#issuecomment-5825239791
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 7 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `fbf7733` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/36082259216) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 421 | 0.257 | 22,333/37,088/37,088 us | 🔴 +14.5% / 🔴 +122.2% | | 🔴 | bs=100 sw=10 sl=64 | 907 | 0.553 | 106,612/146,415/146,415 us | 🔴 +20.2% / 🔴 +30.2% | | ⚪ | bs=1000 sw=10 sl=64 | 1,061 | 0.648 | 933,692/1,006,223/1,006,223 us | ⚪ within ±5% / 🟢 -9.4% | <details><summary>Baseline details</summary> Latest main `fbf7733` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 421 tuples/sec | 478 tuples/sec | 735.19 tuples/sec | -11.9% | -42.7% | | bs=10 sw=10 sl=64 | MB/s | 0.257 MB/s | 0.292 MB/s | 0.449 MB/s | -12.0% | -42.7% | | bs=10 sw=10 sl=64 | p50 | 22,333 us | 19,503 us | 13,231 us | +14.5% | +68.8% | | bs=10 sw=10 sl=64 | p95 | 37,088 us | 35,548 us | 16,692 us | +4.3% | +122.2% | | bs=10 sw=10 sl=64 | p99 | 37,088 us | 35,548 us | 19,901 us | +4.3% | +86.4% | | bs=100 sw=10 sl=64 | throughput | 907 tuples/sec | 959 tuples/sec | 943.78 tuples/sec | -5.4% | -3.9% | | bs=100 sw=10 sl=64 | MB/s | 0.553 MB/s | 0.585 MB/s | 0.576 MB/s | -5.5% | -4.0% | | bs=100 sw=10 sl=64 | p50 | 106,612 us | 101,910 us | 105,801 us | +4.6% | +0.8% | | bs=100 sw=10 sl=64 | p95 | 146,415 us | 121,830 us | 112,493 us | +20.2% | +30.2% | | bs=100 sw=10 sl=64 | p99 | 146,415 us | 121,830 us | 126,888 us | +20.2% | +15.4% | | bs=1000 sw=10 sl=64 | throughput | 1,061 tuples/sec | 1,080 tuples/sec | 974.98 tuples/sec | -1.8% | +8.8% | | bs=1000 sw=10 sl=64 | MB/s | 0.648 MB/s | 0.659 MB/s | 0.595 MB/s | -1.7% | +8.9% | | bs=1000 sw=10 sl=64 | p50 | 933,692 us | 919,480 us | 1,030,375 us | +1.5% | -9.4% | | bs=1000 sw=10 sl=64 | p95 | 1,006,223 us | 995,897 us | 1,071,362 us | +1.0% | -6.1% | | bs=1000 sw=10 sl=64 | p99 | 1,006,223 us | 995,897 us | 1,103,808 us | +1.0% | -8.8% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,474.60,200,128000,421,0.257,22333.40,37087.71,37087.71 1,100,10,64,20,2205.48,2000,1280000,907,0.553,106612.49,146414.60,146414.60 2,1000,10,64,20,18841.26,20000,12800000,1061,0.648,933692.10,1006222.57,1006222.57 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
