github-actions[bot] commented on PR #6045: URL: https://github.com/apache/texera/pull/6045#issuecomment-4851422308
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 5 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `104bcc4` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28500383277) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 378 | 0.231 | 25,523/37,189/37,189 us | 🔴 +14.5% / 🔴 +146.8% | | 🔴 | bs=100 sw=10 sl=64 | 784 | 0.479 | 125,250/156,693/156,693 us | 🔴 +8.6% / 🔴 +45.6% | | ⚪ | bs=1000 sw=10 sl=64 | 923 | 0.563 | 1,087,366/1,127,801/1,127,801 us | ⚪ within ±5% / 🔴 +10.2% | <details><summary>Baseline details</summary> Latest main `104bcc4` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 378 tuples/sec | 425 tuples/sec | 777.62 tuples/sec | -11.1% | -51.4% | | bs=10 sw=10 sl=64 | MB/s | 0.231 MB/s | 0.259 MB/s | 0.475 MB/s | -10.8% | -51.3% | | bs=10 sw=10 sl=64 | p50 | 25,523 us | 22,296 us | 12,612 us | +14.5% | +102.4% | | bs=10 sw=10 sl=64 | p95 | 37,189 us | 35,650 us | 15,070 us | +4.3% | +146.8% | | bs=10 sw=10 sl=64 | p99 | 37,189 us | 35,650 us | 18,360 us | +4.3% | +102.6% | | bs=100 sw=10 sl=64 | throughput | 784 tuples/sec | 822 tuples/sec | 988.31 tuples/sec | -4.6% | -20.7% | | bs=100 sw=10 sl=64 | MB/s | 0.479 MB/s | 0.502 MB/s | 0.603 MB/s | -4.6% | -20.6% | | bs=100 sw=10 sl=64 | p50 | 125,250 us | 120,505 us | 101,066 us | +3.9% | +23.9% | | bs=100 sw=10 sl=64 | p95 | 156,693 us | 144,259 us | 107,594 us | +8.6% | +45.6% | | bs=100 sw=10 sl=64 | p99 | 156,693 us | 144,259 us | 115,830 us | +8.6% | +35.3% | | bs=1000 sw=10 sl=64 | throughput | 923 tuples/sec | 923 tuples/sec | 1,019 tuples/sec | 0.0% | -9.5% | | bs=1000 sw=10 sl=64 | MB/s | 0.563 MB/s | 0.563 MB/s | 0.622 MB/s | 0.0% | -9.5% | | bs=1000 sw=10 sl=64 | p50 | 1,087,366 us | 1,080,942 us | 986,982 us | +0.6% | +10.2% | | bs=1000 sw=10 sl=64 | p95 | 1,127,801 us | 1,118,930 us | 1,028,491 us | +0.8% | +9.7% | | bs=1000 sw=10 sl=64 | p99 | 1,127,801 us | 1,118,930 us | 1,058,493 us | +0.8% | +6.5% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,529.10,200,128000,378,0.231,25522.80,37189.01,37189.01 1,100,10,64,20,2550.91,2000,1280000,784,0.479,125249.53,156693.14,156693.14 2,1000,10,64,20,21674.14,20000,12800000,923,0.563,1087365.70,1127801.04,1127801.04 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
