github-actions[bot] commented on PR #8546: URL: https://github.com/apache/texera/pull/8546#issuecomment-5671680168
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `5042d96` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/34903755964) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 350 | 0.214 | 28,254/34,458/34,458 us | 🔴 +16.1% / 🔴 +130.6% | | 🟢 | bs=100 sw=10 sl=64 | 776 | 0.474 | 128,305/143,035/143,035 us | 🟢 -7.7% / 🔴 +39.5% | | 🔴 | bs=1000 sw=10 sl=64 | 891 | 0.544 | 1,122,233/1,201,156/1,201,156 us | 🔴 +6.9% / 🔴 +22.6% | <details><summary>Baseline details</summary> Latest main `5042d96` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 350 tuples/sec | 397 tuples/sec | 816.13 tuples/sec | -11.8% | -57.1% | | bs=10 sw=10 sl=64 | MB/s | 0.214 MB/s | 0.243 MB/s | 0.498 MB/s | -11.9% | -57.0% | | bs=10 sw=10 sl=64 | p50 | 28,254 us | 24,325 us | 12,250 us | +16.1% | +130.6% | | bs=10 sw=10 sl=64 | p95 | 34,458 us | 33,885 us | 15,315 us | +1.7% | +125.0% | | bs=10 sw=10 sl=64 | p99 | 34,458 us | 33,885 us | 19,159 us | +1.7% | +79.9% | | bs=100 sw=10 sl=64 | throughput | 776 tuples/sec | 798 tuples/sec | 1,067 tuples/sec | -2.8% | -27.2% | | bs=100 sw=10 sl=64 | MB/s | 0.474 MB/s | 0.487 MB/s | 0.651 MB/s | -2.7% | -27.2% | | bs=100 sw=10 sl=64 | p50 | 128,305 us | 122,760 us | 95,768 us | +4.5% | +34.0% | | bs=100 sw=10 sl=64 | p95 | 143,035 us | 154,902 us | 102,529 us | -7.7% | +39.5% | | bs=100 sw=10 sl=64 | p99 | 143,035 us | 154,902 us | 114,717 us | -7.7% | +24.7% | | bs=1000 sw=10 sl=64 | throughput | 891 tuples/sec | 923 tuples/sec | 1,098 tuples/sec | -3.5% | -18.9% | | bs=1000 sw=10 sl=64 | MB/s | 0.544 MB/s | 0.563 MB/s | 0.67 MB/s | -3.4% | -18.8% | | bs=1000 sw=10 sl=64 | p50 | 1,122,233 us | 1,087,381 us | 938,676 us | +3.2% | +19.6% | | bs=1000 sw=10 sl=64 | p95 | 1,201,156 us | 1,123,979 us | 979,813 us | +6.9% | +22.6% | | bs=1000 sw=10 sl=64 | p99 | 1,201,156 us | 1,123,979 us | 1,012,292 us | +6.9% | +18.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,571.48,200,128000,350,0.214,28253.59,34457.57,34457.57 1,100,10,64,20,2576.00,2000,1280000,776,0.474,128305.26,143035.22,143035.22 2,1000,10,64,20,22446.10,20000,12800000,891,0.544,1122233.06,1201155.84,1201155.84 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
