github-actions[bot] commented on PR #7835: URL: https://github.com/apache/texera/pull/7835#issuecomment-5379044773
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 4 better · 🔴 5 worse · ⚪ 6 noise (<±5%) · 0 without baseline > Compared against main `8ca9db2` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/32559779359) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 397 | 0.243 | 24,664/30,301/30,301 us | 🔴 +20.5% / 🔴 +102.1% | | 🔴 | bs=100 sw=10 sl=64 | 809 | 0.494 | 119,774/149,155/149,155 us | 🔴 +20.5% / 🔴 +40.6% | | 🟢 | bs=1000 sw=10 sl=64 | 935 | 0.571 | 1,065,306/1,124,422/1,124,422 us | 🟢 -5.2% / 🔴 +11.4% | <details><summary>Baseline details</summary> Latest main `8ca9db2` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 397 tuples/sec | 461 tuples/sec | 780.31 tuples/sec | -13.9% | -49.1% | | bs=10 sw=10 sl=64 | MB/s | 0.243 MB/s | 0.281 MB/s | 0.476 MB/s | -13.5% | -49.0% | | bs=10 sw=10 sl=64 | p50 | 24,664 us | 20,469 us | 12,590 us | +20.5% | +95.9% | | bs=10 sw=10 sl=64 | p95 | 30,301 us | 35,299 us | 14,995 us | -14.2% | +102.1% | | bs=10 sw=10 sl=64 | p99 | 30,301 us | 35,299 us | 19,141 us | -14.2% | +58.3% | | bs=100 sw=10 sl=64 | throughput | 809 tuples/sec | 847 tuples/sec | 1,006 tuples/sec | -4.5% | -19.6% | | bs=100 sw=10 sl=64 | MB/s | 0.494 MB/s | 0.517 MB/s | 0.614 MB/s | -4.4% | -19.5% | | bs=100 sw=10 sl=64 | p50 | 119,774 us | 119,366 us | 99,387 us | +0.3% | +20.5% | | bs=100 sw=10 sl=64 | p95 | 149,155 us | 123,801 us | 106,056 us | +20.5% | +40.6% | | bs=100 sw=10 sl=64 | p99 | 149,155 us | 123,801 us | 113,689 us | +20.5% | +31.2% | | bs=1000 sw=10 sl=64 | throughput | 935 tuples/sec | 925 tuples/sec | 1,043 tuples/sec | +1.1% | -10.4% | | bs=1000 sw=10 sl=64 | MB/s | 0.571 MB/s | 0.564 MB/s | 0.637 MB/s | +1.2% | -10.3% | | bs=1000 sw=10 sl=64 | p50 | 1,065,306 us | 1,076,875 us | 965,215 us | -1.1% | +10.4% | | bs=1000 sw=10 sl=64 | p95 | 1,124,422 us | 1,185,804 us | 1,009,610 us | -5.2% | +11.4% | | bs=1000 sw=10 sl=64 | p99 | 1,124,422 us | 1,185,804 us | 1,039,108 us | -5.2% | +8.2% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,503.16,200,128000,397,0.243,24664.24,30301.30,30301.30 1,100,10,64,20,2473.35,2000,1280000,809,0.494,119774.13,149155.45,149155.45 2,1000,10,64,20,21396.01,20000,12800000,935,0.571,1065305.93,1124421.54,1124421.54 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
