github-actions[bot] commented on PR #7019: URL: https://github.com/apache/texera/pull/7019#issuecomment-5113552726
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 6 worse · ⚪ 9 noise (<±5%) · 0 without baseline > Compared against main `ab58d47` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30424401101) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 371 | 0.227 | 25,652/35,116/35,116 us | 🔴 +21.0% / 🔴 +122.2% | | 🔴 | bs=100 sw=10 sl=64 | 783 | 0.478 | 127,059/159,936/159,936 us | 🔴 +8.2% / 🔴 +49.0% | | ⚪ | bs=1000 sw=10 sl=64 | 907 | 0.554 | 1,097,395/1,147,577/1,147,577 us | ⚪ within ±5% / 🔴 -12.0% | <details><summary>Baseline details</summary> Latest main `ab58d47` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 371 tuples/sec | 432 tuples/sec | 787.55 tuples/sec | -14.1% | -52.9% | | bs=10 sw=10 sl=64 | MB/s | 0.227 MB/s | 0.264 MB/s | 0.481 MB/s | -14.0% | -52.8% | | bs=10 sw=10 sl=64 | p50 | 25,652 us | 21,202 us | 12,255 us | +21.0% | +109.3% | | bs=10 sw=10 sl=64 | p95 | 35,116 us | 36,156 us | 15,802 us | -2.9% | +122.2% | | bs=10 sw=10 sl=64 | p99 | 35,116 us | 36,156 us | 19,008 us | -2.9% | +84.7% | | bs=100 sw=10 sl=64 | throughput | 783 tuples/sec | 812 tuples/sec | 997.81 tuples/sec | -3.6% | -21.5% | | bs=100 sw=10 sl=64 | MB/s | 0.478 MB/s | 0.496 MB/s | 0.609 MB/s | -3.6% | -21.5% | | bs=100 sw=10 sl=64 | p50 | 127,059 us | 120,317 us | 100,690 us | +5.6% | +26.2% | | bs=100 sw=10 sl=64 | p95 | 159,936 us | 147,857 us | 107,316 us | +8.2% | +49.0% | | bs=100 sw=10 sl=64 | p99 | 159,936 us | 147,857 us | 113,823 us | +8.2% | +40.5% | | bs=1000 sw=10 sl=64 | throughput | 907 tuples/sec | 901 tuples/sec | 1,030 tuples/sec | +0.7% | -12.0% | | bs=1000 sw=10 sl=64 | MB/s | 0.554 MB/s | 0.55 MB/s | 0.629 MB/s | +0.7% | -11.9% | | bs=1000 sw=10 sl=64 | p50 | 1,097,395 us | 1,111,775 us | 981,213 us | -1.3% | +11.8% | | bs=1000 sw=10 sl=64 | p95 | 1,147,577 us | 1,136,662 us | 1,027,605 us | +1.0% | +11.7% | | bs=1000 sw=10 sl=64 | p99 | 1,147,577 us | 1,136,662 us | 1,055,466 us | +1.0% | +8.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,538.58,200,128000,371,0.227,25652.49,35116.10,35116.10 1,100,10,64,20,2553.95,2000,1280000,783,0.478,127058.81,159935.50,159935.50 2,1000,10,64,20,22051.35,20000,12800000,907,0.554,1097395.23,1147576.67,1147576.67 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
