github-actions[bot] commented on PR #7167: URL: https://github.com/apache/texera/pull/7167#issuecomment-5143058151
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 3 worse · ⚪ 10 noise (<±5%) · 0 without baseline > Compared against main `45b7b20` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30631743646) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 385 | 0.235 | 25,489/35,288/35,288 us | 🔴 +8.0% / 🔴 +123.5% | | 🟢 | bs=100 sw=10 sl=64 | 792 | 0.483 | 124,494/164,889/164,889 us | 🟢 -11.5% / 🔴 +49.5% | | ⚪ | bs=1000 sw=10 sl=64 | 913 | 0.557 | 1,090,353/1,123,938/1,123,938 us | ⚪ within ±5% / 🔴 -8.9% | <details><summary>Baseline details</summary> Latest main `45b7b20` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 385 tuples/sec | 410 tuples/sec | 771.62 tuples/sec | -6.1% | -50.1% | | bs=10 sw=10 sl=64 | MB/s | 0.235 MB/s | 0.25 MB/s | 0.471 MB/s | -6.0% | -50.1% | | bs=10 sw=10 sl=64 | p50 | 25,489 us | 23,601 us | 12,626 us | +8.0% | +101.9% | | bs=10 sw=10 sl=64 | p95 | 35,288 us | 33,895 us | 15,786 us | +4.1% | +123.5% | | bs=10 sw=10 sl=64 | p99 | 35,288 us | 33,895 us | 19,344 us | +4.1% | +82.4% | | bs=100 sw=10 sl=64 | throughput | 792 tuples/sec | 799 tuples/sec | 971.56 tuples/sec | -0.9% | -18.5% | | bs=100 sw=10 sl=64 | MB/s | 0.483 MB/s | 0.488 MB/s | 0.593 MB/s | -1.0% | -18.5% | | bs=100 sw=10 sl=64 | p50 | 124,494 us | 119,345 us | 103,463 us | +4.3% | +20.3% | | bs=100 sw=10 sl=64 | p95 | 164,889 us | 186,293 us | 110,296 us | -11.5% | +49.5% | | bs=100 sw=10 sl=64 | p99 | 164,889 us | 186,293 us | 118,690 us | -11.5% | +38.9% | | bs=1000 sw=10 sl=64 | throughput | 913 tuples/sec | 921 tuples/sec | 1,001 tuples/sec | -0.9% | -8.8% | | bs=1000 sw=10 sl=64 | MB/s | 0.557 MB/s | 0.562 MB/s | 0.611 MB/s | -0.9% | -8.9% | | bs=1000 sw=10 sl=64 | p50 | 1,090,353 us | 1,092,844 us | 1,008,988 us | -0.2% | +8.1% | | bs=1000 sw=10 sl=64 | p95 | 1,123,938 us | 1,117,558 us | 1,055,260 us | +0.6% | +6.5% | | bs=1000 sw=10 sl=64 | p99 | 1,123,938 us | 1,117,558 us | 1,074,689 us | +0.6% | +4.6% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,519.70,200,128000,385,0.235,25488.98,35288.44,35288.44 1,100,10,64,20,2524.89,2000,1280000,792,0.483,124494.38,164889.45,164889.45 2,1000,10,64,20,21896.64,20000,12800000,913,0.557,1090352.97,1123938.28,1123938.28 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
