github-actions[bot] commented on PR #7157: URL: https://github.com/apache/texera/pull/7157#issuecomment-5139235621
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 1 worse · ⚪ 12 noise (<±5%) · 0 without baseline > Compared against main `45b7b20` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30603727414) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 385 | 0.235 | 25,514/35,984/35,984 us | 🔴 +6.1% / 🔴 +127.9% | | 🟢 | bs=100 sw=10 sl=64 | 780 | 0.476 | 127,587/149,078/149,078 us | 🟢 -10.7% / 🔴 +35.2% | | ⚪ | bs=1000 sw=10 sl=64 | 898 | 0.548 | 1,107,728/1,158,281/1,158,281 us | ⚪ within ±5% / 🔴 -10.3% | <details><summary>Baseline details</summary> Latest main `45b7b20` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 385 tuples/sec | 384 tuples/sec | 771.62 tuples/sec | +0.3% | -50.1% | | bs=10 sw=10 sl=64 | MB/s | 0.235 MB/s | 0.234 MB/s | 0.471 MB/s | +0.4% | -50.1% | | bs=10 sw=10 sl=64 | p50 | 25,514 us | 24,040 us | 12,626 us | +6.1% | +102.1% | | bs=10 sw=10 sl=64 | p95 | 35,984 us | 37,136 us | 15,786 us | -3.1% | +127.9% | | bs=10 sw=10 sl=64 | p99 | 35,984 us | 37,136 us | 19,344 us | -3.1% | +86.0% | | bs=100 sw=10 sl=64 | throughput | 780 tuples/sec | 777 tuples/sec | 971.56 tuples/sec | +0.4% | -19.7% | | bs=100 sw=10 sl=64 | MB/s | 0.476 MB/s | 0.474 MB/s | 0.593 MB/s | +0.4% | -19.7% | | bs=100 sw=10 sl=64 | p50 | 127,587 us | 127,582 us | 103,463 us | +0.0% | +23.3% | | bs=100 sw=10 sl=64 | p95 | 149,078 us | 166,876 us | 110,296 us | -10.7% | +35.2% | | bs=100 sw=10 sl=64 | p99 | 149,078 us | 166,876 us | 118,690 us | -10.7% | +25.6% | | bs=1000 sw=10 sl=64 | throughput | 898 tuples/sec | 910 tuples/sec | 1,001 tuples/sec | -1.3% | -10.3% | | bs=1000 sw=10 sl=64 | MB/s | 0.548 MB/s | 0.555 MB/s | 0.611 MB/s | -1.3% | -10.3% | | bs=1000 sw=10 sl=64 | p50 | 1,107,728 us | 1,097,216 us | 1,008,988 us | +1.0% | +9.8% | | bs=1000 sw=10 sl=64 | p95 | 1,158,281 us | 1,143,127 us | 1,055,260 us | +1.3% | +9.8% | | bs=1000 sw=10 sl=64 | p99 | 1,158,281 us | 1,143,127 us | 1,074,689 us | +1.3% | +7.8% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,519.42,200,128000,385,0.235,25513.80,35984.12,35984.12 1,100,10,64,20,2564.54,2000,1280000,780,0.476,127587.14,149078.34,149078.34 2,1000,10,64,20,22281.01,20000,12800000,898,0.548,1107728.30,1158281.16,1158281.16 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
