github-actions[bot] commented on PR #9042: URL: https://github.com/apache/texera/pull/9042#issuecomment-6390976935
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 10 worse · ⚪ 5 noise (<±5%) · 0 without baseline > Compared against main `98c6337` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/40143179588) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 376 | 0.229 | 25,270/35,503/35,503 us | 🔴 +18.8% / 🔴 +149.4% | | 🔴 | bs=100 sw=10 sl=64 | 805 | 0.491 | 122,481/157,747/157,747 us | 🔴 +18.3% / 🔴 +63.5% | | 🔴 | bs=1000 sw=10 sl=64 | 949 | 0.579 | 1,041,279/1,209,850/1,209,850 us | 🔴 +10.0% / 🔴 +32.9% | <details><summary>Baseline details</summary> Latest main `98c6337` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 376 tuples/sec | 432 tuples/sec | 879.16 tuples/sec | -13.0% | -57.2% | | bs=10 sw=10 sl=64 | MB/s | 0.229 MB/s | 0.264 MB/s | 0.537 MB/s | -13.3% | -57.3% | | bs=10 sw=10 sl=64 | p50 | 25,270 us | 21,275 us | 11,504 us | +18.8% | +119.7% | | bs=10 sw=10 sl=64 | p95 | 35,503 us | 36,636 us | 14,234 us | -3.1% | +149.4% | | bs=10 sw=10 sl=64 | p99 | 35,503 us | 36,636 us | 17,338 us | -3.1% | +104.8% | | bs=100 sw=10 sl=64 | throughput | 805 tuples/sec | 869 tuples/sec | 1,147 tuples/sec | -7.4% | -29.8% | | bs=100 sw=10 sl=64 | MB/s | 0.491 MB/s | 0.531 MB/s | 0.7 MB/s | -7.5% | -29.9% | | bs=100 sw=10 sl=64 | p50 | 122,481 us | 113,972 us | 88,987 us | +7.5% | +37.6% | | bs=100 sw=10 sl=64 | p95 | 157,747 us | 133,363 us | 96,473 us | +18.3% | +63.5% | | bs=100 sw=10 sl=64 | p99 | 157,747 us | 133,363 us | 102,791 us | +18.3% | +53.5% | | bs=1000 sw=10 sl=64 | throughput | 949 tuples/sec | 958 tuples/sec | 1,182 tuples/sec | -0.9% | -19.7% | | bs=1000 sw=10 sl=64 | MB/s | 0.579 MB/s | 0.585 MB/s | 0.721 MB/s | -1.0% | -19.7% | | bs=1000 sw=10 sl=64 | p50 | 1,041,279 us | 1,047,839 us | 872,751 us | -0.6% | +19.3% | | bs=1000 sw=10 sl=64 | p95 | 1,209,850 us | 1,099,561 us | 910,151 us | +10.0% | +32.9% | | bs=1000 sw=10 sl=64 | p99 | 1,209,850 us | 1,099,561 us | 941,479 us | +10.0% | +28.5% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,532.01,200,128000,376,0.229,25270.45,35503.40,35503.40 1,100,10,64,20,2485.04,2000,1280000,805,0.491,122481.21,157747.16,157747.16 2,1000,10,64,20,21076.72,20000,12800000,949,0.579,1041279.29,1209849.70,1209849.70 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
