github-actions[bot] commented on PR #7705: URL: https://github.com/apache/texera/pull/7705#issuecomment-5312651072
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 4 better · 🔴 3 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `1c4662b` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/32001651075) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🟢 | bs=10 sw=10 sl=64 | 422 | 0.257 | 23,479/28,441/28,441 us | 🟢 -12.3% / 🔴 +86.0% | | 🔴 | bs=100 sw=10 sl=64 | 911 | 0.556 | 110,014/129,932/129,932 us | 🟢 -21.5% / 🔴 +23.0% | | 🔴 | bs=1000 sw=10 sl=64 | 1,065 | 0.65 | 933,557/1,029,234/1,029,234 us | 🔴 +5.7% / ⚪ within ±5% | <details><summary>Baseline details</summary> Latest main `1c4662b` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 422 tuples/sec | 439 tuples/sec | 784.16 tuples/sec | -3.9% | -46.2% | | bs=10 sw=10 sl=64 | MB/s | 0.257 MB/s | 0.268 MB/s | 0.479 MB/s | -4.1% | -46.3% | | bs=10 sw=10 sl=64 | p50 | 23,479 us | 22,875 us | 12,626 us | +2.6% | +86.0% | | bs=10 sw=10 sl=64 | p95 | 28,441 us | 32,426 us | 16,169 us | -12.3% | +75.9% | | bs=10 sw=10 sl=64 | p99 | 28,441 us | 32,426 us | 18,986 us | -12.3% | +49.8% | | bs=100 sw=10 sl=64 | throughput | 911 tuples/sec | 899 tuples/sec | 1,023 tuples/sec | +1.3% | -11.0% | | bs=100 sw=10 sl=64 | MB/s | 0.556 MB/s | 0.549 MB/s | 0.625 MB/s | +1.3% | -11.0% | | bs=100 sw=10 sl=64 | p50 | 110,014 us | 102,543 us | 99,185 us | +7.3% | +10.9% | | bs=100 sw=10 sl=64 | p95 | 129,932 us | 165,467 us | 105,616 us | -21.5% | +23.0% | | bs=100 sw=10 sl=64 | p99 | 129,932 us | 165,467 us | 113,681 us | -21.5% | +14.3% | | bs=1000 sw=10 sl=64 | throughput | 1,065 tuples/sec | 1,070 tuples/sec | 1,057 tuples/sec | -0.5% | +0.8% | | bs=1000 sw=10 sl=64 | MB/s | 0.65 MB/s | 0.653 MB/s | 0.645 MB/s | -0.5% | +0.8% | | bs=1000 sw=10 sl=64 | p50 | 933,557 us | 941,026 us | 965,435 us | -0.8% | -3.3% | | bs=1000 sw=10 sl=64 | p95 | 1,029,234 us | 973,451 us | 1,012,135 us | +5.7% | +1.7% | | bs=1000 sw=10 sl=64 | p99 | 1,029,234 us | 973,451 us | 1,042,088 us | +5.7% | -1.2% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,474.27,200,128000,422,0.257,23479.15,28440.93,28440.93 1,100,10,64,20,2195.80,2000,1280000,911,0.556,110014.11,129932.44,129932.44 2,1000,10,64,20,18778.67,20000,12800000,1065,0.650,933557.42,1029233.58,1029233.58 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
