github-actions[bot] commented on PR #7447: URL: https://github.com/apache/texera/pull/7447#issuecomment-5231329949
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 2 better · 🔴 5 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `e03d971` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/31311162074) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 381 | 0.233 | 25,825/34,459/34,459 us | 🔴 +15.3% / 🔴 +113.8% | | 🔴 | bs=100 sw=10 sl=64 | 801 | 0.489 | 125,331/149,947/149,947 us | 🔴 +10.0% / 🔴 +34.8% | | ⚪ | bs=1000 sw=10 sl=64 | 911 | 0.556 | 1,091,999/1,212,335/1,212,335 us | ⚪ within ±5% / 🔴 +14.1% | <details><summary>Baseline details</summary> Latest main `e03d971` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 381 tuples/sec | 413 tuples/sec | 752.25 tuples/sec | -7.7% | -49.4% | | bs=10 sw=10 sl=64 | MB/s | 0.233 MB/s | 0.252 MB/s | 0.459 MB/s | -7.5% | -49.3% | | bs=10 sw=10 sl=64 | p50 | 25,825 us | 22,406 us | 13,006 us | +15.3% | +98.6% | | bs=10 sw=10 sl=64 | p95 | 34,459 us | 39,614 us | 16,117 us | -13.0% | +113.8% | | bs=10 sw=10 sl=64 | p99 | 34,459 us | 39,614 us | 19,286 us | -13.0% | +78.7% | | bs=100 sw=10 sl=64 | throughput | 801 tuples/sec | 831 tuples/sec | 953.66 tuples/sec | -3.6% | -16.0% | | bs=100 sw=10 sl=64 | MB/s | 0.489 MB/s | 0.507 MB/s | 0.582 MB/s | -3.6% | -16.0% | | bs=100 sw=10 sl=64 | p50 | 125,331 us | 119,600 us | 105,130 us | +4.8% | +19.2% | | bs=100 sw=10 sl=64 | p95 | 149,947 us | 136,287 us | 111,226 us | +10.0% | +34.8% | | bs=100 sw=10 sl=64 | p99 | 149,947 us | 136,287 us | 121,065 us | +10.0% | +23.9% | | bs=1000 sw=10 sl=64 | throughput | 911 tuples/sec | 916 tuples/sec | 984.25 tuples/sec | -0.5% | -7.4% | | bs=1000 sw=10 sl=64 | MB/s | 0.556 MB/s | 0.559 MB/s | 0.601 MB/s | -0.5% | -7.4% | | bs=1000 sw=10 sl=64 | p50 | 1,091,999 us | 1,094,086 us | 1,024,295 us | -0.2% | +6.6% | | bs=1000 sw=10 sl=64 | p95 | 1,212,335 us | 1,238,634 us | 1,062,710 us | -2.1% | +14.1% | | bs=1000 sw=10 sl=64 | p99 | 1,212,335 us | 1,238,634 us | 1,095,400 us | -2.1% | +10.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,524.69,200,128000,381,0.233,25824.62,34458.72,34458.72 1,100,10,64,20,2498.05,2000,1280000,801,0.489,125330.64,149946.62,149946.62 2,1000,10,64,20,21956.79,20000,12800000,911,0.556,1091998.92,1212334.79,1212334.79 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
