github-actions[bot] commented on PR #6143: URL: https://github.com/apache/texera/pull/6143#issuecomment-4885307247
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 7 worse · ⚪ 8 noise (<±5%) · 0 without baseline > Compared against main `92b7fc9` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/28733899441) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 553 | 0.337 | 17,283/24,074/24,074 us | 🔴 -6.9% / 🔴 +59.0% | | 🔴 | bs=100 sw=10 sl=64 | 1,148 | 0.701 | 81,607/129,702/129,702 us | 🔴 +29.2% / 🔴 +20.2% | | ⚪ | bs=1000 sw=10 sl=64 | 1,429 | 0.872 | 699,719/736,112/736,112 us | ⚪ within ±5% / 🟢 +40.6% | <details><summary>Baseline details</summary> Latest main `92b7fc9` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 553 tuples/sec | 593 tuples/sec | 776.36 tuples/sec | -6.7% | -28.8% | | bs=10 sw=10 sl=64 | MB/s | 0.337 MB/s | 0.362 MB/s | 0.474 MB/s | -6.9% | -28.9% | | bs=10 sw=10 sl=64 | p50 | 17,283 us | 16,946 us | 12,636 us | +2.0% | +36.8% | | bs=10 sw=10 sl=64 | p95 | 24,074 us | 24,034 us | 15,143 us | +0.2% | +59.0% | | bs=10 sw=10 sl=64 | p99 | 24,074 us | 24,034 us | 18,954 us | +0.2% | +27.0% | | bs=100 sw=10 sl=64 | throughput | 1,148 tuples/sec | 1,259 tuples/sec | 985.33 tuples/sec | -8.8% | +16.5% | | bs=100 sw=10 sl=64 | MB/s | 0.701 MB/s | 0.769 MB/s | 0.601 MB/s | -8.8% | +16.6% | | bs=100 sw=10 sl=64 | p50 | 81,607 us | 77,180 us | 101,671 us | +5.7% | -19.7% | | bs=100 sw=10 sl=64 | p95 | 129,702 us | 100,365 us | 107,939 us | +29.2% | +20.2% | | bs=100 sw=10 sl=64 | p99 | 129,702 us | 100,365 us | 113,798 us | +29.2% | +14.0% | | bs=1000 sw=10 sl=64 | throughput | 1,429 tuples/sec | 1,427 tuples/sec | 1,016 tuples/sec | +0.1% | +40.6% | | bs=1000 sw=10 sl=64 | MB/s | 0.872 MB/s | 0.871 MB/s | 0.62 MB/s | +0.1% | +40.6% | | bs=1000 sw=10 sl=64 | p50 | 699,719 us | 700,996 us | 989,693 us | -0.2% | -29.3% | | bs=1000 sw=10 sl=64 | p95 | 736,112 us | 736,293 us | 1,028,327 us | -0.0% | -28.4% | | bs=1000 sw=10 sl=64 | p99 | 736,112 us | 736,293 us | 1,059,969 us | -0.0% | -30.6% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,361.84,200,128000,553,0.337,17282.90,24074.23,24074.23 1,100,10,64,20,1742.51,2000,1280000,1148,0.701,81606.59,129701.74,129701.74 2,1000,10,64,20,14000.24,20000,12800000,1429,0.872,699718.58,736112.43,736112.43 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
