github-actions[bot] commented on PR #7118: URL: https://github.com/apache/texera/pull/7118#issuecomment-5126972985
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 6 worse · ⚪ 9 noise (<±5%) · 0 without baseline > Compared against main `301e3a8` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/30516401105) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | ⚪ | bs=10 sw=10 sl=64 | 395 | 0.241 | 23,729/36,084/36,084 us | ⚪ within ±5% / 🔴 +128.8% | | 🔴 | bs=100 sw=10 sl=64 | 887 | 0.541 | 107,245/157,049/157,049 us | 🔴 +20.8% / 🔴 +46.3% | | 🔴 | bs=1000 sw=10 sl=64 | 1,096 | 0.669 | 908,807/986,619/986,619 us | 🔴 +6.6% / 🟢 -7.3% | <details><summary>Baseline details</summary> Latest main `301e3a8` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 395 tuples/sec | 408 tuples/sec | 786.12 tuples/sec | -3.2% | -49.8% | | bs=10 sw=10 sl=64 | MB/s | 0.241 MB/s | 0.249 MB/s | 0.48 MB/s | -3.2% | -49.8% | | bs=10 sw=10 sl=64 | p50 | 23,729 us | 24,086 us | 12,305 us | -1.5% | +92.8% | | bs=10 sw=10 sl=64 | p95 | 36,084 us | 37,058 us | 15,774 us | -2.6% | +128.8% | | bs=10 sw=10 sl=64 | p99 | 36,084 us | 37,058 us | 18,978 us | -2.6% | +90.1% | | bs=100 sw=10 sl=64 | throughput | 887 tuples/sec | 960 tuples/sec | 999.71 tuples/sec | -7.6% | -11.3% | | bs=100 sw=10 sl=64 | MB/s | 0.541 MB/s | 0.586 MB/s | 0.61 MB/s | -7.7% | -11.3% | | bs=100 sw=10 sl=64 | p50 | 107,245 us | 102,487 us | 100,616 us | +4.6% | +6.6% | | bs=100 sw=10 sl=64 | p95 | 157,049 us | 130,009 us | 107,356 us | +20.8% | +46.3% | | bs=100 sw=10 sl=64 | p99 | 157,049 us | 130,009 us | 113,255 us | +20.8% | +38.7% | | bs=1000 sw=10 sl=64 | throughput | 1,096 tuples/sec | 1,122 tuples/sec | 1,031 tuples/sec | -2.3% | +6.3% | | bs=1000 sw=10 sl=64 | MB/s | 0.669 MB/s | 0.685 MB/s | 0.63 MB/s | -2.3% | +6.3% | | bs=1000 sw=10 sl=64 | p50 | 908,807 us | 896,211 us | 980,328 us | +1.4% | -7.3% | | bs=1000 sw=10 sl=64 | p95 | 986,619 us | 925,811 us | 1,027,528 us | +6.6% | -4.0% | | bs=1000 sw=10 sl=64 | p99 | 986,619 us | 925,811 us | 1,054,298 us | +6.6% | -6.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,506.57,200,128000,395,0.241,23729.07,36084.21,36084.21 1,100,10,64,20,2254.66,2000,1280000,887,0.541,107244.78,157049.18,157049.18 2,1000,10,64,20,18253.57,20000,12800000,1096,0.669,908807.14,986618.66,986618.66 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
