github-actions[bot] commented on PR #8528: URL: https://github.com/apache/texera/pull/8528#issuecomment-5651007907
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 2 worse · ⚪ 13 noise (<±5%) · 0 without baseline > Compared against main `7190a81` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/34736425249) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 542 | 0.331 | 16,886/26,478/26,478 us | 🔴 -7.5% / 🔴 +75.8% | | ⚪ | bs=100 sw=10 sl=64 | 1,124 | 0.686 | 82,676/131,575/131,575 us | ⚪ within ±5% / 🔴 +28.2% | | ⚪ | bs=1000 sw=10 sl=64 | 1,405 | 0.858 | 708,139/774,701/774,701 us | ⚪ within ±5% / 🟢 +29.4% | <details><summary>Baseline details</summary> Latest main `7190a81` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 542 tuples/sec | 586 tuples/sec | 807.77 tuples/sec | -7.5% | -32.9% | | bs=10 sw=10 sl=64 | MB/s | 0.331 MB/s | 0.357 MB/s | 0.493 MB/s | -7.3% | -32.9% | | bs=10 sw=10 sl=64 | p50 | 16,886 us | 17,126 us | 12,280 us | -1.4% | +37.5% | | bs=10 sw=10 sl=64 | p95 | 26,478 us | 26,477 us | 15,066 us | +0.0% | +75.8% | | bs=10 sw=10 sl=64 | p99 | 26,478 us | 26,477 us | 19,166 us | +0.0% | +38.2% | | bs=100 sw=10 sl=64 | throughput | 1,124 tuples/sec | 1,143 tuples/sec | 1,054 tuples/sec | -1.7% | +6.7% | | bs=100 sw=10 sl=64 | MB/s | 0.686 MB/s | 0.698 MB/s | 0.643 MB/s | -1.7% | +6.7% | | bs=100 sw=10 sl=64 | p50 | 82,676 us | 81,683 us | 96,023 us | +1.2% | -13.9% | | bs=100 sw=10 sl=64 | p95 | 131,575 us | 130,816 us | 102,660 us | +0.6% | +28.2% | | bs=100 sw=10 sl=64 | p99 | 131,575 us | 130,816 us | 114,950 us | +0.6% | +14.5% | | bs=1000 sw=10 sl=64 | throughput | 1,405 tuples/sec | 1,432 tuples/sec | 1,086 tuples/sec | -1.9% | +29.3% | | bs=1000 sw=10 sl=64 | MB/s | 0.858 MB/s | 0.874 MB/s | 0.663 MB/s | -1.8% | +29.4% | | bs=1000 sw=10 sl=64 | p50 | 708,139 us | 692,387 us | 940,412 us | +2.3% | -24.7% | | bs=1000 sw=10 sl=64 | p95 | 774,701 us | 751,499 us | 979,930 us | +3.1% | -20.9% | | bs=1000 sw=10 sl=64 | p99 | 774,701 us | 751,499 us | 1,015,625 us | +3.1% | -23.7% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,369.02,200,128000,542,0.331,16885.69,26478.47,26478.47 1,100,10,64,20,1779.14,2000,1280000,1124,0.686,82675.88,131574.56,131574.56 2,1000,10,64,20,14233.96,20000,12800000,1405,0.858,708138.65,774700.88,774700.88 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
