github-actions[bot] commented on PR #6312: URL: https://github.com/apache/texera/pull/6312#issuecomment-4932061914
<!-- texera-benchmarks-comment --> ## ⚠️ Benchmark changes need a look 🟢 0 better · 🔴 8 worse · ⚪ 7 noise (<±5%) · 0 without baseline > Compared against main `1b42558` benchmarked on **this same runner**, so the delta is largely free of cross-runner hardware noise. The "7d avg" column still reflects the gh-pages dashboard. Treat <±5% as noise unless repeated. [Dashboard](https://apache.github.io/texera/dev/bench/) · [Run](https://github.com/apache/texera/actions/runs/29069457076) | | config | throughput | MB/s | latency | max Δ latest / 7d | |---|---|---:|---:|---:|---:| | 🔴 | bs=10 sw=10 sl=64 | 359 | 0.219 | 28,390/33,440/33,440 us | 🔴 +12.2% / 🔴 +126.2% | | 🔴 | bs=100 sw=10 sl=64 | 779 | 0.475 | 128,057/145,662/145,662 us | 🔴 +7.6% / 🔴 +36.0% | | 🔴 | bs=1000 sw=10 sl=64 | 911 | 0.556 | 1,094,777/1,188,578/1,188,578 us | 🔴 +5.4% / 🔴 +15.5% | <details><summary>Baseline details</summary> Latest main `1b42558` from same runner | config | metric | PR | latest main | 7d avg | Δ latest | Δ 7d | |---|---|---:|---:|---:|---:|---:| | bs=10 sw=10 sl=64 | throughput | 359 tuples/sec | 382 tuples/sec | 779.42 tuples/sec | -6.0% | -53.9% | | bs=10 sw=10 sl=64 | MB/s | 0.219 MB/s | 0.233 MB/s | 0.476 MB/s | -6.0% | -54.0% | | bs=10 sw=10 sl=64 | p50 | 28,390 us | 25,302 us | 12,550 us | +12.2% | +126.2% | | bs=10 sw=10 sl=64 | p95 | 33,440 us | 35,030 us | 15,115 us | -4.5% | +121.2% | | bs=10 sw=10 sl=64 | p99 | 33,440 us | 35,030 us | 18,652 us | -4.5% | +79.3% | | bs=100 sw=10 sl=64 | throughput | 779 tuples/sec | 830 tuples/sec | 1,000 tuples/sec | -6.1% | -22.1% | | bs=100 sw=10 sl=64 | MB/s | 0.475 MB/s | 0.507 MB/s | 0.61 MB/s | -6.3% | -22.2% | | bs=100 sw=10 sl=64 | p50 | 128,057 us | 119,060 us | 99,872 us | +7.6% | +28.2% | | bs=100 sw=10 sl=64 | p95 | 145,662 us | 139,863 us | 107,073 us | +4.1% | +36.0% | | bs=100 sw=10 sl=64 | p99 | 145,662 us | 139,863 us | 114,377 us | +4.1% | +27.4% | | bs=1000 sw=10 sl=64 | throughput | 911 tuples/sec | 927 tuples/sec | 1,020 tuples/sec | -1.7% | -10.7% | | bs=1000 sw=10 sl=64 | MB/s | 0.556 MB/s | 0.566 MB/s | 0.622 MB/s | -1.8% | -10.7% | | bs=1000 sw=10 sl=64 | p50 | 1,094,777 us | 1,079,192 us | 987,499 us | +1.4% | +10.9% | | bs=1000 sw=10 sl=64 | p95 | 1,188,578 us | 1,128,110 us | 1,028,784 us | +5.4% | +15.5% | | bs=1000 sw=10 sl=64 | p99 | 1,188,578 us | 1,128,110 us | 1,057,136 us | +5.4% | +12.4% | </details> <details><summary>Raw CSV</summary> ```csv config_idx,batch_size,schema_width,string_len,num_batches,total_ms,total_tuples,total_bytes,tuples_per_sec,mb_per_sec,lat_p50_us,lat_p95_us,lat_p99_us 0,10,10,64,20,556.68,200,128000,359,0.219,28389.94,33439.96,33439.96 1,100,10,64,20,2567.35,2000,1280000,779,0.475,128056.53,145662.16,145662.16 2,1000,10,64,20,21951.56,20000,12800000,911,0.556,1094776.85,1188578.41,1188578.41 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
