ding-young commented on PR #16512:
URL: https://github.com/apache/datafusion/pull/16512#issuecomment-2996151512
To run bench, `cargo bench --bench spill_io`
### Q2
- spill_compression/q2/uncompressed
time: [51.207 ms 51.521 ms 51.841 ms]
[q2 | Uncompressed] mem: 9.4 MB| disk: 9.5 MB| compression ratio: 0.990x
- spill_compression/q2/zstd
time: [146.99 ms 147.36 ms 147.70 ms]
[q2 | Zstd] mem: 9.4 MB| disk: 1546.1 KB| compression ratio: 6.215x
- spill_compression/q2/lz4_frame
time: [97.601 ms 97.942 ms 98.273 ms]
[q2 | Lz4Frame] mem: 9.4 MB| disk: 3.2 MB| compression ratio: 2.922x
### Q16
- spill_compression/q16/uncompressed
time: [75.849 ms 78.053 ms 80.220 ms]
[q16 | Uncompressed] mem: 23.5 MB| disk: 19.5 MB| compression ratio: 1.209x
- spill_compression/q16/zstd
time: [235.68 ms 236.48 ms 237.19 ms]
[q16 | Zstd] mem: 23.5 MB| disk: 4.4 MB| compression ratio: 5.373x
- spill_compression/q16/lz4_frame
time: [142.50 ms 145.18 ms 147.88 ms]
[q16 | Lz4Frame] mem: 23.5 MB| disk: 7.8 MB| compression ratio: 3.007x
### Q20
- spill_compression/q20/uncompressed
time: [63.979 ms 64.233 ms 64.482 ms]
[q20 | Uncompressed] mem: 12.5 MB| disk: 12.7 MB| compression ratio: 0.989x
- spill_compression/q20/zstd
time: [189.99 ms 190.57 ms 191.14 ms]
[q20 | Zstd] mem: 12.5 MB| disk: 2.4 MB| compression ratio: 5.282x
- spill_compression/q20/lz4_frame
time: [123.13 ms 123.43 ms 123.72 ms]
[q20 | Lz4Frame] mem: 12.5 MB| disk: 4.8 MB| compression ratio: 2.629x
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
