amirshukayev opened a new pull request, #9367: URL: https://github.com/apache/arrow-rs/pull/9367
# Which issue does this PR close? - Closes #8648. # Rationale for this change Tuning window size with zstd is important for wider columns such as html strings. In my personal uses I saw a 32% size decrease with small performance penalty with level = 9 and windowLog = 27 (128 MB windows up from 8 MB default for level 9). # What changes are included in this PR? We add a `zstd_window_log_override: Option<u32>` param to `CodecOptions` to just allow the value to be set through to `zstd-safe`. Just plumbing. # Are these changes tested? Pass all the cargo tests, one unit test provided, just to show a usage example/guard the behaviour, doesn't necessarily test the behaviour of the underlying zstd library. # Are there any user-facing changes? No backwards compatible changes, but this change adds a new param to `CodecOptionsBuilder`, and makes changes to cargo docs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
