lwpyr opened a new pull request, #4411:
URL: https://github.com/apache/arrow-rs/pull/4411
The wrongly calculated compressed length included the full original buffer
length, which will decline almost all the compressable data. Suppose original
buffer len is *a*, incoming data len is *b*, compressed data len is *c*, the
code should compare *b* and *c* instead of *b* and *a+c*
# Which issue does this PR close?
Closes #4410.
# Rationale for this change
We observe abnormal compress ratio in our production code even with ZSTD.
# What changes are included in this PR?
Fix the compressed length calculation
# Are there any user-facing changes?
No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
