Joe McDonnell created IMPALA-11603: -------------------------------------- Summary: Investigate using cloudflare's zlib library Key: IMPALA-11603 URL: https://issues.apache.org/jira/browse/IMPALA-11603 Project: IMPALA Issue Type: Improvement Components: Backend Affects Versions: Impala 4.2.0 Reporter: Joe McDonnell
Amazon recommends the use of cloudflare's zlib implementation at [https://github.com/cloudflare/zlib] In a blog post, they claim pretty large performance boosts over the regular zlib implementation: [https://aws.amazon.com/blogs/opensource/improving-zlib-cloudflare-and-comparing-performance-with-other-zlib-forks/] {noformat} On Arm: Compression performance: ~90 percent faster than zlib-madler (original zlib). Decompression performance: ~52 percent faster than zlib-madler. On x86: Compression performance: ~113 percent faster than zlib-madler. Decompression performance: ~44 percent faster than zlib-madler.{noformat} The blog post is a year and a half old, so things may have changed since then, but it seems interesting. Amazon's guidebooks still recommend it. -- This message was sent by Atlassian Jira (v8.20.10#820010)