Hi, how will this work with encrypted data in logs if/when KIP-317 gets merged? 
Encrypted data will be hard to compress, so the analyzer tool might need to 
acquire the decryption key somewhere measure the compression stats.

On 2020/08/17 20:23:51, "Christopher Beard (BLOOMBERG/ 919 3RD A)" 
<cbea...@bloomberg.net> wrote: 
> Hi everyone,
> 
> I would like to start a discussion on KIP-640:
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-640%3A+Add+log+compression+analysis+tool
> 
> This KIP outlines a new CLI tool which helps compare how the various 
> compression types supported by Kafka reduce the size of a log (and therefore 
> more broadly, of a topic).
> 
> I've put together a PR that might help serve as a starting point for comments 
> and suggestions.
> [WIP] PR: https://github.com/apache/kafka/pull/9193
> 
> Thanks,
> Chris Beard

Reply via email to