[
https://issues.apache.org/jira/browse/KAFKA-13361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828245#comment-17828245
]
Mickael Maison commented on KAFKA-13361:
----------------------------------------
Dongjin had written a KIP
([KIP-780|https://cwiki.apache.org/confluence/display/KAFKA/KIP-780%3A+Support+fine-grained+compression+options])
but it hasn't been accepted.
I'm currently working on getting
[KIP-390|https://cwiki.apache.org/confluence/display/KAFKA/KIP-390%3A+Support+Compression+Level],
which this task depends on, implemented. I have a [draft
PR|https://github.com/apache/kafka/pull/15516].
I don't want to discourage you, so if you want to work on this please do but I
don't think this is an easy task at all.
> Support fine-grained compression options
> ----------------------------------------
>
> Key: KAFKA-13361
> URL: https://issues.apache.org/jira/browse/KAFKA-13361
> Project: Kafka
> Issue Type: Improvement
> Components: clients, core
> Reporter: Dongjin Lee
> Assignee: Dongjin Lee
> Priority: Major
> Labels: needs-kip
>
> Adds the following options into the Producer, Broker, and Topic
> configurations:
> * compression.gzip.buffer: the buffer size that feeds raw input into the
> Deflator or is fed by the uncompressed output from the Deflator. (available:
> [512, ), default: 8192(=8kb).)
> * compression.snappy.block: the block size that snappy uses. (available:
> [1024, ), default: 32768(=32kb).)
> * compression.lz4.block: the block size that lz4 uses. (available: [4, 7],
> (means 64kb, 256kb, 1mb, 4mb respectively), default: 4.)
> * compression.zstd.window: enables long mode; the log of the window size
> that zstd uses to memorize the compressing data. (available: [10, 22],
> default: 0 (disables long mode.))
> All of the above are different but somewhat in common from the point of
> compression process in that it impacts the memorize size during the process.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
