[
https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar Reddy updated KAFKA-2213:
-----------------------------------
Attachment: KAFKA-2213_2015-08-20_17:04:28.patch
> Log cleaner should write compacted messages using configured compression type
> -----------------------------------------------------------------------------
>
> Key: KAFKA-2213
> URL: https://issues.apache.org/jira/browse/KAFKA-2213
> Project: Kafka
> Issue Type: Bug
> Reporter: Joel Koshy
> Assignee: Manikumar Reddy
> Attachments: KAFKA-2213.patch, KAFKA-2213_2015-05-30_00:23:01.patch,
> KAFKA-2213_2015-06-17_16:05:53.patch, KAFKA-2213_2015-07-10_20:18:06.patch,
> KAFKA-2213_2015-08-20_17:04:28.patch
>
>
> In KAFKA-1374 the log cleaner was improved to handle compressed messages.
> There were a couple of follow-ups from that:
> * We write compacted messages using the original compression type in the
> compressed message-set. We should instead append all retained messages with
> the configured broker compression type of the topic.
> * While compressing messages we should ideally do some batching before
> compression.
> * Investigate the use of the client compressor. (See the discussion in the
> RBs for KAFKA-1374)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
