[
https://issues.apache.org/jira/browse/KAFKA-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105459#comment-13105459
]
Neha Narkhede commented on KAFKA-79:
------------------------------------
The github diff URL is here -
https://github.com/nehanarkhede/kafka/compare/8db50143d7362750225e...4c49c4e2a9490255c35e21f89a6f4545de87cc5a
This diff url will capture the major changes, though some more minor fixes went
in the Apache SVN repo after this.
I started writing a wiki page for the compression feature here -
https://cwiki.apache.org/confluence/display/KAFKA/Compression
Comments and suggestions are welcome.
> Introduce the compression feature in Kafka
> ------------------------------------------
>
> Key: KAFKA-79
> URL: https://issues.apache.org/jira/browse/KAFKA-79
> Project: Kafka
> Issue Type: New Feature
> Affects Versions: 0.6
> Reporter: Neha Narkhede
> Fix For: 0.7
>
>
> With this feature, we can enable end-to-end block compression in Kafka. The
> idea is to enable compression on the producer for some or all topics, write
> the data in compressed format on the server and make the consumers
> compression aware. The data will be decompressed only on the consumer side.
> Ideally, there should be a choice of compression codecs to be used by the
> producer. That means a change to the message header as well as the network
> byte format. On the consumer side, the state maintenance behavior of the
> zookeeper consumer changes. For compressed data, the consumed offset will be
> advanced one compressed message at a time. For uncompressed data, consumed
> offset will be advanced one message at a time.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
