hi,all:
why i send a messageset of 872 bytes snappy-compressed data to
kafka,and the messageSet stored in kafka was of 3940 payloadsize?
I used sarama AsyncProducer using snappy compression to send
messageSet(5 messages per messageSet),I found that the origin data were 3940
bytes, and the compressed data were 832 bytes.It indicated the snappy
compression has worked..While I checked kafka log data??it showed "offset:
1047825 position: 484851876 isvalid: true payloadsize: 3607 magic: 0
compresscodec: SnappyCompressionCodec crc: 2412106187" and it seemed that the
kafka broker had decode data and encode data again..
How can I store compressed data in kafka which should be 832 bytes per
messageSet in this case ? My kafka version is kafka_2.9.1-0.8.2.1.
3ks!
