[ https://issues.apache.org/jira/browse/KAFKA-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120439#comment-15120439 ]
Ismael Juma commented on KAFKA-3160: ------------------------------------ [~edenhill], you're working on this, right? You should probably assign the issue to yourself to avoid duplicated work. > Kafka LZ4 framing code miscalculates header checksum > ---------------------------------------------------- > > Key: KAFKA-3160 > URL: https://issues.apache.org/jira/browse/KAFKA-3160 > Project: Kafka > Issue Type: Bug > Components: compression > Affects Versions: 0.8.2.0, 0.8.2.1, 0.9.0.0, 0.8.2.2 > Reporter: Dana Powers > > KAFKA-1493 implements the LZ4 framing specification, but it incorrectly > calculates the header checksum. Specifically, the current implementation > includes the 4-byte MagicNumber in the checksum, which is incorrect. > http://cyan4973.github.io/lz4/lz4_Frame_format.html > Third-party clients that attempt to use off-the-shelf lz4 framing find that > brokers reject messages as having a corrupt checksum. So currently non-java > clients must 'fixup' lz4 packets to deal with the broken checksum. > Magnus first identified this issue in librdkafka; kafka-python has the same > problem. -- This message was sent by Atlassian JIRA (v6.3.4#6332)