[ https://issues.apache.org/jira/browse/KAFKA-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631122#comment-16631122 ]
Jason Gustafson commented on KAFKA-7405: ---------------------------------------- Seems reasonable to me. This was brought as a potential improvement in the discussion of KIP-334: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=87297793. > Support for graceful handling of corrupted records in Kafka consumer > -------------------------------------------------------------------- > > Key: KAFKA-7405 > URL: https://issues.apache.org/jira/browse/KAFKA-7405 > Project: Kafka > Issue Type: Improvement > Components: consumer, streams > Affects Versions: 0.10.2.2, 0.11.0.3, 1.1.1 > Reporter: Eugen Feller > Priority: Major > > We have run into issues several times where corrupted records cause the Kafka > consumer to throw an error code 2 exception (CRC checksum failure) in the > fetch layer. Specifically, when using Kafka streams we run into KAFKA-6977 > that throws an IllegalStateException and crashes the service. It would be > great if the Kafka consumer could be extended with a setting similar to > [KIP-161|https://cwiki.apache.org/confluence/display/KAFKA/KIP-161%3A+streams+deserialization+exception+handlers], > that would allow one to gracefully ignore corrupted records. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)