[
https://issues.apache.org/jira/browse/KAFKA-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022824#comment-16022824
]
Eno Thereska commented on KAFKA-5211:
-------------------------------------
[~becket_qin] I think this change needs a KIP. There have been several JIRAs
like KAFKA-5078, KAFKA-4740 etc that have a lot of discussion on the PR. I
personally haven't understood the ramifications of these changes. They affect
users since they need to know what to do in case bad data is in the pipeline.
Could you prepare a KIP on this? Thanks.
> KafkaConsumer should not skip a corrupted record after throwing an exception.
> -----------------------------------------------------------------------------
>
> Key: KAFKA-5211
> URL: https://issues.apache.org/jira/browse/KAFKA-5211
> Project: Kafka
> Issue Type: Bug
> Reporter: Jiangjie Qin
> Assignee: Jiangjie Qin
> Labels: clients, consumer
> Fix For: 0.11.0.0
>
>
> In 0.10.2, when there is a corrupted record, KafkaConsumer.poll() will throw
> an exception and block on that corrupted record. In the latest trunk this
> behavior has changed to skip the corrupted record (which is the old consumer
> behavior). With KIP-98, skipping corrupted messages would be a little
> dangerous as the message could be a control message for a transaction. We
> should fix the issue to let the KafkaConsumer block on the corrupted messages.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
