This KIP is inline with KIP-334 <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=87297793> in which it's proposed that the consumer will throw FaultyRecordException with corrupt/in-operative record offset and topic-partition on encountering the invalid record.
In this KIP proposed changes, you've mentioned to skip the corrupted record while producing the RecordBatch, Will you also handle the same case while consuming the records by providing a callback to the consumer to either skip or halt the processing? (This is a follow-up idea of KIP-334 which seems relevant to this one) On Sat, Jun 8, 2019 at 5:29 AM Guozhang Wang <wangg...@gmail.com> wrote: > Bump up this thread again for whoever's interested. > > On Sat, May 11, 2019 at 12:34 PM Guozhang Wang <wangg...@gmail.com> wrote: > > > Hello everyone, > > > > I'd like to start a discussion thread on this newly created KIP to > improve > > error communication and handling for producer response: > > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-467%3A+Augment+ProduceResponse+error+messaging+for+specific+culprit+records > > > > Thanks, > > -- > > -- Guozhang > > > > > -- > -- Guozhang >
