Re: Failure while reading messages from kafka
The same issue I am facing too. Currently I am working on kafka-0.11. PF the logs. Thanks and Regards, Aakash Mandlik From: Khurram Faraaz Sent: Wednesday, September 5, 2018 12:12:48 AM To: user@drill.apache.org Subject: Re: Failure while reading messages from kafka Can you please share the stack trace from drillbit.log and the version of Kafka that you are on ? Thanks, Khurram On Tue, Sep 4, 2018 at 11:39 AM, Matt wrote: > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues. > apache.org_jira_browse_DRILL-2D6723&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r= > H5JEl9vb-mBIjic10QAbDD2vkUUKAxjO6wZO322RtdI&m=1BtkhAfyGAwpn_Qov_2S8- > 0asOGHNYFYaxumWdyI4kE&s=57Qb0eMSL8xLEok5uB7ovkEkro0DgQwTXYnFeERXGiY&e= > > On Mon, Aug 27, 2018 at 12:27 PM Matt wrote: > > > I have a Kafka topic with some non-JSON test messages in it, resulting in > > errors "Error: DATA_READ ERROR: Failure while reading messages from > kafka. > > Recordreader was at record: 1" > > > > I don't seem to be able to bypass these topic messages with > > "store.json.reader.skip_invalid_records" or even an OFFSET in the query. > > > > Is there a mechanism or setting I can use to query a topic and not fail > on > > malformed messages? > > > DISCLAIMER This email and any files transmitted with it are intended solely for the person or the entity to whom they are addressed and may contain information which is Confidential and Privileged. Any misuse of the information contained in this email, including but not limited to retransmission or dissemination of the said information by person or entities other than the intended recipient is unauthorized and strictly prohibited. If you are not the intended recipient of this email, please delete this email and contact the sender immediately.
Re: Failure while reading messages from kafka
Can you please share the stack trace from drillbit.log and the version of Kafka that you are on ? Thanks, Khurram On Tue, Sep 4, 2018 at 11:39 AM, Matt wrote: > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues. > apache.org_jira_browse_DRILL-2D6723&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r= > H5JEl9vb-mBIjic10QAbDD2vkUUKAxjO6wZO322RtdI&m=1BtkhAfyGAwpn_Qov_2S8- > 0asOGHNYFYaxumWdyI4kE&s=57Qb0eMSL8xLEok5uB7ovkEkro0DgQwTXYnFeERXGiY&e= > > On Mon, Aug 27, 2018 at 12:27 PM Matt wrote: > > > I have a Kafka topic with some non-JSON test messages in it, resulting in > > errors "Error: DATA_READ ERROR: Failure while reading messages from > kafka. > > Recordreader was at record: 1" > > > > I don't seem to be able to bypass these topic messages with > > "store.json.reader.skip_invalid_records" or even an OFFSET in the query. > > > > Is there a mechanism or setting I can use to query a topic and not fail > on > > malformed messages? > > >
Re: Failure while reading messages from kafka
https://issues.apache.org/jira/browse/DRILL-6723 On Mon, Aug 27, 2018 at 12:27 PM Matt wrote: > I have a Kafka topic with some non-JSON test messages in it, resulting in > errors "Error: DATA_READ ERROR: Failure while reading messages from kafka. > Recordreader was at record: 1" > > I don't seem to be able to bypass these topic messages with > "store.json.reader.skip_invalid_records" or even an OFFSET in the query. > > Is there a mechanism or setting I can use to query a topic and not fail on > malformed messages? >
Failure while reading messages from kafka
I have a Kafka topic with some non-JSON test messages in it, resulting in errors "Error: DATA_READ ERROR: Failure while reading messages from kafka. Recordreader was at record: 1" I don't seem to be able to bypass these topic messages with "store.json.reader.skip_invalid_records" or even an OFFSET in the query. Is there a mechanism or setting I can use to query a topic and not fail on malformed messages?