Re: Failure while reading messages from kafka

2019-04-03 Thread Akash Mandlik
The same issue I am facing too. Currently I am working on kafka-0.11.

PF the logs.


Thanks and Regards,

Aakash Mandlik



From: Khurram Faraaz 
Sent: Wednesday, September 5, 2018 12:12:48 AM
To: user@drill.apache.org
Subject: Re: Failure while reading messages from kafka

Can you please share the stack trace from drillbit.log and the version of
Kafka that you are on ?

Thanks,
Khurram

On Tue, Sep 4, 2018 at 11:39 AM, Matt  wrote:

> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.
> apache.org_jira_browse_DRILL-2D6723=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=
> H5JEl9vb-mBIjic10QAbDD2vkUUKAxjO6wZO322RtdI=1BtkhAfyGAwpn_Qov_2S8-
> 0asOGHNYFYaxumWdyI4kE=57Qb0eMSL8xLEok5uB7ovkEkro0DgQwTXYnFeERXGiY=
>
> On Mon, Aug 27, 2018 at 12:27 PM Matt  wrote:
>
> > I have a Kafka topic with some non-JSON test messages in it, resulting in
> > errors "Error: DATA_READ ERROR: Failure while reading messages from
> kafka.
> > Recordreader was at record: 1"
> >
> > I don't seem to be able to bypass these topic messages with
> > "store.json.reader.skip_invalid_records" or even an OFFSET in the query.
> >
> > Is there a mechanism or setting I can use to query a topic and not fail
> on
> > malformed messages?
> >
>
DISCLAIMER
This email and any files transmitted with it are intended solely for the person 
or the entity to whom they are addressed and may contain information which is 
Confidential and Privileged. Any misuse of the information contained in this 
email, including but not limited to retransmission or dissemination of the said 
information by person or entities other than the intended recipient is 
unauthorized and strictly prohibited. If you are not the intended recipient of 
this email, please delete this email and contact the sender immediately.


Re: Failure while reading messages from kafka

2018-09-04 Thread Khurram Faraaz
Can you please share the stack trace from drillbit.log and the version of
Kafka that you are on ?

Thanks,
Khurram

On Tue, Sep 4, 2018 at 11:39 AM, Matt  wrote:

> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.
> apache.org_jira_browse_DRILL-2D6723=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg=
> H5JEl9vb-mBIjic10QAbDD2vkUUKAxjO6wZO322RtdI=1BtkhAfyGAwpn_Qov_2S8-
> 0asOGHNYFYaxumWdyI4kE=57Qb0eMSL8xLEok5uB7ovkEkro0DgQwTXYnFeERXGiY=
>
> On Mon, Aug 27, 2018 at 12:27 PM Matt  wrote:
>
> > I have a Kafka topic with some non-JSON test messages in it, resulting in
> > errors "Error: DATA_READ ERROR: Failure while reading messages from
> kafka.
> > Recordreader was at record: 1"
> >
> > I don't seem to be able to bypass these topic messages with
> > "store.json.reader.skip_invalid_records" or even an OFFSET in the query.
> >
> > Is there a mechanism or setting I can use to query a topic and not fail
> on
> > malformed messages?
> >
>


Re: Failure while reading messages from kafka

2018-09-04 Thread Matt
https://issues.apache.org/jira/browse/DRILL-6723

On Mon, Aug 27, 2018 at 12:27 PM Matt  wrote:

> I have a Kafka topic with some non-JSON test messages in it, resulting in
> errors "Error: DATA_READ ERROR: Failure while reading messages from kafka.
> Recordreader was at record: 1"
>
> I don't seem to be able to bypass these topic messages with
> "store.json.reader.skip_invalid_records" or even an OFFSET in the query.
>
> Is there a mechanism or setting I can use to query a topic and not fail on
> malformed messages?
>