Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Cody Koeninger
https://issues.apache.org/jira/browse/SPARK-19680 and https://issues.apache.org/jira/browse/KAFKA-3370 has a good explanation. Verify that it works correctly with auto offset set to latest, to rule out other issues. Then try providing explicit starting offsets reasonably near the beginning of

Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Matthias J. Sax
I don't know if any workaround. Maybe ask at Spark mailing list? -Matthias On 2/12/18 1:20 PM, Ted Yu wrote: > Have you looked at SPARK-19888 ? > > Please give the full stack trace of the exception you saw. > > Cheers > > On Mon, Feb 12, 2018 at 12:38 PM, Mina Aslani

Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Ted Yu
Have you looked at SPARK-19888 ? Please give the full stack trace of the exception you saw. Cheers On Mon, Feb 12, 2018 at 12:38 PM, Mina Aslani wrote: > Hi Matthias, > Are you referring to https://issues.apache.org/jira/browse/SPARK-19976? > Doesn't look like that the

Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Mina Aslani
; > > > I am getting below error > > Caused by: org.apache.kafka.clients.consumer.OffsetOutOfRangeException: > > Offsets out of range with no configured reset policy for partitions: > > {topic1-0=304337} > > as soon as I submit a spark app to my cluster. > > > > I am using below dependency > > na

Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Mina Aslani
; > > > I am getting below error > > Caused by: org.apache.kafka.clients.consumer.OffsetOutOfRangeException: > > Offsets out of range with no configured reset policy for partitions: > > {topic1-0=304337} > > as soon as I submit a spark app to my cluster. > > > > I am using below dependency > &

Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Matthias J. Sax
> Caused by: org.apache.kafka.clients.consumer.OffsetOutOfRangeException: > Offsets out of range with no configured reset policy for partitions: > {topic1-0=304337} > as soon as I submit a spark app to my cluster. > > I am using below dependency > name: 'spark-streaming-kafka-0-10_2.11', version: '2.2.0' And setting the

org.apache.kafka.clients.consumer.OffsetOutOfRangeException

2018-02-12 Thread Mina Aslani
Hi, I am getting below error Caused by: org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {topic1-0=304337} as soon as I submit a spark app to my cluster. I am using below dependency name: 'spark-streaming-kafka-0