Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Yeah. Quite possible. Completely missed this possibility. What I simply did was to download and add the kafka-streams jar as a dependency. I didn't update the downstream dependencies. My bad! On Tue, Apr 18, 2017 at 7:42 PM, Eno Thereska wrote: > Hi Mahendra, > > I see

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hi Mahendra, I see the java.lang.NoSuchMethodError: org.apache.kafka.clients... error. Looks like some jars aren't in the classpath? Eno > On 18 Apr 2017, at 12:46, Mahendra Kariya wrote: > > Hey Eno, > > I just pulled the latest jar from the link you shared and

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hey Eno, I just pulled the latest jar from the link you shared and tried to run my code. I am getting the following exception on new KafkaStreams(). The same code is working fine with 0.10.2.0 jar. Exception in thread "main" org.apache.kafka.common.KafkaException: Failed to construct kafka

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Thanks! On Tue, Apr 18, 2017, 12:26 AM Eno Thereska wrote: > The RC candidate build is here: > http://home.apache.org/~gwenshap/kafka-0.10.2.1-rc1/ < > http://home.apache.org/~gwenshap/kafka-0.10.2.1-rc1/> > > Eno > > On 17 Apr 2017, at 17:20, Mahendra Kariya

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

The RC candidate build is here: http://home.apache.org/~gwenshap/kafka-0.10.2.1-rc1/ Eno > On 17 Apr 2017, at 17:20, Mahendra Kariya wrote: > > Thanks! > > In the meantime, is the jar published somewhere on

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Thanks! In the meantime, is the jar published somewhere on github or as a part of build pipeline? On Mon, Apr 17, 2017 at 9:18 PM, Eno Thereska wrote: > Not yet, but as soon as 0.10.2 is voted it should be. Hopefully this week. > > Eno > > On 17 Apr 2017, at 13:25,

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Not yet, but as soon as 0.10.2 is voted it should be. Hopefully this week. Eno > On 17 Apr 2017, at 13:25, Mahendra Kariya wrote: > > Are the bug fix releases published to Maven central repo? > > On Sat, Apr 1, 2017 at 12:26 PM, Eno Thereska

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Are the bug fix releases published to Maven central repo? On Sat, Apr 1, 2017 at 12:26 PM, Eno Thereska wrote: > Hi Sachin, > > In the bug fix release for 0.10.2 (and in trunk) we have now set > max.poll.interval to infinite since from our experience with streams this >

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hi Sachin, In the bug fix release for 0.10.2 (and in trunk) we have now set max.poll.interval to infinite since from our experience with streams this should not be something that users set: https://github.com/apache/kafka/pull/2770/files .

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Should this timeout be less than max poll interval value? if yes than generally speaking what should be the ratio between two or range for this timeout value . Thanks Sachin On 1 Apr 2017 04:57, "Matthias J. Sax" wrote: Yes, you can increase

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Yes, you can increase ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG -Matthias On 3/31/17 11:32 AM, Sachin Mittal wrote: > Hi, > So I have added the config ProducerConfig.RETRIES_CONFIG, Integer.MAX_VALUE > and the NotLeaderForPartitionException is gone. > > However we see a new exception

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hi, So I have added the config ProducerConfig.RETRIES_CONFIG, Integer.MAX_VALUE and the NotLeaderForPartitionException is gone. However we see a new exception especially under heavy load: org.apache.kafka.streams.errors.StreamsException: task [0_1] exception caught when producing at

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hi Sachin, Not in this case. Thanks Eno > On Mar 25, 2017, at 6:19 PM, Sachin Mittal wrote: > > OK. > I will try this out. > > Do I need to change anything for > max.in.flight.requests.per.connection > > Thanks > Sachin > > > On Sat, Mar 25, 2017 at 10:59 PM, Eno

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

OK. I will try this out. Do I need to change anything for max.in.flight.requests.per.connection Thanks Sachin On Sat, Mar 25, 2017 at 10:59 PM, Eno Thereska wrote: > Hi Sachin, > > For this particular error, “org.apache.kafka.common.errors. >

Re: Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hi Sachin, For this particular error, “org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.”, could you try setting the number of retries to something large like this: Properties props = new Properties();

Kafka streams 0.10.2 Producer throwing exception eventually causing streams shutdown

Hi, We have encountered another case of series of errors which I would need more help in understanding. In logs we see message like this: ERROR 2017-03-25 03:41:40,001 [kafka-producer-network-thread | 85-StreamThread-3-producer]: org.apache.kafka.streams.processor.internals.RecordCollectorImpl -