Re: session.timeout.ms limit - Kafka Consumer

2016-03-03 Thread Ewen Cheslack-Postava
In fact, KIP-41 has been implemented in trunk -- see https://issues.apache.org/jira/browse/KAFKA-3007. Testing against a version including that change would be greatly appreciated to ensure it fully addresses the problems you're seeing. -Ewen On Wed, Mar 2, 2016 at 7:00 AM, Olson,Andrew

Re: session.timeout.ms limit - Kafka Consumer

2016-03-02 Thread Olson,Andrew
This topic is currently being discussed at https://issues.apache.org/jira/browse/KAFKA-2986 and https://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records On 3/2/16, 8:11 AM, "Vanessa Gligor" wrote: >Hello, > >I am using Kafka higher

session.timeout.ms limit - Kafka Consumer

2016-03-02 Thread Vanessa Gligor
Hello, I am using Kafka higher consumer 0.9.0. I am not using the auto commit for the offsets, so after I consume the messaged (poll from Kafka) I will have to commit the offsets manually. The issue that I have is actually that the processing of the messages takes longer than 30s (and I cannot