Re: kafka-streams repeatedly rebalances on start up

2017-06-26 Thread Matthias J. Sax
Great. Thanks a lot for confirming! :) -Matthias On 6/26/17 4:58 AM, Tom Dearman wrote: > Hi Matthias, > > This problem seems to be fixed in 0.11.0.0 client. > > Thanks, > > Tom >> On 17 Jun 2017, at 01:11, Matthias J. Sax wrote: >> >> Hi Tom, >> >> Thanks a lot for reporting this. We dug int

Re: kafka-streams repeatedly rebalances on start up

2017-06-26 Thread Tom Dearman
Hi Matthias, This problem seems to be fixed in 0.11.0.0 client. Thanks, Tom > On 17 Jun 2017, at 01:11, Matthias J. Sax wrote: > > Hi Tom, > > Thanks a lot for reporting this. We dug into it. It's easy to reproduce > (thank a lot to describe a simple way to do that) and it seems to be a > bug

Re: kafka-streams repeatedly rebalances on start up

2017-06-16 Thread Matthias J. Sax
Hi Tom, Thanks a lot for reporting this. We dug into it. It's easy to reproduce (thank a lot to describe a simple way to do that) and it seems to be a bug in Streams... I did open a JIRA: https://issues.apache.org/jira/browse/KAFKA-5464 For using Streams 0.10.2.1, there is nothing we can advice a

kafka-streams repeatedly rebalances on start up

2017-06-08 Thread Tom Dearman
We wanted to have less frequent polling in kafka streams (mostly because we have noticed quite a lot of object creation when polling a queue with no new messages on it), so we have set polling to 10 seconds. On start up when rebalance first happens, the onPartitionsAssigned of ConsumerRebalance