Re: Consumer keeps committing to a partition it no longer holds after a rebalance

2016-03-23 Thread Saurabh Daftary
Yes I can reliably reproduce this. To reproduce it initially start with a single consumer node so that it owns all the partitions. Then add another consumer node, after rebalancing you would see that although the ownership of certain partitions are with the new node the older node which now only o

Re: Consumer keeps committing to a partition it no longer holds after a rebalance

2016-03-23 Thread Christian Posta
How long does this last? Maybe there are some async commit-offset frames left in the send buffer to that node? Can you reliably reproduce this? On Wed, Mar 23, 2016 at 6:29 AM, Saurabh Daftary wrote: > I am running broker 0.9.0 with consumer 0.9.0.1. > > Seeing an issue wherein after a consumer

Consumer keeps committing to a partition it no longer holds after a rebalance

2016-03-23 Thread Saurabh Daftary
I am running broker 0.9.0 with consumer 0.9.0.1. Seeing an issue wherein after a consumer rebalance (when I add a new consumer) my old consumer still keeps committing offsets to partition it no longer holds after a rebalance. The rebalance seem to work ok - On run ConsumerGroupCommand I see that