Strange ZK Error precedes frequent rebalances

2015-10-14 Thread noah
A number of our developers are seeing errors like the one below in their console when running a consumer on their laptop. The error is always followed by logging indicating that the local consumer is rebalancing, and in the meantime we are not making much progress. I'm reading this as the

Re: Strange ZK Error precedes frequent rebalances

2015-10-14 Thread Gwen Shapira
It is not strange, it means that one of the consumers lost connectivity to Zookeeper, its session timed-out and this caused ephemeral ZK nodes (like /consumers/real-time-updates/ids/real-time-updates_infra- buildagent-06-1444854764478-4dd4d6af) to be removed and ultimately cause the rebalance.

Re: Strange ZK Error precedes frequent rebalances

2015-10-14 Thread noah
Thanks Gwen. So am I right in deducing that any consumer in the same group dropping will cause a rebalance, regardless of which topics they are subscribed to? On Wed, Oct 14, 2015 at 3:52 PM Gwen Shapira wrote: > It is not strange, it means that one of the consumers lost

Re: Strange ZK Error precedes frequent rebalances

2015-10-14 Thread Gwen Shapira
Yes. The rebalance is on consumers in the group and does not take topics into account. On Wed, Oct 14, 2015 at 1:59 PM, noah wrote: > Thanks Gwen. > > So am I right in deducing that any consumer in the same group dropping will > cause a rebalance, regardless of which topics