Erratic behavior when quickly re-balancing

2014-10-22 Thread Eric Bottard
For the purpose of a unit/integration test for Spring XD, I am creating several consumers (in the same group) in quick succession. With just 3 consumers, this triggers 2 rebalances that (on some machines) can't be dealt with in the default 4*2000ms and fails. I have created a simple use case that

Re: Erratic behavior when quickly re-balancing

2014-10-22 Thread Guozhang Wang
Hello Eric, 1) The rebalance failures is mainly on ZK session timeout, you could try to increase your zk session timeout value and see if that helps. 2) The new consumer in 0.9 re-write will resolve this problem by getting rid of the ZK dependency and use a centralized coordinator for rebalance