Re: Kafka rebalance at the group name level?

2016-05-10 Thread Spico Florin
Hi! Thank you for your answer. Ithelps me since it confirms me the observations (I'm not the only one :)). I could not find the documentation that states this clear "Rebalance is performed at the group level no matter from what topic your are consuming that belongs to it. " The pictures that I'v

Re: Kafka rebalance at the group name level?

2016-05-10 Thread John Holland
I haven't browsed the source for the rebalance algorithm but anecdotally It appears this is the case. In our system we have a consumer group whose application instances are not only scaled but also split by topics (some topics have much higher message rates). When we perform a deployment of one of

Kafka rebalance at the group name level?

2016-05-10 Thread Spico Florin
I have 3 topics A,B,C with same number of partitions. I use the same group name for all the consumers to this topics. My questions are: 1. If a consumer for one of the topics/partitions will rebalance be triggered for the other two topics consumers? 2. Same if adding a new partition for one top