Yes, that is the expected.
You need more partitions per topic, at lest 1 partition per consumer in the group. So if you have n consumers you need n topics. All messages sent to the topic will be divided amongst the partitions. Cheers, Eric Sites On 8/14/13 3:59 PM, "Wu, Jiang2 " <jiang2...@citi.com> wrote: >Hi, > >In our experiments, we find that if multiple consumers in the same group >listen to the same partition, then one consumer will receive all messages >on this partition, and others get none. Is this inherent to Kafka design, >or it can be changed by some configuration? Basically we expect ems queue >behavior, i.e., each of the n consumers receive about 1/n of the total >messages. > >Thanks, >Jiang >