High-level consumer load-balancing problem

2013-11-14 Thread hsy...@gmail.com
Hi, I have questions about the load balancing of kafka high-level consumer Suppose I have 4 partition And the producer throughput to these 4 partitions are like this 01 23 10MB/s 10MB/s 1MB/s1MB/s 1kMsg/s,10kMs

Re: High-level consumer load-balancing problem

2013-11-14 Thread Jun Rao
The consumer load balancing logic today is pretty simple. It just tries to divide the partitions evenly among the consumers. It doesn't try to balance by load. Thanks, Jun On Thu, Nov 14, 2013 at 3:34 PM, hsy...@gmail.com wrote: > Hi, > > I have questions about the load balancing of kafka hig