Re: How many threads should I use per topic

2014-08-14 Thread Joel Koshy
On Thu, Aug 14, 2014 at 10:39:15AM -0700, Chen Wang wrote: > Suppose I have a topic with 5 partitions, and partition 0, 1 has lag of 0, > while the other 3 all have lags. In this case, should I best start 3 > threads, or 5 threads to read from this topic again to achieve best > performance? > I am

How many threads should I use per topic

2014-08-14 Thread Chen Wang
Hey, Guys, I am using the high level consumer. I have a daemon process that checks the lag for a topic. Suppose I have a topic with 5 partitions, and partition 0, 1 has lag of 0, while the other 3 all have lags. In this case, should I best start 3 threads, or 5 threads to read from this topic again