I have a topic with 10 partitions. I have 10 consumers (5 processes x 2 threads) on 5 separate machines. Seem like a decent match?
So why does kafka rebalance and commonly assign two (or more) partitions to a single thread? This leaves threads idling and the partitions start lagging. Is there some way to 'smarten up' this process? Better strategy for sharing out work between consumers?
