Re: Dealing with diverse consumption speeds

2016-06-23 Thread Marcos Juarez
I'm also interested in knowing if other people have run into this problem of different consumption speeds across consumers, and how they've dealt with it. I've run into this in 0.7, 0.8, both beta and release, and now 0.9.0.1. It doesn't seem to be partition-specific, but consumer-specific. In

Dealing with diverse consumption speeds

2016-01-24 Thread Jens Rantil
Hi, How are you dealing with a slow consumer in Kafka? In the best of world, each consumer will have the exact same specs and the exact same workload. But unfortunately that's rarely true: Virtual machines share hardware with other VMs, some Kafka tasks takes longer to process, some partition