Re: Kafka Consumer Questions

2011-11-17 Thread Joel Koshy
Casey, You are right about the high-level (Zookeeper) consumer dealing with broker failures - in which case a "rebalance" is triggered to evenly re-allocate the consumption of partitions across the consumers in the consumer group. Furthermore, if you set autocommit.enabled to true, then it will co

Kafka Consumer Questions

2011-11-17 Thread Sybrandy, Casey
Hello, I have a couple questions about consumers. 1) What's the preferred method of writing a consumer? The SimpleConsumer or the Zookeeper consumer? I'm guessing the Zookeeper one allows the consumer to handle failures within the Kafka cluster. E.g. If one node goes down, the consumer will