Re: Kafka consumer session timeouts

2014-12-22 Thread Neha Narkhede
Terry, The zookeeper client used by the high level Kafka consumer has a separate thread that does the heartbeat in the background. So even if it takes long to process the message, it should not make the consumer's session to time out or make the consumer rebalance. You may be running into long GC

Kafka consumer session timeouts

2014-12-19 Thread Terry Cumaranatunge
Hi I would like to get some feedback on design choices with kafka consumers. We have an application that a consumer reads a message and the thread does a number of things, including database accesses before a message is produced to another topic. The time between consuming and producing the