Kafka consumer session timeouts

2014-12-19 Thread Terry Cumaranatunge
Hi I would like to get some feedback on design choices with kafka consumers. We have an application that a consumer reads a message and the thread does a number of things, including database accesses before a message is produced to another topic. The time between consuming and producing the

ERROR [ReplicaFetcherThread-0-202], Error for partition

2014-12-17 Thread Terry Cumaranatunge
Hello, I'm using 0.8.2-beta with 3 brokers and 3 zookeeper nodes (3.4.6). I had some known issues with 0.8.1.1 that were supposedly fixed in 0.8.2, so I moved to 0.82-beta, but now I'm getting different errors in 0.8.2-beta. All the brokers come up fine and registered with the zookeeper. Then, I