I am using Kafka 0.8.2 and I am using Kafka based storage for offset.
Whenever I restart a consumer (high level consumer api) it is not consuming
messages whichever were posted when the consumer was down.
I am using the following consumer properties
Properties props = new Properties();
props.put("zookeeper.connect", zooKeeper);
props.put("group.id", consumerName);
props.put("zookeeper.session.timeout.ms", "6000");
props.put("zookeeper.sync.time.ms", "200");
props.put("auto.commit.enable", "false");
props.put("offsets.storage", "kafka");
props.put("dual.commit.enabled", "false");
props.put("auto.offset.reset", "largest");
My offset manager is here
https://gist.github.com/gomathi/0d63e29385017577ce3a. I am not sure why the
consumer is behaving weird. Please share any updates if you have.
Thanks & Regards,