I am using Kafka 0.8.2 and I am using Kafka based storage for offset. Whenever I restart a consumer (high level consumer api) it is not consuming messages whichever were posted when the consumer was down.
I am using the following consumer properties Properties props = new Properties(); props.put("zookeeper.connect", zooKeeper); props.put("group.id", consumerName); props.put("zookeeper.session.timeout.ms", "6000"); props.put("zookeeper.sync.time.ms", "200"); props.put("auto.commit.enable", "false"); props.put("offsets.storage", "kafka"); props.put("dual.commit.enabled", "false"); props.put("auto.offset.reset", "largest"); My offset manager is here https://gist.github.com/gomathi/0d63e29385017577ce3a. I am not sure why the consumer is behaving weird. Please share any updates if you have. Thanks & Regards,