Jason Gustafson created KAFKA-2942: -------------------------------------- Summary: Inadvertent auto-commit when pre-fetching can cause message loss Key: KAFKA-2942 URL: https://issues.apache.org/jira/browse/KAFKA-2942 Project: Kafka Issue Type: Bug Reporter: Jason Gustafson Assignee: Jason Gustafson
Before returning from KafkaConsumer.poll(), we update the consumed position and invoke poll(0) to send new fetches. In doing so, it is possible that an auto-commit is triggered which would commit the updated offsets which hasn't yet been returned. If the process then crashes before consuming the messages, there would be a gap in the delivery. -- This message was sent by Atlassian JIRA (v6.3.4#6332)