Jason Gustafson created KAFKA-2942:
--------------------------------------
Summary: Inadvertent auto-commit when pre-fetching can cause
message loss
Key: KAFKA-2942
URL: https://issues.apache.org/jira/browse/KAFKA-2942
Project: Kafka
Issue Type: Bug
Reporter: Jason Gustafson
Assignee: Jason Gustafson
Before returning from KafkaConsumer.poll(), we update the consumed position and
invoke poll(0) to send new fetches. In doing so, it is possible that an
auto-commit is triggered which would commit the updated offsets which hasn't
yet been returned. If the process then crashes before consuming the messages,
there would be a gap in the delivery.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)