Gian Merlino created KAFKA-1612:
-----------------------------------
Summary: Consumer offsets auto-commit before processing finishes
Key: KAFKA-1612
URL: https://issues.apache.org/jira/browse/KAFKA-1612
Project: Kafka
Issue Type: Bug
Components: consumer
Affects Versions: 0.8.1.1
Reporter: Gian Merlino
Assignee: Neha Narkhede
In a loop like this,
for (message <- kafkaStream) {
process(message)
}
The consumer can commit offsets for the next message while "process" is
running. If the program crashes during "process", the next run will pick up
from the *next* message. The message in flight at the time of the crash will
never actually finish processing. Instead, I would have expected the high level
consumer to deliver messages at least once.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
