[
https://issues.apache.org/jira/browse/KAFKA-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110100#comment-14110100
]
Gwen Shapira commented on KAFKA-1612:
-------------------------------------
You should be able to use the commitOffsets() API to commit data before
processing the messages.
> Consumer offsets auto-commit before processing finishes
> -------------------------------------------------------
>
> Key: KAFKA-1612
> URL: https://issues.apache.org/jira/browse/KAFKA-1612
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 0.8.1.1
> Reporter: Gian Merlino
> Assignee: Neha Narkhede
>
> In a loop like this,
> for (message <- kafkaStream) {
> process(message)
> }
> The consumer can commit offsets for the next message while "process" is
> running. If the program crashes during "process", the next run will pick up
> from the *next* message. The message in flight at the time of the crash will
> never actually finish processing. Instead, I would have expected the high
> level consumer to deliver messages at least once.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
