[
https://issues.apache.org/jira/browse/KAFKA-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603115#comment-14603115
]
Matthieu Sprunck commented on KAFKA-2302:
-----------------------------------------
After calling the shutdown() method there is no way to commit offsets of the
current read chunk messages. The connection to zookeeper is closed.
The current workflow for the shutdown is :
# Shutdown of Wildcard topic watcher
# Shutdown of Auto commit scheduler
# Closing of fetcher connections
# Clearing of the chunk messages queue and sending of the shutdown command
# Commit of last offsets (only for auto commit)
# Closing of the zookeeper connection
>From my comprehension, the fourth step is not sufficient. The consumer
>iterator is only able to read the shutdown command in the queue after all
>messages of the current chunk have been consumed. By calling the close()
>method of the Kafka stream the current stream would be cleared.
> Currently iterated chunk is not cleared during consumer shutdown
> ----------------------------------------------------------------
>
> Key: KAFKA-2302
> URL: https://issues.apache.org/jira/browse/KAFKA-2302
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 0.8.1.1
> Reporter: Matthieu Sprunck
> Assignee: Joel Koshy
>
> During consumer connector shutdown, fetch queues are cleared, but the
> currently iterated chunk is not cleared.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
