[
https://issues.apache.org/jira/browse/KAFKA-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662154#comment-14662154
]
Eli Naeher commented on KAFKA-1006:
-----------------------------------
This issue has caused us problems trying to write automated integration tests
which set up new topics. Are there any plans to address it?
> Consumer loses messages of a new topic with auto.offset.reset = largest
> -----------------------------------------------------------------------
>
> Key: KAFKA-1006
> URL: https://issues.apache.org/jira/browse/KAFKA-1006
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.8.0
> Reporter: Swapnil Ghike
> Assignee: Guozhang Wang
> Labels: usability
>
> Consumer currently uses auto.offset.reset = largest by default. If a new
> topic is created, consumer's topic watcher is fired. The consumer will first
> finish partition reassignment as part of rebalance and then start consuming
> from the tail of each partition. Until the partition reassignment is over,
> the server may have appended new messages to the new topic, consumer won't
> consume these messages. Thus, multiple batches of messages may be lost when a
> topic is newly created.
> The fix is to start consuming from the earliest offset for newly created
> topics.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
