[
https://issues.apache.org/jira/browse/KAFKA-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15519566#comment-15519566
]
Apurva Mehta commented on KAFKA-4215:
-------------------------------------
Another observation: the consumer only misses messages when unclean leader
election is enabled, further bolstering the theory above.
> Consumers miss messages during partition reassignment
> -----------------------------------------------------
>
> Key: KAFKA-4215
> URL: https://issues.apache.org/jira/browse/KAFKA-4215
> Project: Kafka
> Issue Type: Bug
> Reporter: Apurva Mehta
> Assignee: Apurva Mehta
>
> In the specific case where the replication-factor of a topic is 1, when
> partition reassignment is ongoing, and when a broker is bounced, consumers
> reliably lose some messages in the stream.
> This can be reproduced in system tests where the following error message sis
> observed:
> {noformat}
> AssertionError: 737 acked message did not make it to the Consumer. They are:
> 22530, 45059, 22534, 45063, 22538, 45067, 22542, 45071, 22546, 45075, 22550,
> 45079, 22554, 45083, 22558, 45087, 22562, 45091, 22566, 45095, ...plus 717
> more. Total Acked: 51809, Total Consumed: 51073. We validated that the first
> 737 of these missing messages correctly made it into Kafka's data files. This
> suggests they were lost on their way to the consumer.
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
