Apurva Mehta created KAFKA-4215: ----------------------------------- Summary: Consumers miss messages during partition reassignment Key: KAFKA-4215 URL: https://issues.apache.org/jira/browse/KAFKA-4215 Project: Kafka Issue Type: Bug Reporter: Apurva Mehta Assignee: Apurva Mehta
In the specific case where the replication-factor of a topic is 1, when partition reassignment is ongoing, and when a broker is bounced, consumers reliably lose some messages in the stream. This can be reproduced in system tests where the following error message sis observed: {noformat} AssertionError: 737 acked message did not make it to the Consumer. They are: 22530, 45059, 22534, 45063, 22538, 45067, 22542, 45071, 22546, 45075, 22550, 45079, 22554, 45083, 22558, 45087, 22562, 45091, 22566, 45095, ...plus 717 more. Total Acked: 51809, Total Consumed: 51073. We validated that the first 737 of these missing messages correctly made it into Kafka's data files. This suggests they were lost on their way to the consumer. {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)