Apurva Mehta created KAFKA-4215:
-----------------------------------

             Summary: Consumers miss messages during partition reassignment
                 Key: KAFKA-4215
                 URL: https://issues.apache.org/jira/browse/KAFKA-4215
             Project: Kafka
          Issue Type: Bug
            Reporter: Apurva Mehta
            Assignee: Apurva Mehta


In the specific case where the replication-factor of a topic is 1, when 
partition reassignment is ongoing, and when a broker is bounced, consumers 
reliably lose some messages in the stream. 

This can be reproduced in system tests where the following error message sis 
observed:

{noformat}
AssertionError: 737 acked message did not make it to the Consumer. They are: 
22530, 45059, 22534, 45063, 22538, 45067, 22542, 45071, 22546, 45075, 22550, 
45079, 22554, 45083, 22558, 45087, 22562, 45091, 22566, 45095, ...plus 717 
more. Total Acked: 51809, Total Consumed: 51073. We validated that the first 
737 of these missing messages correctly made it into Kafka's data files. This 
suggests they were lost on their way to the consumer.
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to