Jason Rosenberg created KAFKA-955:
-------------------------------------
Summary: After a leader change, messages sent with ack=0 are lost
Key: KAFKA-955
URL: https://issues.apache.org/jira/browse/KAFKA-955
Project: Kafka
Issue Type: Bug
Reporter: Jason Rosenberg
If the leader changes for a partition, and a producer is sending messages with
ack=0, then messages will be lost, since the producer has no active way of
knowing that the leader has changed, until it's next metadata refresh update.
The broker receiving the message, which is no longer the leader, logs a message
like this:
Produce request with correlation id 7136261 from client on partition
[mytopic,0] failed due to Leader not local for partition [mytopic,0] on broker
508818741
This is exacerbated by the controlled shutdown mechanism, which forces an
immediate leader change.
A possible solution to this would be for a broker which receives a message, for
a topic that it is no longer the leader for (and if the ack level is 0), then
the broker could just silently forward the message over to the current leader.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira