[ https://issues.apache.org/jira/browse/KAFKA-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151130#comment-14151130 ]
Jun Rao commented on KAFKA-977: ------------------------------- Sriram, There has been some discussion related to this in KAFKA-1211 as well. Yes, by using the leader generations per partition, we can (1) make sure replicas are consistent after unclean leader election; (2) make sure there is no data loss in the corner case discussed in KAFKA-1211 (i.e., another leader failure happens just after the follower has truncated the log, but before it has re-replicated existing committed data from the leader). The change potentially requires wire protocol and on-disk format change though. So, we need to think through how to do that in a backward compatible way. > Implement generation/term per leader to reconcile messages correctly > -------------------------------------------------------------------- > > Key: KAFKA-977 > URL: https://issues.apache.org/jira/browse/KAFKA-977 > Project: Kafka > Issue Type: Bug > Reporter: Sriram Subramanian > Assignee: Sriram Subramanian > > During unclean leader election, the log messages can diverge and when the > followers come back up Kafka does not reconcile correctly. To implement it > correctly, we need to add a term/generation to each message and use that to > reconcile. -- This message was sent by Atlassian JIRA (v6.3.4#6332)