[ 
https://issues.apache.org/jira/browse/KAFKA-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151130#comment-14151130
 ] 

Jun Rao commented on KAFKA-977:
-------------------------------

Sriram,

There has been some discussion related to this in KAFKA-1211 as well. Yes, by 
using the leader generations per partition, we can (1) make sure replicas are 
consistent after unclean leader election; (2) make sure there is no data loss 
in the corner case discussed in KAFKA-1211 (i.e., another leader failure 
happens just after the follower has truncated the log, but before it has 
re-replicated existing committed data from the leader). The change potentially 
requires wire protocol and on-disk format change though. So, we need to think 
through how to do that in a backward compatible way.

> Implement generation/term per leader to reconcile messages correctly
> --------------------------------------------------------------------
>
>                 Key: KAFKA-977
>                 URL: https://issues.apache.org/jira/browse/KAFKA-977
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Sriram Subramanian
>            Assignee: Sriram Subramanian
>
> During unclean leader election, the log messages can diverge and when the 
> followers come back up Kafka does not reconcile correctly. To implement it 
> correctly, we need to add a term/generation to each message and use that to 
> reconcile.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to