[ 
https://issues.apache.org/jira/browse/KAFKA-557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jay Kreps updated KAFKA-557:
----------------------------

    Attachment: KAFKA-557.patch

Attached is a patch that makes offset assignment by the log optional. This is a 
bit hacky since it adds more casewise logic into Log depending on who is 
assigning offsets.

But with this patch now
1. It is not possible for the follower to assign different offsets than the 
leader
2. The follower log should be byte-for-byte identical to the leader

A best effort is made to validate the offsets in the case that we are not 
assigning them, but this does not extend to actually decompressing the message 
set.
                
> Replica fetch thread doesn't need to recompute message id
> ---------------------------------------------------------
>
>                 Key: KAFKA-557
>                 URL: https://issues.apache.org/jira/browse/KAFKA-557
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.8
>            Reporter: Jun Rao
>            Priority: Blocker
>              Labels: bugs
>         Attachments: KAFKA-557.patch
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> With kafka-506, the leader broker computes the logical id for each message 
> produced. This could involve decompressing and recompressing messages, which 
> are expensive. When data is replicated from the leader to the follower, we 
> could avoid recomputing the logical message id since it's the same.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to