Ning Zhang created KAFKA-9076:
---------------------------------

             Summary: MirrorMaker 2.0 automated consumer offset sync
                 Key: KAFKA-9076
                 URL: https://issues.apache.org/jira/browse/KAFKA-9076
             Project: Kafka
          Issue Type: Improvement
          Components: mirrormaker
    Affects Versions: 2.4.0
            Reporter: Ning Zhang
             Fix For: 2.5.0


To calculate the translated consumer offset in the target cluster, currently 
`Mirror-client` provides a function called "remoteConsumerOffsets()" that is 
used by "RemoteClusterUtils" for one-time purpose.

In order to make the consumer migration from source to target cluster 
transparent and convenient, e.g. in event of source cluster failure, it is 
better to have a background job to continuously and periodically sync the 
consumer offsets from the source to target cluster, so that when the consumer 
switches to the target cluster, it will resume to consume from where it left 
off at source cluster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to