Re: kafka MirrorMaker2 - stop offset sync when consumer group idle on source cluster

You may be running into the issue described here: https://issues.apache.org/jira/browse/KAFKA-16364 If that's the case, I believe you have two options: 1. Reduce emit.checkpoints.interval.seconds and sync.group.offsets.interval.seconds to reduce the offset lag between source and target cluster

Re: MirrorMaker2 Offset Replication Issue: MirrorCheckpointConnector Doesn't Replicate Final Offsets In Migrations

o see if it resolves your issue. Hope this helps, Greg Harris On Tue, May 28, 2024 at 12:35 PM Mehrtens, M mailto:mmehr...@amazon.com.inva>lid> wrote: > Hi there, > I’m running into an issue with MirrorMaker2 (MM2), specifically the > MirrorCheckpointConnector (CPC). In sho

MirrorMaker2 Offset Replication Issue: MirrorCheckpointConnector Doesn't Replicate Final Offsets In Migrations

Hi there, I’m running into an issue with MirrorMaker2 (MM2), specifically the MirrorCheckpointConnector (CPC). In short, CPC doesn’t replicate the final batch of offsets to the target Kafka cluster during a migration. I believe I can point to the sections of the MM2 code where this is happening,