Not a problem Greg. Is there some documentation explaining the same ? I tried to find a lot in the past
________________________________ From: Greg Harris <greg.har...@aiven.io.INVALID> Sent: Monday, October 23, 2023 11:23:26 PM To: users@kafka.apache.org <users@kafka.apache.org> Subject: Re: Mirror Maker 2 - offset sync from source to target [You don't often get email from greg.har...@aiven.io.invalid. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ] CAUTION: This email is from an external source. Please don’t open any unknown links or attachments. Alexander, My apologies for calling you Andrew. Greg On Mon, Oct 23, 2023 at 1:22 PM Greg Harris <greg.har...@aiven.io> wrote: > > Andrew, > > Yes, there isn't an explicit "create consumer group" operation, it > should be created when MM2 emits a sync for it. > > Best, > Greg > > On Mon, Oct 23, 2023 at 1:15 PM Alexander Shapiro (ashapiro) > <alexander.shap...@amdocs.com.invalid> wrote: > > > > Thanks, one clarification plz > > > > In bullet for You mention "4. The target group does not exist, or has no > > active consumers" > > If group on target does not exist, will it be created without active > > consumers ? > > > > -----Original Message----- > > From: Greg Harris <greg.har...@aiven.io.INVALID> > > Sent: Monday, October 23, 2023 8:56 PM > > To: users@kafka.apache.org > > Subject: Re: Mirror Maker 2 - offset sync from source to target > > > > [You don't often get email from greg.har...@aiven.io.invalid. Learn why > > this is important at https://aka.ms/LearnAboutSenderIdentification ] > > > > CAUTION: This email is from an external source. Please don’t open any > > unknown links or attachments. > > > > Hi Alexander, > > > > Sorry I noticed an inconsistency in my last email. For point 6: > > If the MirrorCheckpointTask restarts after replication but before offset is > > translated, then it may not be able to perform a translation. > > If the MirrorCheckpointTask does not restart, it should be able to perform > > translation. > > > > So if your MirrorMaker2 is restarting frequently, that may prevent > > consistent translation. > > > > Thanks, > > Greg > > > > On Mon, Oct 23, 2023 at 10:46 AM Alexander Shapiro (ashapiro) > > <alexander.shap...@amdocs.com.invalid> wrote: > > > > > > Hi Greg, > > > Thank you very much, > > > it is the most detailed answer I would expect. > > > > > > -----Original Message----- > > > From: Greg Harris <greg.har...@aiven.io.INVALID> > > > Sent: Monday, October 23, 2023 8:42 PM > > > To: users@kafka.apache.org > > > Subject: Re: Mirror Maker 2 - offset sync from source to target > > > > > > CAUTION: This email is from an external source. Please don’t open any > > > unknown links or attachments. > > > > > > Hi Alexander, > > > > > > Thanks for using MirrorMaker2! > > > > > > If you turn on `sync.group.offsets.enabled`, then the > > > MirrorCheckpointTask will sync the offsets if all of the following is > > > true: > > > 1. The source group exists > > > 2. The source group name matches the configured group filter > > > (group.filter.class, groups, groups.exclude) 3. The source group has an > > > offset for a topic which matches the configured topic filter > > > (topic.filter.class, topics, topics.exclude) 4. The target group does not > > > exist, or has no active consumers 5. The target group has no offset for a > > > specified partition, or the offset is earlier than the translated offset > > > 6. MirrorCheckpointTask restarted after replication happened but before > > > the offset could be translated. > > > > > > If one of these isn't true, you won't see translation happening. > > > > > > Are you having a problem with too many consumer groups being created? > > > You can restrict the group or topic filters, as they're very permissive > > > by default. > > > Or is the problem that you expect the consumer groups to be created, but > > > they aren't? One of the above conditions may not be satisfied, or your > > > MirrorCheckpointConnector/Task may be malfunctioning and you'll need to > > > inspect the logs to debug it. > > > > > > Best, > > > Greg Harris > > > > > > On Sun, Oct 22, 2023 at 5:36 AM Alexander Shapiro (ashapiro) > > > <alexander.shap...@amdocs.com.invalid> wrote: > > > > > > > > Hi > > > > Can someone advise please > > > > if sync.group.offsets.enabled : true to sync offset from source to > > > > target for particular consumer group That group must be created on > > > > target, even if no actual consumption will be done ? > > > > > > > > > > > > > > > > This email and the information contained herein is proprietary and > > > > confidential and subject to the Amdocs Email Terms of Service, which > > > > you may review at > > > > https://www.amdocs.com/about/email-terms-of-service > > > > <https://www.amdocs.com/about/email-terms-of-service> > > > This email and the information contained herein is proprietary and > > > confidential and subject to the Amdocs Email Terms of Service, which > > > you may review at https://www.amdocs.com/about/email-terms-of-service > > > <https://www.amdocs.com/about/email-terms-of-service> > > This email and the information contained herein is proprietary and > > confidential and subject to the Amdocs Email Terms of Service, which you > > may review at https://www.amdocs.com/about/email-terms-of-service > > <https://www.amdocs.com/about/email-terms-of-service> This email and the information contained herein is proprietary and confidential and subject to the Amdocs Email Terms of Service, which you may review at https://www.amdocs.com/about/email-terms-of-service <https://www.amdocs.com/about/email-terms-of-service>
