Re: question about mm2 on consumer group offset mirroring

[Calvin Chen]

Hi Ryanne

Thanks for the reply, it helps, thank you very much!

-Calvin

> 在 2021年9月30日，22:52，Ryanne Dolan  写道：
> 
> Hey Calvin, the property you're looking for is
> emit.checkpoint.interval.seconds. That's how often MM will write
> checkpoints, which includes consumer group offsets.
> 
> Ryanne
> 
>> On Thu, Sep 30, 2021, 9:18 AM Calvin Chen  wrote:
>> 
>> Hi all
>> 
>> I have a question about the mirror make 2, on the consumer group offset
>> mirroring, what is the duration for mm2 to detect consumer group offset
>> change and mirror it to remote kafka consumer group?
>> 
>> I have my mm2 code define as below:
>> 
>> 
>> {{ kafka01_name }}->{{ kafka02_name }}.sync.group.offsets.enabled = true
>> {{ kafka02_name }}->{{ kafka01_name }}.sync.group.offsets.enabled = true
>> 
>> refresh.topics.interval.seconds=10
>> refresh.groups.interval.seconds=10
>> 
>> so I would expect the consumer group offset mirroring would happen every
>> around 10 second, but during test, I see sometime consumer group offset
>> mirroring are quick, sometimes it takes minutes, so I would like to know
>> how is offset mirrored and why there is time difference, thanks
>> 
>> -Calvin
>> 

Re: question about mm2 on consumer group offset mirroring

[Ryanne Dolan]

Hey Calvin, the property you're looking for is
emit.checkpoint.interval.seconds. That's how often MM will write
checkpoints, which includes consumer group offsets.

Ryanne

On Thu, Sep 30, 2021, 9:18 AM Calvin Chen  wrote:

> Hi all
>
> I have a question about the mirror make 2, on the consumer group offset
> mirroring, what is the duration for mm2 to detect consumer group offset
> change and mirror it to remote kafka consumer group?
>
> I have my mm2 code define as below:
>
>
> {{ kafka01_name }}->{{ kafka02_name }}.sync.group.offsets.enabled = true
> {{ kafka02_name }}->{{ kafka01_name }}.sync.group.offsets.enabled = true
>
> refresh.topics.interval.seconds=10
> refresh.groups.interval.seconds=10
>
> so I would expect the consumer group offset mirroring would happen every
> around 10 second, but during test, I see sometime consumer group offset
> mirroring are quick, sometimes it takes minutes, so I would like to know
> how is offset mirrored and why there is time difference, thanks
>
> -Calvin
>

question about mm2 on consumer group offset mirroring

[Calvin Chen]

Hi all

I have a question about the mirror make 2, on the consumer group offset 
mirroring, what is the duration for mm2 to detect consumer group offset change 
and mirror it to remote kafka consumer group?

I have my mm2 code define as below:


{{ kafka01_name }}->{{ kafka02_name }}.sync.group.offsets.enabled = true
{{ kafka02_name }}->{{ kafka01_name }}.sync.group.offsets.enabled = true

refresh.topics.interval.seconds=10
refresh.groups.interval.seconds=10

so I would expect the consumer group offset mirroring would happen every around 
10 second, but during test, I see sometime consumer group offset mirroring are 
quick, sometimes it takes minutes, so I would like to know how is offset 
mirrored and why there is time difference, thanks

-Calvin