Re: Mirror Maker 2 - Issues

2021-03-10 Thread Navneeth Krishnan
Hi All, I was able to set up MM2 successfully but I see the same message being sent again and again. Also I see the following log message which I don't understand why. The topics on source and destination have the same number of partitions. Please give me some advice. [2021-03-10 09:41:02,072] IN

Re: Mirror Maker 2 - Issues

2021-03-07 Thread Navneeth Krishnan
Thanks, I checked a consumer group using the below command on old and new clusters but the new cluster shows error consumer group doesn't exist. Am I missing something? As per the properties all groups should be included except the backlisted ones. kafka-consumer-groups.sh --bootstrap-server <> -

Re: Mirror Maker 2 - Issues

2021-03-07 Thread Ryanne Dolan
You can see the replicated consumer group offsets using the kafka-consumer-groups.sh tool. Make sure the consumer group is in the groups allowlist. Ryanne On Sun, Mar 7, 2021, 11:09 PM Navneeth Krishnan wrote: > Hi Ryanne, > > I commented out the alias config and set target to source as false.

Re: Mirror Maker 2 - Issues

2021-03-07 Thread Navneeth Krishnan
Hi Ryanne, I commented out the alias config and set target to source as false. Now I don't see the error anymore and everything looks good. Thanks a lot for the feedback. One more question, how can I check if the consumer group offsets are replicated. If I switch over an application to this new cl

Re: Mirror Maker 2 - Issues

2021-03-07 Thread Ryanne Dolan
Navneeth, it looks like you are trying to override the cluster aliases to the empty string. If you look closely, these properties are defined using incorrect syntax. I'm not sure how the properties would be parsed, but you should fix that to rule it out as a source of confusion. Then, be aware tha

Mirror Maker 2 - Issues

2021-03-06 Thread Navneeth Krishnan
Hi All, I'm trying to use mirror maker 2 to replicate data to our new AWS MSK kafka cluster and I have been running into so many issues and I couldn't find proper documentation. Need some help and it's very urgent. Thanks Also I don't see any of my topics created. Note: There are no consumers on