[jira] [Comment Edited] (KAFKA-16656) Using a custom replication.policy.separator with DefaultReplicationPolicy

2024-05-08 Thread Chris Egerton (Jira)


[ 
https://issues.apache.org/jira/browse/KAFKA-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844653#comment-17844653
 ] 

Chris Egerton edited comment on KAFKA-16656 at 5/8/24 1:15 PM:
---

Hmm... I've expanded my local setup to a full-on integration test to run 
through that scenario and everything is still running smoothly. Are you sure 
you're using the {{DefaultReplicationPolicy}} class and not 
{{{}IdentityReplicationPolicy{}}}?

I should note that my tests are running on the latest trunk, so it's possible 
that there's a bug that's been fixed in between 3.5.1 and now that would 
explain the issues you're seeing.


was (Author: chrisegerton):
Hmm... I've expanded this to an integration test to test out that scenario and 
everything is still running smoothly. Are you sure you're using the 
{{DefaultReplicationPolicy}} class and not {{{}IdentityReplicationPolicy{}}}?

I should note that my tests are running on the latest trunk, so it's possible 
that there's a bug that's been fixed in between 3.5.1 and now that would 
explain the issues you're seeing.

> Using a custom replication.policy.separator with DefaultReplicationPolicy
> -
>
> Key: KAFKA-16656
> URL: https://issues.apache.org/jira/browse/KAFKA-16656
> Project: Kafka
>  Issue Type: Bug
>  Components: mirrormaker
>Affects Versions: 3.5.1
>Reporter: Lenin Joseph
>Priority: Major
>
> Hi,
> In the case of bidirectional replication using mm2, when we tried using a 
> custom replication.policy.separator( ex: "-") with DefaultReplicationPolicy , 
> we see cyclic replication of topics. Could you confirm whether it's mandatory 
> to use a CustomReplicationPolicy whenever we want to use a separator other 
> than a "." ?
> Regards, 
> Lenin



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Comment Edited] (KAFKA-16656) Using a custom replication.policy.separator with DefaultReplicationPolicy

2024-05-08 Thread Lenin Joseph (Jira)


[ 
https://issues.apache.org/jira/browse/KAFKA-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844529#comment-17844529
 ] 

Lenin Joseph edited comment on KAFKA-16656 at 5/8/24 6:47 AM:
--

Hi [~ChrisEgerton] , thanks for looking into it.
We see cyclic replication for all the topics including internal topics such as 
mm2-offset-syncs, checkpoint, mirrormaker2-cluster-status,  
mirrormaker2-cluster-configs, and mirrormaker2-cluster-offsets. But not for 
consumer-offsets topic.

Below are the configs that we have used.
topicsPattern: ".*"

replication.policy.separator: "-"

replication.policy.class: 
org.apache.kafka.connect.mirror.DefaultReplicationPolicy


was (Author: JIRAUSER304387):
Hi [~ChrisEgerton] , thanks for looking into it.
We see cyclic replication for all the topics including internal topics such as 
mm2-offset-syncs, checkpoint, mirrormaker2-cluster-status,  
mirrormaker2-cluster-configs, and mirrormaker2-cluster-offsets. But not for 
consumer-offsets topic.

Below are the configs that we have used.
topicsPattern: ".*"

replication.policy.separator: "-"

replication.policy.class: 
org.apache.kafka.connect.mirror.IdentityReplicationPolicy

> Using a custom replication.policy.separator with DefaultReplicationPolicy
> -
>
> Key: KAFKA-16656
> URL: https://issues.apache.org/jira/browse/KAFKA-16656
> Project: Kafka
>  Issue Type: Bug
>  Components: mirrormaker
>Affects Versions: 3.5.1
>Reporter: Lenin Joseph
>Priority: Major
>
> Hi,
> In the case of bidirectional replication using mm2, when we tried using a 
> custom replication.policy.separator( ex: "-") with DefaultReplicationPolicy , 
> we see cyclic replication of topics. Could you confirm whether it's mandatory 
> to use a CustomReplicationPolicy whenever we want to use a separator other 
> than a "." ?
> Regards, 
> Lenin



--
This message was sent by Atlassian Jira
(v8.20.10#820010)