Mickael Maison created KAFKA-10332:
--------------------------------------
Summary: MirrorMaker2 fails to detect topic is remote topic is
created first
Key: KAFKA-10332
URL: https://issues.apache.org/jira/browse/KAFKA-10332
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Affects Versions: 2.6.0
Reporter: Mickael Maison
Assignee: Mickael Maison
Setup:
- 2 clusters: source and target
- Mirroring data from source to target
- create a topic called source.mytopic on the target cluster
- create a topic called mytopic on the source cluster
At this point, MM2 does not start mirroring the topic.
This also happens if you delete and recreate a topic that is being mirrored.
The issue is in
[refreshTopicPartitions()|https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java#L211-L232]
which basically does a diff between the 2 clusters.
When creating the topic on the source cluster last, it makes the partition list
of both clusters match, hence not triggering a reconfiguration
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
