[jira] [Commented] (KAFKA-9827) MM2 doesnt replicate data
[
https://issues.apache.org/jira/browse/KAFKA-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106178#comment-17106178
]
victor commented on KAFKA-9827:
---
1.Is running dedicated mm2 cluster with more than one nodes?
2.Whether a topic for unsynchronized data is created after the mm cluster is
started?
> MM2 doesnt replicate data
> -
>
> Key: KAFKA-9827
> URL: https://issues.apache.org/jira/browse/KAFKA-9827
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
>Affects Versions: 2.4.0, 2.4.1
>Reporter: Dmitry
>Priority: Major
> Attachments: mm2.log
>
>
> I have 2 servers with different node count:
> # 2.4.0 version, 3 nodes, broker port plaintext:9090
> # 2.4.0 version, 1 nodes, broker port plaintext:
> I want to transfer data from cluster 1 -> cluster 2 by mirror maker 2.
> MM2 configuration:
>
> {code:java}
> name = mm2-backupFlow
> topics = .*
> groups = .*
> # specify any number of cluster aliases
> clusters = m1-source, m1-backup
> # connection information for each cluster
> m1-source.bootstrap.servers = 172.17.165.49:9090, 172.17.165.50:9090,
> 172.17.165.51:9090
> m1-backup.bootstrap.servers = 172.17.165.52:
> # enable and configure individual replication flows
> m1-source->m1-backup.enabled = true
> m1-soruce->m1-backup.emit.heartbeats.enabled = false
> {code}
>
> When i start MM2 on each clusters created 3 topics:
> * heartbeat
> * *.internal
> And thats all. Nothing to happend.
> I watching next ERROR's:
> {code:java}
> [2020-04-07 07:19:16,821] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorHeartbeatConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:18,312] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorCheckpointConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:16,807] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorSourceConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165){code}
> Full log in attach
> What i missed ? Help please
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KAFKA-9827) MM2 doesnt replicate data
[
https://issues.apache.org/jira/browse/KAFKA-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077051#comment-17077051
]
Srinivas Boga commented on KAFKA-9827:
--
Also how can i avoid the suffix(alias) in the topic name, i am in the process
of moving from kafak-0.11 to kafka-2.4.0 and want to setup the replication
either ways till we complete the migration, so that different services can
publish and consume from both the clusters
Thanks,
-srini
> MM2 doesnt replicate data
> -
>
> Key: KAFKA-9827
> URL: https://issues.apache.org/jira/browse/KAFKA-9827
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
>Affects Versions: 2.4.0, 2.4.1
>Reporter: Dmitry
>Priority: Major
> Attachments: mm2.log
>
>
> I have 2 servers with different node count:
> # 2.4.0 version, 3 nodes, broker port plaintext:9090
> # 2.4.0 version, 1 nodes, broker port plaintext:
> I want to transfer data from cluster 1 -> cluster 2 by mirror maker 2.
> MM2 configuration:
>
> {code:java}
> name = mm2-backupFlow
> topics = .*
> groups = .*
> # specify any number of cluster aliases
> clusters = m1-source, m1-backup
> # connection information for each cluster
> m1-source.bootstrap.servers = 172.17.165.49:9090, 172.17.165.50:9090,
> 172.17.165.51:9090
> m1-backup.bootstrap.servers = 172.17.165.52:
> # enable and configure individual replication flows
> m1-source->m1-backup.enabled = true
> m1-soruce->m1-backup.emit.heartbeats.enabled = false
> {code}
>
> When i start MM2 on each clusters created 3 topics:
> * heartbeat
> * *.internal
> And thats all. Nothing to happend.
> I watching next ERROR's:
> {code:java}
> [2020-04-07 07:19:16,821] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorHeartbeatConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:18,312] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorCheckpointConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:16,807] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorSourceConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165){code}
> Full log in attach
> What i missed ? Help please
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KAFKA-9827) MM2 doesnt replicate data
[
https://issues.apache.org/jira/browse/KAFKA-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077012#comment-17077012
]
Srinivas Boga commented on KAFKA-9827:
--
Im also facing exact same issue, this is the config i am using
mm2.properties
clusters: stg-240,prod-011
stg-240.bootstrap.servers = stg-240:9092
prod-011.bootstrap.servers = prod-011:9092
stg-240->prod-011.enabled = true
stg-240->prod-011.topics = test
prod-011->stg-240.enabled = true
prod-011->stg-240.topics = test
{code:java}
{code}
> MM2 doesnt replicate data
> -
>
> Key: KAFKA-9827
> URL: https://issues.apache.org/jira/browse/KAFKA-9827
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
>Affects Versions: 2.4.0, 2.4.1
>Reporter: Dmitry
>Priority: Major
> Attachments: mm2.log
>
>
> I have 2 servers with different node count:
> # 2.4.0 version, 3 nodes, broker port plaintext:9090
> # 2.4.0 version, 1 nodes, broker port plaintext:
> I want to transfer data from cluster 1 -> cluster 2 by mirror maker 2.
> MM2 configuration:
>
> {code:java}
> name = mm2-backupFlow
> topics = .*
> groups = .*
> # specify any number of cluster aliases
> clusters = m1-source, m1-backup
> # connection information for each cluster
> m1-source.bootstrap.servers = 172.17.165.49:9090, 172.17.165.50:9090,
> 172.17.165.51:9090
> m1-backup.bootstrap.servers = 172.17.165.52:
> # enable and configure individual replication flows
> m1-source->m1-backup.enabled = true
> m1-soruce->m1-backup.emit.heartbeats.enabled = false
> {code}
>
> When i start MM2 on each clusters created 3 topics:
> * heartbeat
> * *.internal
> And thats all. Nothing to happend.
> I watching next ERROR's:
> {code:java}
> [2020-04-07 07:19:16,821] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorHeartbeatConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:18,312] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorCheckpointConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:16,807] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorSourceConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165){code}
> Full log in attach
> What i missed ? Help please
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KAFKA-9827) MM2 doesnt replicate data
[
https://issues.apache.org/jira/browse/KAFKA-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076971#comment-17076971
]
Sönke Liebau commented on KAFKA-9827:
-
This sounds related to KAFKA-9376 though if I read that ticket correctly they
saw data being replicated in that case, so potentially not a duplicate?
[~ryannedolan] maybe you are better positioned to comment?
> MM2 doesnt replicate data
> -
>
> Key: KAFKA-9827
> URL: https://issues.apache.org/jira/browse/KAFKA-9827
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
>Affects Versions: 2.4.0, 2.4.1
>Reporter: Dmitry
>Priority: Major
> Attachments: mm2.log
>
>
> I have 2 servers with different node count:
> # 2.4.0 version, 3 nodes, broker port plaintext:9090
> # 2.4.0 version, 1 nodes, broker port plaintext:
> I want to transfer data from cluster 1 -> cluster 2 by mirror maker 2.
> MM2 configuration:
>
> {code:java}
> name = mm2-backupFlow
> topics = .*
> groups = .*
> # specify any number of cluster aliases
> clusters = m1-source, m1-backup
> # connection information for each cluster
> m1-source.bootstrap.servers = 172.17.165.49:9090, 172.17.165.50:9090,
> 172.17.165.51:9090
> m1-backup.bootstrap.servers = 172.17.165.52:
> # enable and configure individual replication flows
> m1-source->m1-backup.enabled = true
> m1-soruce->m1-backup.emit.heartbeats.enabled = false
> {code}
>
> When i start MM2 on each clusters created 3 topics:
> * heartbeat
> * *.internal
> And thats all. Nothing to happend.
> I watching next ERROR's:
> {code:java}
> [2020-04-07 07:19:16,821] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorHeartbeatConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:18,312] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorCheckpointConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165)
> {code}
> {code:java}
> [2020-04-07 07:19:16,807] ERROR Plugin class loader for connector:
> 'org.apache.kafka.connect.mirror.MirrorSourceConnector' was not found.
> Returning:
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader@1e5f4170
> (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:165){code}
> Full log in attach
> What i missed ? Help please
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
