I am trying to mirror a three node kafka cluster to a single node cluster.
When I starts the mirror maker I got the exception LeaderNotAvailable, but
at the same time topics are created and messages are commited.
Please help me out.
Best Regards
Anshul Bhatnagar
have multiple partitions for that topic in
source
and
destination clusters.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva
sambarc...@gmail.com
wrote:
I ran kafka mirroring tool after producing data in source
cluster
partitions for that topic in
source
and
destination clusters.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva
sambarc...@gmail.com
wrote:
I ran kafka mirroring tool after producing data in source
cluster
and
destination clusters.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva
sambarc...@gmail.com
wrote:
I ran kafka mirroring tool after producing data in source
cluster,
and
this is not copied to destination cluster. If i produce data
.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva sambarc...@gmail.com
wrote:
I ran kafka mirroring tool after producing data in source cluster,
and
this is not copied to destination cluster. If i produce data after
running
tool those data are copied to destination
:
And i also observed ,all the data is moving to one partition in
destination
cluster though i have multiple partitions for that topic in source
and
destination clusters.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva sambarc...@gmail.com
wrote:
I ran kafka
for that topic in source and
destination clusters.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva sambarc...@gmail.com
wrote:
I ran kafka mirroring tool after producing data in source cluster,
and
this is not copied to destination cluster. If i produce data after
running
tool
And i also observed ,all the data is moving to one partition in destination
cluster though i have multiple partitions for that topic in source and
destination clusters.
SunilKalva
On Sat, Mar 7, 2015 at 9:54 PM, sunil kalva sambarc...@gmail.com wrote:
I ran kafka mirroring tool after producing
I ran kafka mirroring tool after producing data in source cluster, and this
is not copied to destination cluster. If i produce data after running tool
those data are copied to destination cluster. Am i missing something ?
--
SunilKalva
. Datacenter1 :3 kafka nodes/3 zookeeper nodes
2. Datacenter 2 : 3 kafka nodes/3 zookeeper nodes
All the kafka nodes are configured with
auto.create.topics.enable=true
and
the default partition is 2 .
I start the kafka mirroring tool with the following
like this
1. Datacenter1 :3 kafka nodes/3 zookeeper nodes
2. Datacenter 2 : 3 kafka nodes/3 zookeeper nodes
All the kafka nodes are configured with auto.create.topics.enable=true
and
the default partition is 2 .
I start the kafka mirroring tool with the following
kafka nodes/3 zookeeper nodes
All the kafka nodes are configured with
auto.create.topics.enable=true
and
the default partition is 2 .
I start the kafka mirroring tool with the following command
bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config
zookeeper nodes
2. Datacenter 2 : 3 kafka nodes/3 zookeeper nodes
All the kafka nodes are configured with auto.create.topics.enable=true and
the default partition is 2 .
I start the kafka mirroring tool with the following command
bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config
nodes
2. Datacenter 2 : 3 kafka nodes/3 zookeeper nodes
All the kafka nodes are configured with auto.create.topics.enable=true and
the default partition is 2 .
I start the kafka mirroring tool with the following command
bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config
We sort of have the same situation where our analytics DC is one of the
main producer DC too. If you use Kafka only for analytics it is fine to
produce directly to the analytics cluster from that DC and mirror the rest.
However we also want to be able to run things locally that will consume
local
Hi all!
Wikimedia is investigating how best to set up Broker clusters in multiple data
centers. Our main analytics Broker cluster is currently in our main
datacenter. It is possible for all of the main DC's frontend producers to
produce directly to our analytics cluster, but we're not sure
We do something like A (though I'm not sure I understand B):
http://kafka.apache.org/documentation.html#datacenters
Essentially what we wanted was that each datacenter stood alone so that we
would not lose data if the datacenters became disconnected. Network
partitions within our data centers are
In our case, our aggregator/analytics cluster is in our main datacenter, so
there's no risk of the main producers becoming disconnected from it. It seems
nicer to have a dedicated aggregator cluster, that only only gets its data via
MirrorMaker (Option A), but in our case this isn't necessary.
Hi,
I've a question about fault tolerance of Kafka mirror maker (0.7.1)
Let's say that I've a mirroring setup with topics in broker B1 mirrored to
broker B2.
On B2, I've Kafka mirror maker and Kafka broker process running. Now,
following is what I noticed when the Kafka broker process on B2 is
Yes, this is true if you have only 1 broker in the target cluster. If you
set up multiple brokers in the target cluster, mirror maker will send
messages to available brokers.
Thanks,
Jun
On Fri, Mar 22, 2013 at 12:02 PM, Riju Kallivalappil
riju.kallivalap...@corp.247customer.com wrote:
Hi,
20 matches
Mail list logo
