A raspberry pi or a apu board would be enough for your majority ZK node
in your 3rd room.
One kafka cluster belongs to one ZK cluster. You could have one ZK/Kafka
cluster per room. There are tools for one direction copying of Kafka
messages but bi-directional "replication" is not possible as f
Hi Han,
Thank you for your response. I understand. Its not possible to have a third
rack/server room at the moment as the requirement is to have redundancy
between both. I tried already to get one :-/
Is it possible to have a Zookeeper Ensemble (3 node) in one server room and
same in the other an
Is there any way you can find a third rack/server room/power supply nearby just
for the 1 extra zookeeper node? You don’t have to put any kafka brokers there,
just a single zookeeper. It’s less likely to have a 3-way split brain because
of a network partition. It’s so much cleaner with 3 avail
Thanks Han and Alexander for taking time out and your responses.
I now understand the risks and the possible outcome of having the desired
setup.
What would be better in your opinion to have failover (active-active)
between both of these server rooms to avoid switching to the clone / 3rd
zookeepe
I agree on this is one cluster but having one additional ZK node per
site does not help. (as far as I understand ZK)
A 3 out of 6 is also not a majority. So I think you mean 3/5 with a
cloned 3rd one. This would mean manually switching the cloned one for
majority which can cause issues again.
In that case it’s really one cluster. Make sure to set different rack ids for
each server room so kafka will ensure that the replicas always span both floors
and you don’t loose availability of data if a server room goes down.
You will have to configure one addition zookeeper node in each site w
Hi Hans,
Thank you for your reply.
Its basically two different server rooms on different floors and they are
connected with fiber connectivity so its almost like a local connection
between them no network latencies / lag.
If i do a Mirror Maker / Replicator then i will not be able to use them at
Hi Hans,
Thank you for your reply.
Its basically two different server rooms on different floors and they are
connected with fiber connectivity so its almost like a local connection
between them no network latencies / lag.
If i do a Mirror Maker / Replicator then i will not be able to use them at
What do you mean when you say you have "2 sites not datacenters"? You
should be very careful configuring a stretch cluster across multiple sites.
What is the RTT between the two sites? Why do you think that MIrror Maker
(or Confluent Replicator) would not work between the sites and yet you
think a
Hi Guys,
Thank you very much for you reply.
The scenario which i have to implement is that i have 2 sites not
datacenters so mirror maker would not work here.
There will be 4 nodes in total, like 2 in Site A and 2 in Site B. The idea
is to have Active-Active setup along with fault tolerance so t
Hi Guys,
Thank you very much for you reply.
The scenario which i have to implement is that i have 2 sites not
datacenters so mirror maker would not work here.
There will be 4 nodes in total, like 2 in Site A and 2 in Site B. The idea
is to have Active-Active setup along with fault tolerance so t
Jens,
I think you are correct that a 4 node zookeeper ensemble can be made to work
but it will be slightly less resilient than a 3 node ensemble because it can
only tolerate 1 failure (same as a 3 node ensemble) and the likelihood of node
failures is higher because there is 1 more node that cou
Hi Hans,
On Mon, Mar 6, 2017 at 12:10 AM, Hans Jespersen wrote:
> A 4 node zookeeper ensemble will not even work. It MUST be an odd number
> of zookeeper nodes to start.
Are you sure about that? If Zookeer doesn't run with four nodes, that means
a running ensemble of three can't be live-migrat
A 4 node zookeeper ensemble will not even work. It MUST be an odd number of
zookeeper nodes to start.
For Kafka you can start with any number of nodes (including 4). Remember that
it is the partitions that are replicated, not the entire broker so if you have
a Kafka node crash, its only the par
Hi Guys,
I have a scenario where i need to configure a 4 node Kafka Cluster along
with Zookeeper having 4 nodes as well.
I understand as a rule of them when it comes to cluster its always odd
number, however this is the case i need to do it.
For zookeeper, i understand with a 4 node cluster i ca
Hi Guys,
I have a scenario where i need to configure a 4 node Kafka Cluster along
with Zookeeper having 4 nodes as well.
I understand as a rule of them when it comes to cluster its always odd
number, however this is the case i need to do it.
For zookeeper, i understand with a 4 node cluster i ca
16 matches
Mail list logo
