Re: Allowing a ZooKeeper server to be part of multiple clusters

2010-10-26 Thread Flavio Junqueira
That proposal came in the context of federated zookeeper, and the motivation at the time was to use multiple overlapping clusters to enable increasing write throughput as we increase the number of servers. To my knowledge, we haven't made any progress on the implementation of such a feature.I'd be

Allowing a ZooKeeper server to be part of multiple clusters

2010-10-25 Thread Vishal K
Hi All, I am thinking about the choices one would have to support multiple 2-node clusters. Assume that for some reason one needs to support multiple 2-node clusters. This would mean they will have to figure out a way to run a third instance of ZK server for each cluster somewhere to ensure that

Re: Allowing a ZooKeeper server to be part of multiple clusters

2010-10-25 Thread Mahadev Konar
Hi Vishal, This idea (2.) had been kicked around intially by Flavio. I think heĀ¹ll probably chip in on the discussion. I am just curious on the whats the idea behind your proposal? Is this to provide some kind of failure gaurantees between a 2 node and 3 node cluster? Thanks mahadev On

Re: Allowing a ZooKeeper server to be part of multiple clusters

2010-10-25 Thread Vishal K
Hi Mahadev, It lets one run multiple 2-node clusters. Suppose I have an application that does a simple 2-way mirroring of my data and uses ZK for clustering. If I need to support many 2-node clusters, where will I find the spare machines to run the third instance for each cluster? -Vishal On