Adding one more, you can also explore Apache BookKeeper for storing millions of K/V data. Since it uses filesystem for storing the ledgers & its entries(data) size won't be a constraint. But it doesn't have watch notifications.
Regards, Rakesh On Fri, Aug 15, 2014 at 10:18 PM, Alvaro Gareppe <agare...@gmail.com> wrote: > It doesn't seems to be the best use of zookeeper, Maybe redis is a best > "tool" for you.. or some no sql db like Casandra or mongo is going to fit a > little bit more. > > > > > On Fri, Aug 15, 2014 at 3:41 AM, saurabh jain <sauravma...@gmail.com> > wrote: > > > Hi Folks, > > > > I am planning to use ZooKeeper znodes to store my key value data. > > Name of the znode will be my key and data present inside it will be my > > value. > > > > > > The problem is I can have millions of key/value pairs. > > > > Is the zookeeper recommended to solve this type of problem. I read about > > the zookeeper that > > it is not an actual File system but a splitted File system and should be > > used only for distributed coordination service. > > > > My requirement is something like this that I need a global place to store > > these key values so that all the jobs can access it and even if some job > > create a new znode then my other jobs can see these changes with the help > > of watcher. > > > > Would you guys recommend using ZooKeeper for above problem statement ? > > > > I have also read in one of the mail archive on the limitation of max no > of > > znodes , if this limitation still exists then may be this solution won't > > work in my case. > > > > > > > http://zookeeper-user.578899.n2.nabble.com/Question-regarding-the-maximum-number-of-ZNODES-a-zookeeper-td6979604.html > > > > Please advise > > > > Many Thanks > > Saurabh > > > > > > -- > Ing. Alvaro Gareppe > agare...@gmail.com >
