Re: Getting rid of zookeeper

2020-06-10 Thread matthew sporleder
FWIW -- zookeeper is pretty set-and-forget in my experience with settings like autopurge.snapRetainCount, autopurge.purgeInterval, and rotating the zookeeper.out stdout file. It is a big hassle to setup the individual myid files and keep them in sync with the server.$id=hostname in zoo.cfg but,

Re: Getting rid of zookeeper

2020-06-10 Thread Jan Høydahl
Curator is just on the client (solr) side, to make it easier to integrate with Zookeeper, right? If you study Elastic, they had terrible cluster stability a few years ago since everything was too «dynamic» and «zero config». That led to the system outsmarting itself when facing real-life

Re: Getting rid of zookeeper

2020-06-09 Thread Erick Erickson
The intermediate solution is to migrate to Curator. I don’t know all the ins and outs of that and whether or not it would be easier to setup and maintain. I do know that Zookeeper is deeply embedded in Solr and taking replacing it with most anything would be a major pain. I’m also certain that

Re: Getting rid of zookeeper

2020-06-09 Thread Dave
Is it horrible that I’m already burnt out from just reading that? I’m going to stick to the classic solr master slave set up for the foreseeable future, at least that let’s me focus more on the search theory rather than the back end system non stop. > On Jun 9, 2020, at 5:11 PM, Vincenzo

Re: Getting rid of zookeeper

2020-06-09 Thread Vincenzo D'Amore
My 2 cents, I have few solrcloud productions installations, I would share some thoughts of what I learned in the latest 4/5 years (fwiw) just as they come out of my mind. - to configure a SolrCloud *production* Cluster you have to be a zookeeper expert even if you only need Solr. - the Zookeeper

Re: Getting rid of zookeeper

2020-06-09 Thread Walter Underwood
Zookeeper was created because fault-tolerant algorithms are extremely hard to test and get correct. Maybe the hardest thing in computing. Using a trusted implementation frees up lots of developer time. To get an idea of the difficulty, read through the kinds of things fixed in the Zookeeper

Re: Getting rid of zookeeper

2020-06-09 Thread David Hastings
Zookeeper is annoying to both set up and manage, but then again the same thing can be said about solr cloud. not certain why you would want to deal with either On Tue, Jun 9, 2020 at 3:29 PM S G wrote: > Hello, > > I recently stumbled across KIP-500: Replace ZooKeeper with a Self-Managed >

Getting rid of zookeeper

2020-06-09 Thread S G
Hello, I recently stumbled across KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum Elastic-search does this too. And so do many other systems. Is there some work to