Re: SolrCloud "master mode" planned?

2017-04-26 Thread Greg Pendlebury
Would it be possible to have an optional node that can dynamically assume a leadership position? There has been some small amount of discussion here about whether we could have a 'search node' join a cluster and give it an empty/null (or zero length) hash range on the clusterstate file and it woul

Re: SolrCloud "master mode" planned?

2017-04-26 Thread Walter Underwood
Not fired up about approaches that have “some nodes more equal than others”, whether it is zk-only or replica-only. That is the opposite of autoscaling. Getting our Solr Cloud cluster running in test and in prod was surprisingly difficult and unfortunately mysterious. I started with Solr 1.1, so

Re: SolrCloud "master mode" planned?

2017-04-26 Thread Otis Gospodnetić
Right, that "bin/solr zk start" is sort of how one could present that to users. I took the liberty of creating https://issues.apache.org/jira/browse/SOLR-10573 after not being able to find any such issues (yet hearing about such ideas at Lucene Revolution). Ishan & Co, you may want to link other

Re: SolrCloud "master mode" planned?

2017-04-26 Thread Upayavira
On Wed, 26 Apr 2017, at 10:06 PM, David Smiley wrote: > >> On Apr 26, 2017, at 4:35 PM, Upayavira wrote: >> >> I have done a *lot* of automating this. Redoing it recently it was >> quite embarrassing to realise how much complexity there is involved >> in it - it is crazy hard to get a basic,

Re: SolrCloud "master mode" planned?

2017-04-26 Thread David Smiley
> On Apr 26, 2017, at 4:35 PM, Upayavira wrote: > > I have done a *lot* of automating this. Redoing it recently it was quite > embarrassing to realise how much complexity there is involved in it - it is > crazy hard to get a basic, production ready SolrCloud setup running. Would you mind enum

Re: SolrCloud "master mode" planned?

2017-04-26 Thread Upayavira
I have done a *lot* of automating this. Redoing it recently it was quite embarrassing to realise how much complexity there is involved in it - it is crazy hard to get a basic, production ready SolrCloud setup running. One thing that is hard is getting a ZooKeeper ensemble going - using Exhibitor ma

Re: SolrCloud "master mode" planned?

2017-04-26 Thread Mike Drob
Could the zk role also be guaranteed to run the Overseer (and no collections)? If we already have that separated out, it would make sense to put it with the embedded zk. I think you can already configure and place things manually this way, but it would be a huge win to package it all up nicely for

Re: SolrCloud "master mode" planned?

2017-04-26 Thread Jan Høydahl
There have been suggestions to add a “node controller” process which again could start Solr and perhaps ZK on a node. But adding a new “zk” role which would let that node start (embedded) ZK I cannot recall. It would of course make a deploy simpler if ZK was hidden as a solr role/feature and pe

Re: SolrCloud "master mode" planned?

2017-04-25 Thread Ishan Chattopadhyaya
Hi Otis, I've been working on, and shall be working on, a few issues on the lines of "hide ZK". SOLR-6736: Uploading configsets can now be done through Solr nodes instead of uploading them to ZK. SOLR-10272: Use a _default configset, with the intention of not needing the user to bother about the c

SolrCloud "master mode" planned?

2017-04-25 Thread Otis Gospodnetić
Hi, This thread about Solr master-slave vs. SolrCloud deployment poll seems to point out people find SolrCloud (the ZK part of it) deployment complex: http://search-lucene.com/m/Solr/eHNlfm4WpJPVR92?subj=Re+Poll+Master+Slave+or+SolrCloud+ It could be just how information is presented... ... or h