Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
oud at this point. This >>>>>>>>>>> just mater a whole hell of lot less unless they are messing with >>>>>>>>>>> SolrCloud. Standalone is more of a brute. >>>>>>>>>>> >>>>>>>>&

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
ave 60 modules that are interconnected. We have a huge code >>>>>>>>>> base. That is also fine. >>>>>>>>>> >>>>>>>>>> We don't tend our garden. That's not fine. I've tended the garden >>>>>>>

Re: SolrCloud is sick.

2019-11-05 Thread Scott Blum
gt; this. >>>>>>>>> >>>>>>>>> This is hardly concrete awareness of a problem here. The awareness >>>>>>>>> to figure out what actually are the problems and what must be done - >>>>>>>>> that's >

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
;>>> >>>>>>>>> Anyway, no redesign, no library, no nothing like that gonna save >>>>>>>>> this. >>>>>>>>> >>>>>>>>> This is hardly concrete awareness of a problem

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
t;>>>> expensive shit these days if you ask me. I've been wrong lots tough. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>&g

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
t;>>>>>> years. >>>>>>>> One could also say that one writes the current use cases and >>>>>>>> interesting future use cases for Solr in a document and designs from >>>>>>>> scratch new - taking only the

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
m 04.11.2019 um 20:58 schrieb Erick Erickson < >>>>>>> erickerick...@gmail.com>: >>>>>>> > >>>>>>> > If Curator would make that easier and we’re doing major surgery >>>>>>> anyway…. >>>>>>> >

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
the design is flawed. >>>>>> > >>>>>> > Or, if I’m putting my philosophical hat on, code doesn’t get gnarly >>>>>> intentionally. It gets gnarly because there are a bunch of problems to be >>>>>> solved and you don’t know what they are until you ru

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
t gnarly >>>>> intentionally. It gets gnarly because there are a bunch of problems to be >>>>> solved and you don’t know what they are until you run into them. And it’s >>>>> always a tension between fixing it enough to get by and fixing it by >>&

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
;> major portions of it. The questions now are: >>>> > 1> are we at that point? >>>> > 2> are we going to put the effort into rewriting some of the worst >>>> offenders? >>>> > >>>> > >>>> > >>>

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
gt;> >> >>> >> Figuring out a better overall algorithmic & data structure design >>> that's an order of magnitude improvement seems far more important than >>> swapping out libraries. And I say this as a Curator fan and committer. ;) >>> >>

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
gt;> >> >> >> On Mon, Nov 4, 2019 at 11:44 AM Erick Erickson < >> erickerick...@gmail.com> wrote: >> >> Bram: >> >> >> >> Using Curator has been proposed before. It would require significant >> refactoring b/c of how deeply ent

Re: SolrCloud is sick.

2019-11-05 Thread Mark Miller
t; Using Curator has been proposed before. It would require significant > refactoring b/c of how deeply entwined raw ZK is in the code. That said, if > we’re going to do major surgery it may be the right time to consider it. > >> > >> Erick > >> > >>>> On Nov 4

Re: SolrCloud is sick.

2019-11-04 Thread Jörn Franke
Curator has been proposed before. It would require significant >> refactoring b/c of how deeply entwined raw ZK is in the code. That said, if >> we’re going to do major surgery it may be the right time to consider it. >> >> Erick >> >>>> On Nov 4, 2019, at 9:2

Re: SolrCloud is sick.

2019-11-04 Thread Erick Erickson
oposed before. It would require significant > refactoring b/c of how deeply entwined raw ZK is in the code. That said, if > we’re going to do major surgery it may be the right time to consider it. > > Erick > > > On Nov 4, 2019, at 9:24 AM, Bram Van Dam wrote: > > >

Re: SolrCloud is sick.

2019-11-04 Thread Scott Blum
g Curator has been proposed before. It would require significant > refactoring b/c of how deeply entwined raw ZK is in the code. That said, if > we’re going to do major surgery it may be the right time to consider it. > > Erick > > > On Nov 4, 2019, at 9:24 AM, Bram Van Dam

Re: SolrCloud is sick.

2019-11-04 Thread Erick Erickson
ote: > >> SolrCloud is sick right now. The way low level Zookeeper is handeled > > On an unrelated project, I've stopped using "raw" ZK client access and > have switched to Curator. The API is a fair bit easier to work with, and > it results in less ugly code. I realize that thi

Re: SolrCloud is sick.

2019-11-04 Thread Bram Van Dam
> SolrCloud is sick right now. The way low level Zookeeper is handeled On an unrelated project, I've stopped using "raw" ZK client access and have switched to Curator. The API is a fair bit easier to work with, and it results in less ugly code. I realize that this won't go very far

Re: SolrCloud is sick.

2019-11-04 Thread Jan Høydahl
processing file://lucene/src/main/xml/ENTITY_TermQuery.xml: www.bar.xyz: > Unknown host www.bar.xyz > ]> > > apparently www.bar.xyz host is supposed to be a placeholder > but for the life of me I cannot see where www.bar.zyz placeholder is replaced > by a valid URL > >

Re: SolrCloud is sick.

2019-11-03 Thread Martin Gainty
aceholder is replaced by a valid URL (i havent used DTD in at least 10 years and i am way out of my element when trying to resolve) any suggestions? martin From: David Smiley Sent: Sunday, November 3, 2019 12:32 AM To: Solr/Lucene Dev Cc: Mark Miller Subject: Re: SolrCl

Re: SolrCloud is sick.

2019-11-03 Thread Mark Miller
;>>>> >>> This is not to put blame on one person or a group of people. (I >>>>> occasionally see people discussing design issues upfront, I just hope that >>>>> is the norm.) >>>>> >>> >>>>> >>> >>>>>

Re: SolrCloud is sick.

2019-11-03 Thread Mark Miller
using the same process we used to create these problems. Again, I'm >>>> not questioning the intent or competence of anyone. Unless we set the >>>> process right, we are doomed to make the same mistakes again. >>>> >>> >>>> >>> >

Re: SolrCloud is sick.

2019-11-03 Thread Mark Miller
>> >>> I hope we don't resort to personal attacks and use this as an >>> opportunity to improve our processes. >>> >>> Thanks >>> >>> >>> >>> On Sun, Nov 3, 2019, 9:52 AM Scott Blum >>> wrote: >>> >>>> &g

Re: SolrCloud is sick.

2019-11-03 Thread Mark Miller
gt; wrote: >> >>>> >> >>>> Very much agreed. I've been trying to figure out for a long time >> what is the point in having a replica DOWN state that has to be toggled >> (DOWN and then UP!) every time a node restarts. Considering that we could >

Re: SolrCloud is sick.

2019-11-03 Thread Mark Miller
since kill -9 on a solr node won't mark > all the replicas DOWN-- that doesn't happen until the node comes back up > (perversely). > >>>> > >>>> What would it take to get to a state where restarting a node would > require a minimal amount of ZK work in most cases?

Re: SolrCloud is sick.

2019-11-03 Thread Jörn Franke
ely). >>>> >>>> What would it take to get to a state where restarting a node would require >>>> a minimal amount of ZK work in most cases? >>>> >>>> On Sat, Nov 2, 2019 at 5:44 PM Mark Miller wrote: >>>>> >

Re: SolrCloud is sick.

2019-11-02 Thread Noble Paul
lay out my case and proposal. >>>> >>>> Everyone is then free to decide that we need to do something drastic or >>>> that I'm wrong and we should just continue down the same road. If that's >>>> the case, a lot of your work will get a lot easier and less imped

Re: SolrCloud is sick.

2019-11-02 Thread David Smiley
a lot of your work will get a lot easier and less impeded by me >>> and we will still all be happier. Win win. >>> >>> If we can just not make drastic changes for a just a brief week or so >>> window, I'll say what I have to say, you guys can judge and do whatever >

Re: SolrCloud is sick.

2019-11-02 Thread Mark Miller
; >>>>> Everyone is then free to decide that we need to do something drastic >>>>> or that I'm wrong and we should just continue down the same road. If >>>>> that's >>>>> the case, a lot of your work will get a lot easier and less impeded by me &g

Re: SolrCloud is sick.

2019-11-02 Thread Mark Miller
> the case, a lot of your work will get a lot easier and less impeded by me >>>> and we will still all be happier. Win win. >>>> >>>> If we can just not make drastic changes for a just a brief week or so >>>> window, I'll say what I have to

Re: SolrCloud is sick.

2019-11-02 Thread Mark Miller
t;> If we can just not make drastic changes for a just a brief week or so >>> window, I'll say what I have to say, you guys can judge and do whatever >>> you'd please. >>> >>> - mark >>> >>> On Fri, Nov 1, 2019 at 7:46 PM Mark Miller >&

Re: SolrCloud is sick.

2019-11-02 Thread Mark Miller
w, I'll say what I have to say, you guys can judge and do whatever >> you'd please. >> >> - mark >> >> On Fri, Nov 1, 2019 at 7:46 PM Mark Miller wrote: >> >>> Hey All Solr Dev's, >>> >>> SolrCloud is sick right now. The way low leve

Re: SolrCloud is sick.

2019-11-02 Thread Mark Miller
that we need to do something drastic or >>> that I'm wrong and we should just continue down the same road. If that's >>> the case, a lot of your work will get a lot easier and less impeded by me >>> and we will still all be happier. Win win. >>> >>>

Re: SolrCloud is sick.

2019-11-02 Thread Noble Paul
e will still all be happier. Win win. >> >> If we can just not make drastic changes for a just a brief week or so >> window, I'll say what I have to say, you guys can judge and do whatever >> you'd please. >> >> - mark >> >> On Fri, Nov 1, 2019

Re: SolrCloud is sick.

2019-11-02 Thread Scott Blum
Nov 1, 2019 at 7:46 PM Mark Miller wrote: > >> Hey All Solr Dev's, >> >> SolrCloud is sick right now. The way low level Zookeeper is handeled, the >> Overseer, is mix and mess of proper exception handling and super slow >> startup and shutdown, adding new thing

Re: SolrCloud is sick.

2019-11-02 Thread Mark Miller
and we will still all be happier. Win win. If we can just not make drastic changes for a just a brief week or so window, I'll say what I have to say, you guys can judge and do whatever you'd please. - mark On Fri, Nov 1, 2019 at 7:46 PM Mark Miller wrote: > Hey All Solr Dev's, > > SolrClou

***UNCHECKED*** SolrCloud is sick.

2019-11-01 Thread Mark Miller
Hey All Solr Dev's, SolrCloud is sick right now. The way low level Zookeeper is handeled, the Overseer, is mix and mess of proper exception handling and super slow startup and shutdown, adding new things all the time with no concern for performance or proper ordering (which is harder to tell than