Re: Question: Solr perform well with thousands of replicas?

2019-09-04 Thread Hongxu Ma
warning message to user. From: Erick Erickson Sent: Monday, September 2, 2019 21:20 To: solr-user@lucene.apache.org Subject: Re: Question: Solr perform well with thousands of replicas? > why so many collection/replica: it's our customer needs, for example: ea

Re: Question: Solr perform well with thousands of replicas?

2019-09-02 Thread Erick Erickson
; > > > From: Erick Erickson > Sent: Friday, August 30, 2019 20:05 > To: solr-user@lucene.apache.org > Subject: Re: Question: Solr perform well with thousands of replicas? > > “no registered leader” is the effect of some problem usually, not

Re: Question: Solr perform well with thousands of replicas?

2019-09-02 Thread Hongxu Ma
base table mappings a collection. * this env is just a test cluster: I want to verify the max collection number solr can support stably. From: Erick Erickson Sent: Friday, August 30, 2019 20:05 To: solr-user@lucene.apache.org Subject: Re: Question: Solr perform

Re: Question: Solr perform well with thousands of replicas?

2019-08-30 Thread Erick Erickson
“no registered leader” is the effect of some problem usually, not the root cause. In this case, for instance, you could be running out of file handles and see other errors like “too many open files”. That’s just one example. One common problem is that Solr needs a lot of file handles and the sy

Re: Question: Solr perform well with thousands of replicas?

2019-08-30 Thread Jörn Franke
What is the reason for this number of replicas? Solr should work fine, but maybe it is worth to consolidate some collections to avoid also administrative overhead. > Am 29.08.2019 um 05:27 schrieb Hongxu Ma : > > Hi > I have a solr-cloud cluster, but it's unstable when collection number is big:

Re: Question: Solr perform well with thousands of replicas?

2019-08-29 Thread Hongxu Ma
To: solr-user@lucene.apache.org Subject: Re: Question: Solr perform well with thousands of replicas? On 8/28/2019 9:27 PM, Hongxu Ma wrote: > I have a solr-cloud cluster, but it's unstable when collection number is big: > 1000 replica/core per solr node. > > To sol

Re: Question: Solr perform well with thousands of replicas?

2019-08-29 Thread Shawn Heisey
On 8/28/2019 9:27 PM, Hongxu Ma wrote: I have a solr-cloud cluster, but it's unstable when collection number is big: 1000 replica/core per solr node. To solve this issue, I have read the performance guide: https://cwiki.apache.org/confluence/display/SOLR/SolrPerformanceProblems I noted there i

Re: Question: Solr perform well with thousands of replicas?

2019-08-29 Thread Erick Erickson
There are two factors: 1> the raw number of replicas on a Solr node. 2> total resources Solr needs. You say “..it’s unstalble…”. _How_ is it unstable? What symptoms are you seeing? You might want to review: https://cwiki.apache.org/confluence/display/solr/UsingMailingLists And not as you add mo

Re: Question: Solr perform well with thousands of replicas?

2019-08-28 Thread Hendrik Haddorp
Hi, we are usually using Solr Clouds with 5 nodes and up to 2000 collections and a replication factor of 2. So we have close to 1000 cores per node. That is on Solr 7.6 but I believe 7.3 worked as well. We tuned a few caches down to a minimum as otherwise the memory usage goes up a lot. The Solr