Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-31 Thread Rishi Easwaran
14 5:51 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/30/2014 2:59 PM, Rishi Easwaran wrote: > RAM shouldn't be a problem. > I have a box with 144GB RAM, running 12 instances with 4GB Java heap each. > There are 9 instances wrting to 1TB of SSD

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-30 Thread Shawn Heisey
On 3/30/2014 2:59 PM, Rishi Easwaran wrote: > RAM shouldn't be a problem. > I have a box with 144GB RAM, running 12 instances with 4GB Java heap each. > There are 9 instances wrting to 1TB of SSD disk space. > Other 3 are writing to SATA drives, and have autosoftcommit disabled. This brought up

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-30 Thread Rishi Easwaran
-user Sent: Fri, Mar 28, 2014 8:35 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/28/2014 4:07 PM, Rishi Easwaran wrote: > > Shawn, > > I changed the autoSoftCommit value to 15000 (15 sec). > My index size is pretty small ~4GB and

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Shawn Heisey
On 3/28/2014 4:07 PM, Rishi Easwaran wrote: > > Shawn, > > I changed the autoSoftCommit value to 15000 (15 sec). > My index size is pretty small ~4GB and its running on a SSD drive with ~100 > GB space on it. > Now I see the warn message every 15 seconds. > > The caches I think are minimal >

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Rishi Easwaran
on SSD drives is a long time to handle a 4GB index. Thanks, Rishi. -Original Message- From: Shawn Heisey To: solr-user Sent: Fri, Mar 28, 2014 3:28 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/28/2014 1:03 PM, Rishi Easwaran wrote: >

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Dmitry Kan
And in addition, if you begin to see more onDeckSearchers warming up simultaneously, just bumping up maxWarmingSearchers is only postponing the proper core problem solution [1] We have been through this ourselves! http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_commits On Fri, Mar 28,

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Shawn Heisey
On 3/28/2014 1:03 PM, Rishi Easwaran wrote: I thought auto soft commit was for NRT search (shouldn't it be optimized for search performance), if i have to wait 10 mins how is it NRT? or am I missing something? You are correct, but once a second is REALLY often. If the rest of your config is

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Rishi Easwaran
02 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 Hi Rishi, Do you really need soft-commit every second? Can you make it 10 mins, for example? What is happening (conditional on checking your logs) is that several commits (looks like 2 in your case) are arriving

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Dmitry Kan
Hi Rishi, Do you really need soft-commit every second? Can you make it 10 mins, for example? What is happening (conditional on checking your logs) is that several commits (looks like 2 in your case) are arriving in a quick succession. Then system is starting to warmup the searchers, one per each

SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-27 Thread Rishi Easwaran
All, I am running SOLR Cloud 4.6, everything looks ok, except for this warn message constantly in the logs. 2014-03-27 17:09:03,982 WARN [commitScheduler-15-thread-1] [] SolrCore - [index_shard16_replica1] PERFORMANCE WARNING: Overlapping onDeckSearchers=2 2014-03-27 17:09:05,517 WARN [commi