Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-31 Thread Rishi Easwaran
@lucene.apache.org Sent: Sun, Mar 30, 2014 5:51 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/30/2014 2:59 PM, Rishi Easwaran wrote: RAM shouldn't be a problem. I have a box with 144GB RAM, running 12 instances with 4GB Java heap each. There are 9 instances

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-30 Thread Rishi Easwaran
...@elyograg.org To: solr-user solr-user@lucene.apache.org Sent: Fri, Mar 28, 2014 8:35 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/28/2014 4:07 PM, Rishi Easwaran wrote: Shawn, I changed the autoSoftCommit value to 15000 (15 sec). My index size

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-30 Thread Shawn Heisey
On 3/30/2014 2:59 PM, Rishi Easwaran wrote: RAM shouldn't be a problem. I have a box with 144GB RAM, running 12 instances with 4GB Java heap each. There are 9 instances wrting to 1TB of SSD disk space. Other 3 are writing to SATA drives, and have autosoftcommit disabled. This brought up

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Dmitry Kan
Hi Rishi, Do you really need soft-commit every second? Can you make it 10 mins, for example? What is happening (conditional on checking your logs) is that several commits (looks like 2 in your case) are arriving in a quick succession. Then system is starting to warmup the searchers, one per each

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Rishi Easwaran
@lucene.apache.org Sent: Fri, Mar 28, 2014 1:02 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 Hi Rishi, Do you really need soft-commit every second? Can you make it 10 mins, for example? What is happening (conditional on checking your logs) is that several commits

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Shawn Heisey
On 3/28/2014 1:03 PM, Rishi Easwaran wrote: I thought auto soft commit was for NRT search (shouldn't it be optimized for search performance), if i have to wait 10 mins how is it NRT? or am I missing something? You are correct, but once a second is REALLY often. If the rest of your config

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Dmitry Kan
And in addition, if you begin to see more onDeckSearchers warming up simultaneously, just bumping up maxWarmingSearchers is only postponing the proper core problem solution [1] We have been through this ourselves! http://wiki.apache.org/solr/SolrPerformanceProblems#Slow_commits On Fri, Mar 28,

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Rishi Easwaran
:28 pm Subject: Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2 On 3/28/2014 1:03 PM, Rishi Easwaran wrote: I thought auto soft commit was for NRT search (shouldn't it be optimized for search performance), if i have to wait 10 mins how is it NRT? or am I missing

Re: SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-28 Thread Shawn Heisey
On 3/28/2014 4:07 PM, Rishi Easwaran wrote: Shawn, I changed the autoSoftCommit value to 15000 (15 sec). My index size is pretty small ~4GB and its running on a SSD drive with ~100 GB space on it. Now I see the warn message every 15 seconds. The caches I think are minimal

SOLR Cloud 4.6 - PERFORMANCE WARNING: Overlapping onDeckSearchers=2

2014-03-27 Thread Rishi Easwaran
All, I am running SOLR Cloud 4.6, everything looks ok, except for this warn message constantly in the logs. 2014-03-27 17:09:03,982 WARN [commitScheduler-15-thread-1] [] SolrCore - [index_shard16_replica1] PERFORMANCE WARNING: Overlapping onDeckSearchers=2 2014-03-27 17:09:05,517 WARN