Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Andre Bois-Crettez
Using Solr 3.4.0. That changelog actually says it should reduce memory usage for that version. We were on a much older version previously, 1.something. Norms are off on all fields that it can be turned off on. I'm just hoping this new version doesn't have any leaks. Does FastLRUCache vs

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Paul Libbrecht
Steve, do you have any custom code in your Solr? We had out-of-memory errors just because of that, I was using one method to obtain the request which was leaking... had not read javadoc carefully enough. Since then, no leak. What do you do after the OoME? paul Le 9 nov. 2011 à 21:33, Steve

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Steve Fatula
From: Paul Libbrecht p...@hoplahup.net To: solr-user@lucene.apache.org Sent: Thursday, November 10, 2011 7:19 AM Subject: Re: Out of memory, not during import or updates of the index do you have any custom code in your Solr? We had out-of-memory errors just because of that, I was using one

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Steve Fatula
From: Andre Bois-Crettez andre.b...@kelkoo.com To: solr-user@lucene.apache.org solr-user@lucene.apache.org Sent: Thursday, November 10, 2011 7:02 AM Subject: Re: Out of memory, not during import or updates of the index You can add JVM parameters to better trace the heap usage with

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Mark Miller
How big is your index? What kind of queries do you tend to see? Do you facet on a lot of fields? Sort on a lot of fields? Before you get the OOM and are running along nicely, how much RAM is used? On Nov 9, 2011, at 3:33 PM, Steve Fatula wrote: We get at rare times out of memory errors

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Steve Fatula
From: Mark Miller markrmil...@gmail.com To: solr-user solr-user@lucene.apache.org Sent: Thursday, November 10, 2011 3:00 PM Subject: Re: Out of memory, not during import or updates of the index How big is your index? The total for the data dir is 651M. What kind of queries do you tend to see?

Out of memory, not during import or updates of the index

2011-11-09 Thread Steve Fatula
We get at rare times out of memory errors during the day. I know one reason for this is data imports, none are going on. I see in the wiki, document adds have some quirks, not doing that. I don't know to to expect for memory use though. We had Solr running under Tomcat set to 2G ram. I presume

Re: Out of memory, not during import or updates of the index

2011-11-09 Thread Otis Gospodnetic
Hi, Some options: * Yes, on the slave/search side you can reduce your cache sizes and lower the memory footprint. * You can also turn off norms in various fields if you don't need that and save memory there. * You can increase your Xmx I don't know what version of Solr you have, but look

Re: Out of memory, not during import or updates of the index

2011-11-09 Thread Steve Fatula
From: Otis Gospodnetic otis_gospodne...@yahoo.com To: solr-user@lucene.apache.org solr-user@lucene.apache.org Sent: Wednesday, November 9, 2011 2:51 PM Subject: Re: Out of memory, not during import or updates of the index Hi, Some options: * Yes, on the slave/search side you can reduce your