Re: out of memory during indexing do to large incoming queue

2013-06-17 Thread Shawn Heisey
On 6/17/2013 4:32 AM, Yoni Amir wrote: I was wondering about your recommendation to use facet.method=enum? Can you explain what is the trade-off here? I understand that I gain a benefit by using less memory, but what with I lose? Is it speed? The problem with facet.method=fc (the default) and

RE: out of memory during indexing do to large incoming queue

2013-06-17 Thread Yoni Amir
n, Yoni -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Monday, June 03, 2013 17:08 To: solr-user@lucene.apache.org Subject: Re: out of memory during indexing do to large incoming queue On 6/3/2013 1:06 AM, Yoni Amir wrote: > Solrconfig.xml -> http://apaste.info/d

Re: out of memory during indexing do to large incoming queue

2013-06-03 Thread Shawn Heisey
On 6/3/2013 1:06 AM, Yoni Amir wrote: > Solrconfig.xml -> http://apaste.info/dsbv > > Schema.xml -> http://apaste.info/67PI > > This solrconfig.xml file has optimization enabled. I had another file which I > can't locate at the moment, in which I defined a custom merge scheduler in > order to d

RE: out of memory during indexing do to large incoming queue

2013-06-03 Thread Yoni Amir
segments, I mean that's the number I saw in Solr UI. I assume there were much more files than that. Thanks, Yoni -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Sunday, June 02, 2013 22:53 To: solr-user@lucene.apache.org Subject: Re: out of memory during inde

Re: out of memory during indexing do to large incoming queue

2013-06-02 Thread Shawn Heisey
On 6/2/2013 12:25 PM, Yoni Amir wrote: > Hi Shawn and Shreejay, thanks for the response. > Here is some more information: > 1) The machine is a virtual machine on ESX server. It has 4 CPUs and 8GB of > RAM. I don't remember what CPU but something modern enough. It is running > Java 7 without any

RE: out of memory during indexing do to large incoming queue

2013-06-02 Thread Yoni Amir
ecessary to avoid such a large number of segments? Is it possible? Thanks again, Yoni -Original Message- From: Shawn Heisey [mailto:s...@elyograg.org] Sent: Sunday, June 02, 2013 18:05 To: solr-user@lucene.apache.org Subject: Re: out of memory during indexing do to large incoming queue

Re: out of memory during indexing do to large incoming queue

2013-06-02 Thread Shawn Heisey
On 6/2/2013 8:16 AM, Yoni Amir wrote: > Hello, > I am receiving OutOfMemoryError during indexing, and after investigating the > heap dump, I am still missing some information, and I thought this might be a > good place for help. > > I am using Solr 4.0 beta, and I have 5 threads that send update

Re: out of memory during indexing do to large incoming queue

2013-06-02 Thread Shreejay
A couple of things: 1) can you give some more details about your setup ? Like whether its cloud or single instance . How many nodes if its cloud. The hardware - memory per machine , JVM options. Etc 2) any specific reason for using 4.0 beta? The latest version is 4.3. I used 4.0 for a few w