Re: Large Index and OutOfMemoryError: Map failed

2012-04-22 Thread Michael McCandless
Forwarded conversation Subject: Large Index and OutOfMemoryError: Map failed From: Gopal Patwa gopalpa...@gmail.com Date: Fri, Mar 30, 2012 at 10:26 PM To: solr-user@lucene.apache.org I need help!! I am using Solr 4.0 nightly build with NRT and I

Re: Large Index and OutOfMemoryError: Map failed

2012-04-20 Thread Gopal Patwa
/autoSoftCommit /updateHandler Forwarded conversation Subject: Large Index and OutOfMemoryError: Map failed From: Gopal Patwa gopalpa...@gmail.com Date: Fri, Mar 30, 2012 at 10:26 PM To: solr-user@lucene.apache.org I need help

Re: Large Index and OutOfMemoryError: Map failed

2012-04-19 Thread Boon Low
/autoSoftCommit /updateHandler Forwarded conversation Subject: Large Index and OutOfMemoryError: Map failed From: Gopal Patwa gopalpa...@gmail.com Date: Fri, Mar 30, 2012 at 10:26 PM To: solr-user@lucene.apache.org I need help!! I am

Re: Large Index and OutOfMemoryError: Map failed

2012-04-14 Thread Gopal Patwa
openSearcherfalse/openSearcher /autoCommit autoSoftCommit maxTime${inventory.solr.softcommit.duration:1000}/maxTime /autoSoftCommit /updateHandler Forwarded conversation Subject: Large Index and OutOfMemoryError: Map failed

Re: Large Index and OutOfMemoryError: Map failed

2012-04-12 Thread Michael McCandless
and OutOfMemoryError: Map failed From: Gopal Patwa gopalpa...@gmail.com Date: Fri, Mar 30, 2012 at 10:26 PM To: solr-user@lucene.apache.org I need help!! I am using Solr 4.0 nightly build with NRT and I often get this error during auto commit java.lang.OutOfMemoryError: Map

Re: Large Index and OutOfMemoryError: Map failed

2012-04-12 Thread Mark Miller
openSearcherfalse/openSearcher /autoCommit autoSoftCommit maxTime${inventory.solr.softcommit.duration:1000}/maxTime /autoSoftCommit /updateHandler Forwarded conversation Subject: Large Index and OutOfMemoryError: Map failed

Re: Large Index and OutOfMemoryError: Map failed

2012-04-11 Thread Michael McCandless
Hi, 65K is already a very large number and should have been sufficient... However: have you increased the merge factor? Doing so increases the open files (maps) required. Have you disabled compound file format? (Hmmm: I think Solr does so by default... which is dangerous). Maybe try enabling

Re: Large Index and OutOfMemoryError: Map failed

2012-04-10 Thread Gopal Patwa
Michael, Thanks for response it was 65K as you mention the default value for cat /proc/sys/vm/max_map_count . How we determine what value this should be? is it number of document during hard commit in my case it is 15 minutes? or it is number of index file or number of documents we have in all

Re: Large Index and OutOfMemoryError: Map failed

2012-03-31 Thread Michael McCandless
It's the virtual memory limit that matters; yours says unlimited below (good!), but, are you certain that's really the limit your Solr process runs with? On Linux, there is also a per-process map count: cat /proc/sys/vm/max_map_count I think it typically defaults to 65,536 but you should

Large Index and OutOfMemoryError: Map failed

2012-03-30 Thread Gopal Patwa
*I need help!!* * * *I am using Solr 4.0 nightly build with NRT and I often get this error during auto commit **java.lang.OutOfMemoryError:* *Map* *failed. I have search this forum and what I found it is related to OS ulimit setting, please se below my ulimit settings. I am not sure what ulimit