The machine has a total ram of around 46GB. My Biggest concern is Solr index 
time gradually increasing and then the commit stops because of timeouts, out 
commit rate is very high, but I am not able to find the root cause of the issue.

Regards,
Rohit
Mobile: +91-9901768202
About Me: http://about.me/rohitg

-----Original Message-----
From: Shawn Heisey [mailto:s...@elyograg.org] 
Sent: 13 April 2012 05:15
To: solr-user@lucene.apache.org
Subject: Re: solr 3.5 taking long to index

On 4/12/2012 12:42 PM, Rohit wrote:
> Thanks for pointing these out, but I still have one concern, why is 
> the Virtual Memory running in 300g+?

Solr 3.5 uses MMapDirectoryFactory by default to read the index.  This does an 
mmap on the files that make up your index, so their entire contents are simply 
accessible to the application as virtual memory (over 300GB in your case), the 
OS automatically takes care of swapping disk pages in and out of real RAM as 
required.  This approach has less overhead and tends to make better use of the 
OS disk cache than other methods.  It does lead to confused questions and scary 
numbers in memory usage reporting, though.

You have mentioned that you are giving 36GB of RAM to Solr.  How much total RAM 
does the machine have?

Thanks,
Shawn


Reply via email to