On 1/16/2013 11:22 PM, Cool Techi wrote:
We have an index of approximately 400GB in size, indexing 5000 documents was
taking 20 seconds. But lately, the indexing is taking very long, committing the
same amount of document is taking 5-20 mins.
On checking the logs I can see that their a frequent merges happening, which I
am guessing is the reason for this, how can this be improved. My configurations
are given below,
<useCompoundFile>false</useCompoundFile>
<mergeFactor>30</mergeFactor>
<ramBufferSizeMB>64</ramBufferSizeMB>
What version of Solr? Version 4 will finish merges in the background
even after indexing and commits are complete, although you do have to
have a high enough maxMergeCount so that indexing stays in the
foreground. I use a maxMergeCount of 6 which seems to work for all
situations.
Another thing that makes commits take an extremely long time is high
autowarmCount values on Solr caches, especially filterCache.
Thanks,
Shawn
