Hi, That's a juicy index. Is this on a single server? Have you considered sharding it and thus spreading the indexing work over multiple servers, disks, etc.? You could increase ramBufferSizeMB, which will help a bit with indexing speed, but not with actual merging.
Otis -- Solr & ElasticSearch Support http://sematext.com/ On Thu, Jan 17, 2013 at 1:22 AM, Cool Techi <cooltec...@outlook.com> wrote: > Hi, > > We have an index of approximately 400GB in size, indexing 5000 documents > was taking 20 seconds. But lately, the indexing is taking very long, > committing the same amount of document is taking 5-20 mins. > > On checking the logs I can see that their a frequent merges happening, > which I am guessing is the reason for this, how can this be improved. My > configurations are given below, > > <useCompoundFile>false</useCompoundFile> > <mergeFactor>30</mergeFactor> > <ramBufferSizeMB>64</ramBufferSizeMB> > > regards, > Ayush >
