Switching existing solr indexes from Segment to Compound Style index files

2011-01-19 Thread Nicholas W
Dear All, On a Linux system running a multi-core linux server, we are experiencing a problem of too many files open which is causing tomcat to abort. Reading the documentation, one of the things it seems we can do is to switch to using compound indexes. We can see that in the solrconfig.xml there

Re: Switching existing solr indexes from Segment to Compound Style index files

2011-01-19 Thread Erick Erickson
Let's back up a ways here and figure out why you're getting so many files open. 1 how many files are in your index? 2 are you committing very frequently? 3 or do you simply have a LOT of cores? 4 do you optimize your indexes? If so, how many files to you have in your cores before/after

Re: Switching existing solr indexes from Segment to Compound Style index files

2011-01-19 Thread Markus Jelsma
Indeed, wouldn't reducing the number of segments be a better idea? Speeds up searching too! Do you happen to have a very high mergeFactor value for each core? On Wednesday 19 January 2011 17:53:12 Erick Erickson wrote: You're perhaps exactly right in your approach, but with a bit more info we