Hi Jack, Sorry, I should have put them on my original message.
All merge policy settings are at their default except mergeFactor, which I now notice is quite high at 45. Unfortunately I don’t have the full history to see when this setting was changed, but I do know they haven’t been changed for well over a year, and that we did originally run Solr using the default settings. So reading about mergeFactor it sounds like this is likely the problem, and we’re simply not asking Solr to merge into these old and large segments yet? If I was to change this back down to the default of 10, would you expect we’d get quite an immediate and intense period of merging? If I was to launch a dupliacate test Solr instance, change the merge factor, and simply leave it for a few days, would it perform the background merge (so I can test to see if there’s enough memory etc for the merge to complete?). Thanks, James > On 25 Jan 2016, at 21:39, Jack Krupansky <jack.krupan...@gmail.com> wrote: > > What exacting are you merge policy settings in solrconfig? They control > when the background merges will be performed. Sometimes they do need to be > tweaked. > > -- Jack Krupansky > > On Mon, Jan 25, 2016 at 1:50 PM, James Mason <jamespma...@hotmail.com> > wrote: > >> Hi, >> >> I’ve have a large index that has been added to over several years, and >> I’ve discovered that I have many segments that haven’t been updated for >> well over a year, even though I’m adding, updating and deleting records >> daily. My five largest segments all haven’t been updated for over a year. >> >> Meanwhile, the number of segments I have keeps on increasing, and I have >> hundreds of segment files that don’t seem to be getting merged past a >> certain size (e.g. the largest is 2Gb but my older segments are over 100Gb). >> >> My understanding was that background merges should be merging these older >> segments with newer data over time, but this doesn’t seem to be the case. >> >> I’m using Solr 4.9, but I was using an older version at the time that >> these ‘older’ segments were created. >> >> Any help on suggestions of what’s happening would be very much >> appreciated. And also any suggestion on how I can monitor what’s happening >> with the background merges. >> >> Thanks, >> >> James
