Re: Reduce Number of Segments

2014-08-28 Thread Chris Decker
, 2014 at 4:27:31 PM To: elasticsearch@googlegroups.com elasticsearch@googlegroups.com Subject:  Re: Reduce Number of Segments OK, I would suggest setting index.merge.scheduler.max_thread_count to 1 for spinning disks. Maybe try also disabling merge throttling and see if that has an effect?  6

Re: Reduce Number of Segments

2014-08-28 Thread Michael McCandless
To: elasticsearch@googlegroups.com elasticsearch@googlegroups.com elasticsearch@googlegroups.com Subject: Re: Reduce Number of Segments OK, I would suggest setting index.merge.scheduler.max_thread_count to 1 for spinning disks. Maybe try also disabling merge throttling and see if that has an effect? 6

Re: Reduce Number of Segments

2014-08-28 Thread Chris Decker
@googlegroups.com Subject:  Re: Reduce Number of Segments OK, I would suggest setting index.merge.scheduler.max_thread_count to 1 for spinning disks. Maybe try also disabling merge throttling and see if that has an effect?  6 MB/sec seems slow... Mike McCandless http://blog.mikemccandless.com On Mon

Re: Reduce Number of Segments

2014-08-28 Thread Michael McCandless
On Thu, Aug 28, 2014 at 3:25 PM, Chris Decker ch...@chris-decker.com wrote: Mike, :) I upgraded to 1.3.2 yesterday mid-afternoon. So far things feel much snappier, but I wiped my ‘data’ directory so ES has less to search (though most of my queries only go back 1 day anyways; I go back 3

Re: Reduce Number of Segments

2014-08-26 Thread Michael McCandless
policy is best. Mike McCandless http://blog.mikemccandless.com On Mon, Aug 25, 2014 at 1:08 PM, Chris Decker ch...@chris-decker.com wrote: All, I’m looking for advice on how to reduce the number of segments for my indices because in my use case (log analysis), quick searches are more

Reduce Number of Segments

2014-08-25 Thread Chris Decker
All, I’m looking for advice on how to reduce the number of segments for my indices because in my use case (log analysis), quick searches are more important than real-time access to data. I've turned many of the knobs available within ES, and read many blog postings, ES documentation, etc

Re: Reduce Number of Segments

2014-08-25 Thread Michael McCandless
http://blog.mikemccandless.com On Mon, Aug 25, 2014 at 1:08 PM, Chris Decker ch...@chris-decker.com wrote: All, I’m looking for advice on how to reduce the number of segments for my indices because in my use case (log analysis), quick searches are more important than real-time access

Re: Reduce Number of Segments

2014-08-25 Thread Chris Decker
McCandless http://blog.mikemccandless.com On Mon, Aug 25, 2014 at 1:08 PM, Chris Decker ch...@chris-decker.com javascript: wrote: All, I’m looking for advice on how to reduce the number of segments for my indices because in my use case (log analysis), quick searches are more