Dont we need to consider space for compound file formats? Worst case scenario of CFS enabled, forceMerge to 1 segment would need 40GB free space for 2 x 10GB segments?
Also index.merge.policy.max_merge_size defaults to unbounded, is there some recommended numbers around this? There are no disk based circuit breaker turned on by default and the index just appears to go red when there is no free disk space. So I wanted to set safeguards at my end to avoid this issue. On Friday, 3 April 2015 20:30:05 UTC-7, Mark Walkom wrote: > > It needs as much space as the segments it's merging, so if you have 2 x > 10GB segments then you'd want at least 20GB free. > > On 4 April 2015 at 12:28, Ankit Malpani <ankit....@gmail.com <javascript:> > > wrote: > >> What is the minimum storage space Elasticsearch nodes should have to >> ensure smooth merging of segments accounting for index optimize calls. From >> my understanding, lucene needs 3X index size space [1] especially during >> forced merges. Our use case is not memory bound. Does that mean I should >> plan capacity based on only 1/3 total disk space? >> >> [1] - >> https://issues.apache.org/jira/browse/LUCENE-6386?focusedCommentId=14391162&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14391162 >> >> Thanks, >> Ankit >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com <javascript:>. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/056ae7cf-6d54-4bc7-bd15-9eb99173c347%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/056ae7cf-6d54-4bc7-bd15-9eb99173c347%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/91b98b8b-30a7-4685-a78c-e31985924724%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
