Hello Jorg, I am sorry, there was some problem in the implementation at my end. Thanks a lot guys for the insight and help. Appreciate the quick responses.
Thanks and Regards Sri On Sunday, June 8, 2014 5:04:24 PM UTC-4, sri wrote: > > Hello Jorg, > > Thanks a lot for the info., i tried applying the template provided by you > but the size is not reducing.On the other hand, I was noticing decrease in > size when i was disabling the fields via Mapping API. > > Thanks and Regards > Sri > > On Sunday, June 8, 2014 4:37:58 PM UTC-4, Jörg Prante wrote: >> >> Try this index template for new index creations >> >> curl -XPUT 'localhost:9200/_template/template1' -d ' >> { >> "template" : "*", >> "mappings" : { >> "_default_" : { >> "_source" : { "enabled" : false }, >> "_all" : { "enabled" : false} >> } >> } >> } >> ' >> >> See also >> >> >> http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-templates.html >> >> You can not disable _all or _source in an existing index. >> >> Jörg >> >> >> >> On Sun, Jun 8, 2014 at 10:22 PM, sri <1.fr...@gmail.com> wrote: >> >>> Thanks a lot for the insight Patrick. >>> >>> I have a few more queries: >>> >>> - it is possible to disable the '_source' and '_all' fields by >>> default for all the indices that would be created later (possibility >>> define >>> in the elasticsearch.yml file) >>> - what happens if my index is created and then i disable '_source' >>> and '_all' fields, would that effect the file size of the index, i.e., >>> will >>> the fields be removed/disabled for only the documents that will be added >>> after the disabling the fields?? >>> >>> Thanks and Regards >>> Sri >>> >>> On Sunday, June 8, 2014 2:48:16 PM UTC-4, Patrick Proniewski wrote: >>> >>>> Hello, >>>> >>>> I don't know how it's compressed but it appears that data is compressed >>>> up to an amount of 4k. ie. it's useless to store data on a compressed >>>> (lz4) >>>> filesystem if fs block size is 4k: >>>> >>>> Filesystem Size Used Avail Capacity Mounted on >>>> zdata/ES-lz4 1.1T 1.9G 1.1T 0% /zdata/ES-lz4 >>>> zdata/ES 1.1T 1.9G 1.1T 0% /zdata/ES >>>> >>>> But if fs block size is greater (say 128k), filesystem compression is a >>>> huge win: >>>> >>>> Filesystem Size Used Avail Capacity Mounted on >>>> zdata/ES-lz4 1.1T 1.1G 1.1T 0% >>>> /zdata/ES-lz4 -> compressratio 1.73x >>>> zdata/ES-gzip 1.1T 901M 1.1T 0% >>>> /zdata/ES-gzip -> compressratio 2.27x >>>> zdata/ES 1.1T 1.9G 1.1T 0% /zdata/ES >>>> >>>> Unfortunately, a filesystem block size greater than 4K is not optimal >>>> for IO (unless you have a big amount of physical memory you can dedicate >>>> to >>>> filesystem data cache, which would be redundant with ES cache). >>>> >>>> >>>> >>>> On 08 juin 2014, at 18:41, David Pilato wrote: >>>> >>>> > It's compressed by default now. >>>> > >>>> > -- >>>> > David ;-) >>>> > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs >>>> > >>>> > >>>> > Le 8 juin 2014 à 18:01, sri <1.fr...@gmail.com> a écrit : >>>> > >>>> > Hello everyone, >>>> > >>>> > I have read posts and blogs on how elasticsearch compression can be >>>> enabled in the previous versions(0.17 - 0.19). >>>> > >>>> > I am currently using ES 1.2.1, i wasn't able to find out how to >>>> enable compression in this version or if at all there is any such option >>>> for it. >>>> > >>>> > I know that i can reduce the storage amount by disabling the source >>>> using the mapping api, but what i was interested is the compression of >>>> data >>>> storage. >>>> > >>>> > Thanks and Regards >>>> > Sri >>>> >>>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearc...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/ea1e6264-9694-47b0-98d1-992c67bbb63d%40googlegroups.com >>> >>> <https://groups.google.com/d/msgid/elasticsearch/ea1e6264-9694-47b0-98d1-992c67bbb63d%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/acc298a6-bae1-4bb1-ab1c-24ae28a54ff1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.