I would guess that your gzipped data would need to be base64 encoded and placed in a field of the JSON along with an extract of whatever other fields you find important or interesting. Then you'll have _source.gzipped available to your application to decode and unzip when you choose.
--Karl On Mar 25, 2015 1:04 AM, "Marcel Matus" <matusmar...@gmail.com> wrote: > Actually, I am more interested about pushing compressed data into > elasticsearch than asking for compressed data. > So far, I tried it manually, using Google chrome plugin - postman, or > curl, without success: > > curl -sS -X POST --data-binary txn001.json.gz > http://localhost:9200/gzip/new -H "Content-Type: application/json" -H > "Content-Encoding: gzip" > Response: curl: (52) Empty reply from server > > Marcel > > > > On Tue, Mar 24, 2015 at 10:18 PM, joergpra...@gmail.com < > joergpra...@gmail.com> wrote: > >> Logstash has both Java and HTTP output, but I assume you want to use HTTP. >> >> Set http.compression parameter to true in ES configuration, then you can >> use gzip-compressed HTTP traffic using "Accept-Encoding" header. >> >> >> http://www.elastic.co/guide/en/elasticsearch/reference/current/modules-http.html >> >> Jörg >> >> On Tue, Mar 24, 2015 at 2:30 PM, Marcel Matus <matusmar...@gmail.com> >> wrote: >> >>> Hi Joe, >>> no, we post data into elasticsearch using Logstash. Actually, the >>> complete way is: APP - Logstash - RMQ - Logstash - ES. >>> And when I include F5 VIP's, there are 6 services on the way to process >>> these data... >>> >>> Marcel >>> >>> >>> On Tue, Mar 24, 2015 at 1:50 PM, joergpra...@gmail.com < >>> joergpra...@gmail.com> wrote: >>> >>>> Are you using Java API? >>>> >>>> Jörg >>>> >>>> On Tue, Mar 24, 2015 at 11:59 AM, Marcel Matus <matusmar...@gmail.com> >>>> wrote: >>>> >>>>> Hi, >>>>> some of our data are big ones (1 - 10 MB), and if there are milions of >>>>> those, it causes us trouble in our internal network. >>>>> We would like to compress these data in generation time, and send over >>>>> the network to elasticsearch in compressed state. I tried to find some >>>>> solution, but usually I found only retrieving gzipped data. Is there a >>>>> way, >>>>> how to put compressed data into elasticsearch? >>>>> >>>>> Thanks, >>>>> Marcel >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "elasticsearch" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to elasticsearch+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/elasticsearch/bce57798-0b51-4c9e-a0ca-06e41b2ca160%40googlegroups.com >>>>> <https://groups.google.com/d/msgid/elasticsearch/bce57798-0b51-4c9e-a0ca-06e41b2ca160%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to a topic in the >>>> Google Groups "elasticsearch" group. >>>> To unsubscribe from this topic, visit >>>> https://groups.google.com/d/topic/elasticsearch/iWT19g3_Viw/unsubscribe >>>> . >>>> To unsubscribe from this group and all its topics, send an email to >>>> elasticsearch+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFagGZYQ1wCZe%2BCMrUSUJ9gE7erjA7fk1aSOLfsdZkXjg%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFagGZYQ1wCZe%2BCMrUSUJ9gE7erjA7fk1aSOLfsdZkXjg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> >>> >>> -- >>> Marcel Matus >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAHUcNyj4cAi0oDGqgLmeSxLwVwtCssF72pyhufKV8ML911auHA%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAHUcNyj4cAi0oDGqgLmeSxLwVwtCssF72pyhufKV8ML911auHA%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "elasticsearch" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/elasticsearch/iWT19g3_Viw/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3DzuBnV4LWr7ySj6arirFzjxgCARzq%2Bvh05mFqyJ7%2Bpg%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3DzuBnV4LWr7ySj6arirFzjxgCARzq%2Bvh05mFqyJ7%2Bpg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Marcel Matus > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAHUcNyhFUHHgwQwubaqPed0O6oWrHJaeD_nousLF%3DJW69p_1zg%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAHUcNyhFUHHgwQwubaqPed0O6oWrHJaeD_nousLF%3DJW69p_1zg%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BEXWsz%2Bhg_P2E04_ZJOZmszMhNMZhDf9z3R57HJf46uOJjJHQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
