Logstash has both Java and HTTP output, but I assume you want to use HTTP. Set http.compression parameter to true in ES configuration, then you can use gzip-compressed HTTP traffic using "Accept-Encoding" header.
http://www.elastic.co/guide/en/elasticsearch/reference/current/modules-http.html Jörg On Tue, Mar 24, 2015 at 2:30 PM, Marcel Matus <matusmar...@gmail.com> wrote: > Hi Joe, > no, we post data into elasticsearch using Logstash. Actually, the complete > way is: APP - Logstash - RMQ - Logstash - ES. > And when I include F5 VIP's, there are 6 services on the way to process > these data... > > Marcel > > > On Tue, Mar 24, 2015 at 1:50 PM, joergpra...@gmail.com < > joergpra...@gmail.com> wrote: > >> Are you using Java API? >> >> Jörg >> >> On Tue, Mar 24, 2015 at 11:59 AM, Marcel Matus <matusmar...@gmail.com> >> wrote: >> >>> Hi, >>> some of our data are big ones (1 - 10 MB), and if there are milions of >>> those, it causes us trouble in our internal network. >>> We would like to compress these data in generation time, and send over >>> the network to elasticsearch in compressed state. I tried to find some >>> solution, but usually I found only retrieving gzipped data. Is there a way, >>> how to put compressed data into elasticsearch? >>> >>> Thanks, >>> Marcel >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/bce57798-0b51-4c9e-a0ca-06e41b2ca160%40googlegroups.com >>> <https://groups.google.com/d/msgid/elasticsearch/bce57798-0b51-4c9e-a0ca-06e41b2ca160%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "elasticsearch" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/elasticsearch/iWT19g3_Viw/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFagGZYQ1wCZe%2BCMrUSUJ9gE7erjA7fk1aSOLfsdZkXjg%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFagGZYQ1wCZe%2BCMrUSUJ9gE7erjA7fk1aSOLfsdZkXjg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Marcel Matus > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAHUcNyj4cAi0oDGqgLmeSxLwVwtCssF72pyhufKV8ML911auHA%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAHUcNyj4cAi0oDGqgLmeSxLwVwtCssF72pyhufKV8ML911auHA%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoG%3DzuBnV4LWr7ySj6arirFzjxgCARzq%2Bvh05mFqyJ7%2Bpg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
