Re: [heka] Supress parsing logging

2015-02-05 Thread Victor Castell
That makes sense, thanks Rob! On Thu, Feb 5, 2015 at 6:06 PM, Rob Miller wrote: > On 02/05/2015 04:39 AM, Victor Castell wrote: > >> Yeah I know it's different because my input is LogStreamer and the >> example in docs was for receiving protobuf by tcp. >> >> I want to understand. >> >> When my

Re: [heka] Supress parsing logging

2015-02-05 Thread Rob Miller
On 02/05/2015 04:39 AM, Victor Castell wrote: Yeah I know it's different because my input is LogStreamer and the example in docs was for receiving protobuf by tcp. I want to understand. When my LogStreamer reads a message it passes to the decoder a Protocol Buffer message with the with the log

Re: [heka] Supress parsing logging

2015-02-05 Thread Victor Castell
Yeah I know it's different because my input is LogStreamer and the example in docs was for receiving protobuf by tcp. I want to understand. When my LogStreamer reads a message it passes to the decoder a Protocol Buffer message with the with the log line in the message payload, that's right? Usin

Re: [heka] Supress parsing logging

2015-02-04 Thread Rob Miller
The config that you cargo-culted from the docs is meant for an entirely different use case. That's meant to handle cases where you're receiving protocol buffer encoded Heka messages, each of which contains an Nginx access log line as the message payload. This would be useful in a case where one

Re: [heka] Supress parsing logging

2015-02-04 Thread Victor Castell
I managed to get a working config but I want to understand what's going on: [syslog-decoder] type = "MultiDecoder" subs = ['nginx-access-decoder', 'rsyslog-decoder'] cascade_strategy = "first-wins" log_sub_errors = false In the nginx-access I'm deconding the corresponding access.log entries from

Re: [heka] Supress parsing logging

2015-01-30 Thread Victor Castell
Didn't know of that! Life saver Thanks! El 30/1/2015 11:17, "Krzysztof Krzyżaniak" escribió: > W dni pią 30 sty, 2015 o 10∶34 użytkownik Victor Castell < > vic...@victorcastell.com> napisał: > > Hi! > > I have a centralized rsyslog formatted logfile and I'm extracting nginx > logs from there usi

Re: [heka] Supress parsing logging

2015-01-30 Thread Krzysztof Krzyżaniak
W dni pią 30 sty, 2015 o 10∶34 użytkownik Victor Castell napisał: Hi! I have a centralized rsyslog formatted logfile and I'm extracting nginx logs from there using heka and the nginx access log decoder. The problem is that the parser also logs every other log message out to heka.log. The

[heka] Supress parsing logging

2015-01-30 Thread Victor Castell
Hi! I have a centralized rsyslog formatted logfile and I'm extracting nginx logs from there using heka and the nginx access log decoder. The problem is that the parser also logs every other log message out to heka.log. The volume of non nginx logs mixed in my rsyslog log is really huge so heka.l