Hi,

I’m splitting logs which partially consist of multiline messages (like stack 
traces).
For this I’m using RegexSplitter with delimiter like “\n([^\s])” as all 
stacktraces start with space.
The problem with this approach is there is a lag of 1 log message (because you 
can’t match the delimiter until
you receive the next line) which is quite noticeable on logs with rarely 
incoming messages.

Any ideas on how to deal with this?

The only solution that comes to my mind is to create a custom splitter with 
timeout.
This way slow logs will be processed with no lag (but with delay of “timeout”) 
and fast logs will be processed as usual.

May it be I’m missing a simpler solution?


Thanks,
Timur
_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka

Reply via email to