Yup, this needs to be resolved. There's already an issue open for adding the timeout setting to the RegexSplitter: https://github.com/mozilla-services/heka/issues/1689
-r On 09/20/2015 08:53 AM, Timur Batyrshin wrote:
Hi, I’m splitting logs which partially consist of multiline messages (like stack traces). For this I’m using RegexSplitter with delimiter like “\n([^\s])” as all stacktraces start with space. The problem with this approach is there is a lag of 1 log message (because you can’t match the delimiter until you receive the next line) which is quite noticeable on logs with rarely incoming messages. Any ideas on how to deal with this? The only solution that comes to my mind is to create a custom splitter with timeout. This way slow logs will be processed with no lag (but with delay of “timeout”) and fast logs will be processed as usual. May it be I’m missing a simpler solution? Thanks, Timur _______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
