Re: [rsyslog] Question on multiline log messages

2018-09-11 Thread Rich Megginson via rsyslog
e with repeat and foreach to parse this into {"time":"", "stream":"stdout", "log":"partial_log_0partial_log_1rest_of_partial_log\n"} ? David Lang Thanks, --noriko Note that a LOT of log processi

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
"log":"partial_log_1"}{"time":"", "stream":"stdout", "log":"rest_of_partial_log\n"} Would we be able to use mmnormalize with repeat and foreach to parse this into {"time":"", "stream":"

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 03:45 PM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: Just to clarify - rsyslog does not currently support "multiline" docker json-file nor crio logs because there is no endmsg.regex - we would need to add support for that first in order to use mmnormalize repeat

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread David Lang
On Thu, 6 Sep 2018, Rich Megginson wrote: Just to clarify - rsyslog does not currently support "multiline" docker json-file nor crio logs because there is no endmsg.regex - we would need to add support for that first in order to use mmnormalize repeat and foreach as you have described above.

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 11:57 AM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: That is, if multiline specifically means records like this: first line of recordA    recordA second line    recordA third line first line of recordB Perhaps Noriko and I mean something slightly different

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread David Lang
On Thu, 6 Sep 2018, Rich Megginson wrote: That is, if multiline specifically means records like this: first line of recordA    recordA second line    recordA third line first line of recordB Perhaps Noriko and I mean something slightly different by "multiline" - a single message spread

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
e with repeat and foreach to parse this into {"time":"", "stream":"stdout", "log":"partial_log_0partial_log_1rest_of_partial_log\n"} ? David Lang Thanks, --noriko Note that a LOT of log processi

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread David Lang
Lang On Wed, 5 Sep 2018, Noriko Hosoi via rsyslog wrote: Date: Wed, 5 Sep 2018 14:04:42 -0700 From: Noriko Hosoi via rsyslog To: rsyslog@lists.adiscon.com Cc: Noriko Hosoi Subject: [rsyslog] Question on multiline log messages Hello, Rsyslog List, We have a requirement to pro

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
00 From: Noriko Hosoi via rsyslog To: rsyslog@lists.adiscon.com Cc: Noriko Hosoi Subject: [rsyslog] Question on multiline log messages Hello, Rsyslog List, We have a requirement to process multiline log messages in a log file. The simplified log format looks like this.   stdout F full_log_0     .

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Noriko Hosoi via rsyslog
.com Cc: Noriko Hosoi Subject: [rsyslog] Question on multiline log messages Hello, Rsyslog List, We have a requirement to process multiline log messages in a log file. The simplified log format looks like this.   stdout F full_log_0       stdout F full_log_n-1   stdo

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread David Lang
it to other tools for processing. David Lang On Wed, 5 Sep 2018, Noriko Hosoi via rsyslog wrote: Date: Wed, 5 Sep 2018 14:04:42 -0700 From: Noriko Hosoi via rsyslog To: rsyslog@lists.adiscon.com Cc: Noriko Hosoi Subject: [rsyslog] Question on multiline log messages Hello, Rsyslog List, We have

[rsyslog] Question on multiline log messages

2018-09-05 Thread Noriko Hosoi via rsyslog
Hello, Rsyslog List, We have a requirement to process multiline log messages in a log file. The simplified log format looks like this.   stdout F full_log_0       stdout F full_log_n-1   stdout P partial_log_0   stdout P partial_log_1   stdout F