I had already modify my config to: ``` action ( type="mmjsonparse" name="action_jsonarray-parse" ) if ( re_match($msg, ']}$') ) then { foreach ($.line in $!msg) do { action (... ```
just after you told me async queue no help with mm**. So, the failure was just the one with synchronously calling mmjsonparse. 2015-04-09 19:19 GMT+08:00 singh.janmejay <singh.janme...@gmail.com>: > Can you reproduce the failure with synchronously calling mmjsonparse? > > I'll try to reproduce it again. > > -- > Regards, > Janmejay > > PS: Please blame the typos in this mail on my phone's uncivilized soft > keyboard sporting it's not-so-smart-assist technology. > > On Apr 9, 2015 3:20 PM, "chenlin rao" <rao.chen...@gmail.com> wrote: > > > janmyjay: > > I don't think that's a json-c problem, because if I use omfile > inside > > foreach, rsyslogd never died. > > I also try to compile and run your repo, process fault again and the > > valgrind output keep totally same. > > > > 2015-04-08 21:26 GMT+08:00 singh.janmejay <singh.janme...@gmail.com>: > > > > > BTW, here is the gdb-session-trace if you are interested: > > > > > > Program received signal SIGSEGV, Segmentation fault. > > > [Switching to Thread 0x7ffff1657700 (LWP 14762)] > > > 0x00007ffff718c23b in array_list_get_idx () from > > > /lib/x86_64-linux-gnu/libjson-c.so.2 > > > (gdb) bt > > > #0 0x00007ffff718c23b in array_list_get_idx () from > > > /lib/x86_64-linux-gnu/libjson-c.so.2 > > > #1 0x00000000004450af in execForeach (stmt=0x6ffab0, > > > pMsg=0x7fffec016040, pWti=0x718810) at ruleset.c:279 > > > #2 0x0000000000445874 in scriptExec (root=0x6ffab0, > > > pMsg=0x7fffec016040, pWti=0x718810) at ruleset.c:464 > > > #3 0x0000000000444fdb in execIf (stmt=0x6ffdc0, pMsg=0x7fffec016040, > > > pWti=0x718810) at ruleset.c:257 > > > #4 0x000000000044584a in scriptExec (root=0x6fd560, > > > pMsg=0x7fffec016040, pWti=0x718810) at ruleset.c:461 > > > #5 0x0000000000444ebc in execCall (stmt=0x6fd4c0, > > > pMsg=0x7fffec016040, pWti=0x718810) at ruleset.c:232 > > > #6 0x0000000000445820 in scriptExec (root=0x6fd4c0, > > > pMsg=0x7fffec016040, pWti=0x718810) at ruleset.c:458 > > > #7 0x00000000004459f2 in processBatch (pBatch=0x718848, > > > pWti=0x718810) at ruleset.c:503 > > > #8 0x000000000045b390 in msgConsumer (notNeeded=0x0, pBatch=0x718848, > > > pWti=0x718810) at rsyslogd.c:575 > > > #9 0x00000000004409f3 in ConsumerReg (pThis=0x718380, pWti=0x718810) > > > at queue.c:1897 > > > #10 0x000000000043bcfd in wtiWorker (pThis=0x718810) at wti.c:334 > > > #11 0x000000000043a8af in wtpWorker (arg=0x718810) at wtp.c:389 > > > #12 0x00007ffff79ac0a4 in start_thread (arg=0x7ffff1657700) at > > > pthread_create.c:309 > > > #13 0x00007ffff6abc04d in clone () at > > > ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 > > > (gdb) up 1 > > > #1 0x00000000004450af in execForeach (stmt=0x6ffab0, > > > pMsg=0x7fffec016040, pWti=0x718810) at ruleset.c:279 > > > 279 curr = json_object_array_get_idx(arr, i); > > > (gdb) p pMsg->json > > > $1 = (struct json_object *) 0x7fffe00176b0 > > > (gdb) p *pMsg->json > > > $2 = {o_type = json_type_object, _delete = 0x7ffff718c9a0, > > > _to_json_string = 0x7ffff718cee0, _ref_count = 1, _pb = 0x0, o = > > > {c_boolean = -536774912, > > > c_double = 6.9533292876306475e-310, c_int64 = 140736951580416, > > > c_object = 0x7fffe0017700, c_array = 0x7fffe0017700, c_string = {str = > > > 0x7fffe0017700 "\020", len = 0}}, > > > _user_delete = 0x0, _userdata = 0x0} > > > (gdb) p *pMsg->json->o.c_object > > > $3 = {size = 16, count = 1, collisions = 0, resizes = 0, lookups = 2, > > > inserts = 1, deletes = 0, name = 0x0, head = 0x7fffe00177a0, tail = > > > 0x7fffe00177a0, table = 0x7fffe0017760, > > > free_fn = 0x7ffff718cca0, hash_fn = 0x7ffff718fd60 <lh_char_hash>, > > > equal_fn = 0x7ffff71901f0 <lh_char_equal>} > > > (gdb) p *pMsg->json->o.c_object->head->key > > > There is no member named key. > > > (gdb) p pMsg->json->o.c_object->head->key > > > There is no member named key. > > > (gdb) p *pMsg->json->o.c_object->head > > > $4 = {k = 0x7fffe0018230, v = 0x7fffe0017970, next = 0x0, prev = 0x0} > > > (gdb) p *pMsg->json->o.c_object->head->k > > > Attempt to dereference a generic pointer. > > > (gdb) p (char*) pMsg->json->o.c_object->head->k > > > $5 = 0x7fffe0018230 "msg" > > > (gdb) p (json_object*) pMsg->json->o.c_object->head->v > > > $6 = (json_object *) 0x7fffe0017970 > > > (gdb) p *(json_object*) pMsg->json->o.c_object->head->v > > > $7 = {o_type = json_type_string, _delete = 0x7ffff718c9c0, > > > _to_json_string = 0x7ffff718c930, _ref_count = 1, _pb = 0x0, o = > > > {c_boolean = -536774208, > > > c_double = 6.9533292876654297e-310, c_int64 = 140736951581120, > > > c_object = 0x7fffe00179c0, c_array = 0x7fffe00179c0, c_string = { > > > str = 0x7fffe00179c0 "[{\"content\":\"Error > > > Domain=WBBussinessErrorDomain Code=20030 \\\"the user base info is not > > > exists!\\\" UserInfo=0x17127cc00 {NSLocalizedDescription=the user base > > > info is not exists!, WBBussinessErrorInfoKe"..., len = 2144}}, > > > _user_delete = 0x0, _userdata = 0x0} > > > > > > On Wed, Apr 8, 2015 at 6:53 PM, singh.janmejay < > singh.janme...@gmail.com > > > > > > wrote: > > > > Spent some time on this today. > > > > I had the crash reproducing consistently with tcpflood -C 1000 ... > > > > > > > > Here is what I observed: > > > > - When large number of messages (copy of the message you shared) are > > > > sent, some messages get parsed with key 'msg' pointing to a > > > > json-string (its contents is the entire remaining string, starting > > > > with [{"content.... > > > > - I have added a type-check which ensures foreach tries to iterate > > > > only when the given type is an array, if not, it prints out a warning > > > > and skips the loop. > > > > > > > > This means, it'll skip ill-parsed messages. _I haven't looked through > > > > the json-c parser code to reason code-flow that can lead to this > > > > problem_, but because of it happening on a different thread, changes > > > > may be visible to ruleset thread in unexpected order, which would > make > > > > it see the json-object being available, but its state being > > > > intermediate (rather than final). > > > > > > > > Can you test with git://github.com/janmejay/rsyslog.git and let us > > > > know if it fixes the crash? > > > > > > > > With this change I can't reproduce the crash anymore, but again, > > > > because modifications to the json-object are happening on a different > > > > thread, it could lead to crash on accessing that object for a > > > > different reason. However, this also means the ill-parsed messages > > > > will be skipped, so depending on how you reason about it, they will > be > > > > lost. > > > > > > > > While this fixes the value not being an array problem, you still want > > > > to move to sync mmjsonparse call. > > > > > > > > > > > > > > > > On Mon, Apr 6, 2015 at 6:07 PM, chenlin rao <rao.chen...@gmail.com> > > > wrote: > > > >> yes. > > > >> rsyslogd 8.8.0.ad1, compiled with: > > > >> PLATFORM: x86_64-redhat-linux-gnu > > > >> PLATFORM (lsb_release -d): > > > >> FEATURE_REGEXP: Yes > > > >> GSSAPI Kerberos 5 support: No > > > >> FEATURE_DEBUG (debug build, slow code): No > > > >> 32bit Atomic operations supported: Yes > > > >> 64bit Atomic operations supported: Yes > > > >> memory allocator: system default > > > >> Runtime Instrumentation (slow code): No > > > >> uuid support: Yes > > > >> Number of Bits in RainerScript integers: 64 > > > >> > > > >> 2015-04-06 20:32 GMT+08:00 singh.janmejay <singh.janme...@gmail.com > >: > > > >> > > > >>> So it is 8.8.0? > > > >>> > > > >>> On Mon, Apr 6, 2015 at 5:33 PM, chenlin rao <rao.chen...@gmail.com > > > > > wrote: > > > >>> > I install latest version from rsyslog_v8 yum repo in CentOS6.5. > > > >>> > And for more options in valgrind report, I compiled another > version > > > from > > > >>> > git master, ran into the same problem. > > > >>> > > > > >>> > 2015-04-06 13:55 GMT+08:00 singh.janmejay < > > singh.janme...@gmail.com > > > >: > > > >>> > > > > >>> >> It was looking very similar to the issue that Thomas reported on > > > >>> >> > > > >>> >> > > > >>> > > > > > > http://www.gossamer-threads.com/lists/rsyslog/users/16204?do=post_view_threaded > > > >>> >> > > > >>> >> To double-check, I cherry-picked the two patches in that PR, > which > > > >>> >> fixed the failing json_array_looping test. > > > >>> >> > > > >>> >> So I'll now focus on Chenlin's problem. > > > >>> >> > > > >>> >> To rule-out the same problem (the one that PR fixes), Chenlin, > can > > > you > > > >>> >> confirm which version of rsyslog are you on? > > > >>> >> > > > >>> >> > > > >>> >> > > > >>> >> On Thu, Apr 2, 2015 at 6:58 PM, singh.janmejay < > > > >>> singh.janme...@gmail.com> > > > >>> >> wrote: > > > >>> >> > I couldn't spend too much time on it, but just saw it > reproduce > > > on my > > > >>> >> > local env (also running Ubuntu 12.04). > > > >>> >> > > > > >>> >> > Will again get a chance to look at in a a few days (likely > > > Monday). > > > >>> >> > > > > >>> >> > Again, sorry for the delay. > > > >>> >> > > > > >>> >> > On Thu, Apr 2, 2015 at 6:43 PM, singh.janmejay < > > > >>> singh.janme...@gmail.com> > > > >>> >> wrote: > > > >>> >> >> Foreach support is a recent addition. > > > >>> >> >> > > > >>> >> >> On Thu, Apr 2, 2015 at 3:34 PM, singh.janmejay < > > > >>> >> singh.janme...@gmail.com> wrote: > > > >>> >> >>> I saw that mail, but by that time I had already setup the > > > >>> environment > > > >>> >> >>> to reproduce it with Chenlin's config. > > > >>> >> >>> > > > >>> >> >>> I should pursue the CI failure first. Didn't know it was > > > happening > > > >>> in > > > >>> >> every run. > > > >>> >> >>> > > > >>> >> >>> On Thu, Apr 2, 2015 at 2:04 PM, Rainer Gerhards > > > >>> >> >>> <rgerha...@hq.adiscon.com> wrote: > > > >>> >> >>>> I > > > >>> >> >>>> > > > >>> >> >>>> 2015-04-02 7:35 GMT+02:00 singh.janmejay < > > > singh.janme...@gmail.com > > > >>> >: > > > >>> >> >>>>> Hadn't noticed the use of msg key early-on, so "]}" > > shouldn't > > > be a > > > >>> >> >>>>> problem, but I can't reproduce it with input i crafted to > > work > > > >>> with > > > >>> >> >>>>> it. > > > >>> >> >>>>> Here is the crafted input: > > > >>> >> >>>>> @cee:{"msg" : ["G\"foo\":\"10\"}", "G\"bar\":\"20\""]} > > > >>> >> >>>>> > > > >>> >> >>>>> This is what does fail it, im using a bad type (it doesn't > > do > > > >>> >> type-check yet): > > > >>> >> >>>>> @cee:{"msg" : "G\"foo\":\"10\"}", "bar" : ["foo"]} > > > >>> >> >>>>> > > > >>> >> >>>>> Here it ending in value of 'bar' satisfies the ']}' > > > conditional, > > > >>> but > > > >>> >> >>>>> msg isn't an array. I'll add array-typecheck, but other > than > > > this > > > >>> I > > > >>> >> >>>>> have been unable to reproduce it, so this may not fix your > > > >>> problem. > > > >>> >> >>>>> > > > >>> >> >>>>> I think your input line (or entire input file) will help. > > > >>> >> >>>> > > > >>> >> >>>> No sure if you overlooked that posting. As it looks, the > > > problem > > > >>> seems > > > >>> >> >>>> to be reproducible with the testbench as well. At least > this > > > commit > > > >>> >> >>>> continously fails: > > > >>> >> >>>> > > > >>> >> >>>> https://github.com/rsyslog/rsyslog/pull/286 > > > >>> >> >>>> > > > >>> >> >>>> I've also sent a build log via te ML a couple of days ago. > > > >>> >> >>>> > > > >>> >> >>>> HTH > > > >>> >> >>>> Rainer > > > >>> >> >>>>> > > > >>> >> >>>>> On Thu, Apr 2, 2015 at 9:39 AM, singh.janmejay < > > > >>> >> singh.janme...@gmail.com> wrote: > > > >>> >> >>>>>> Hi Chenlin, > > > >>> >> >>>>>> > > > >>> >> >>>>>> I finally have some time to look at it. (Sorry for the > > > delay.) > > > >>> >> >>>>>> > > > >>> >> >>>>>> Can you please share a sample log-line? Feel free to > > > anonymize > > > >>> it, > > > >>> >> but > > > >>> >> >>>>>> please keep the structure and types as is. > > > >>> >> >>>>>> > > > >>> >> >>>>>> I see that you are checking $msg ends with "]}", that > means > > > it > > > >>> is an > > > >>> >> >>>>>> object, not an array. > > > >>> >> >>>>>> > > > >>> >> >>>>>> If my interpretation is correct, trying to iterate over > > > object > > > >>> >> instead > > > >>> >> >>>>>> of array may be causing this problem. (I haven't looked > at > > > code > > > >>> yet > > > >>> >> to > > > >>> >> >>>>>> verify this manifestation though). > > > >>> >> >>>>>> > > > >>> >> >>>>>> On Tue, Mar 31, 2015 at 2:32 PM, Rainer Gerhards > > > >>> >> >>>>>> <rgerha...@hq.adiscon.com> wrote: > > > >>> >> >>>>>>> 2015-03-30 19:55 GMT+02:00 singh.janmejay < > > > >>> >> singh.janme...@gmail.com>: > > > >>> >> >>>>>>>> Sorry, I haven't had a chance to look at it yet. > > > >>> >> >>>>>>> > > > >>> >> >>>>>>> Take your time, I know how challenging it is at times > ;) I > > > just > > > >>> >> wanted > > > >>> >> >>>>>>> to spread the good news that we have a good repro. > > > >>> >> >>>>>>> > > > >>> >> >>>>>>> Rainer > > > >>> >> >>>>>>>> > > > >>> >> >>>>>>>> Will get to this asap. > > > >>> >> >>>>>>>> > > > >>> >> >>>>>>>> On Mon, Mar 30, 2015 at 2:36 PM, Rainer Gerhards > > > >>> >> >>>>>>>> <rgerha...@hq.adiscon.com> wrote: > > > >>> >> >>>>>>>>> Co-incidentally, an unrelated testbench run also > > > experienced > > > >>> >> problems > > > >>> >> >>>>>>>>> in this area. I have attached the testbench log. > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> Here is the valgrind report: > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> 5812.499032607:main Q:Reg/w0 : wti 0x614e9e0: we need > > to > > > >>> create > > > >>> >> a new > > > >>> >> >>>>>>>>> action worker instance for action 2 > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> 5812.499181273:main Q:Reg/w0 : Action 2 transitioned > to > > > >>> state: > > > >>> >> itx > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> 5812.499314576:main Q:Reg/w0 : FOREACH .corge IN > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> 5812.499625664:main Q:Reg/w0 : var '.quux!bar' > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> 5812.500078770:main Q:Reg/w0 : eval expr 0x60849e0, > > type > > > >>> 'V[86]' > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Thread 6: > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Invalid read of size 8 > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== at 0x587B134: lh_table_lookup_entry (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x587B1A8: lh_table_lookup (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x416F98: jsonVarExtract (msg.c:4218) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x41C82F: msgGetJSONPropJSON > (msg.c:2848) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x4562D0: cnfexprEval > > (rainerscript.c:1785) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x45842E: cnfexprEvalCollection > > > >>> >> (rainerscript.c:2483) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435CFC: scriptExec (ruleset.c:271) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435D6B: scriptExec (ruleset.c:284) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x436233: processBatch (ruleset.c:503) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x44464B: msgConsumer (rsyslogd.c:576) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x432AC2: ConsumerReg (queue.c:1897) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x42F55E: wtiWorker (wti.c:334) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Address 0x61645c8 is 8 bytes before a block > of > > > size > > > >>> 5 > > > >>> >> alloc'd > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== at 0x4C2B6CD: malloc (in > > > >>> >> >>>>>>>>> /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x5D0B081: strdup (strdup.c:43) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x5878A5C: json_object_object_add (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x41E419: msgAddJSON (msg.c:4379) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x41F2E0: msgSetJSONFromVar > (msg.c:4554) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435D4E: scriptExec (ruleset.c:283) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x436233: processBatch (ruleset.c:503) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x44464B: msgConsumer (rsyslogd.c:576) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x432AC2: ConsumerReg (queue.c:1897) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x42F55E: wtiWorker (wti.c:334) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x42E6C6: wtpWorker (wtp.c:389) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x5050E99: start_thread > > > (pthread_create.c:308) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Jump to the invalid address stated on the > next > > > line > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== at 0x0: ??? > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x587B136: lh_table_lookup_entry (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x587B1A8: lh_table_lookup (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x416F98: jsonVarExtract (msg.c:4218) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x41C82F: msgGetJSONPropJSON > (msg.c:2848) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x4562D0: cnfexprEval > > (rainerscript.c:1785) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x45842E: cnfexprEvalCollection > > > >>> >> (rainerscript.c:2483) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435CFC: scriptExec (ruleset.c:271) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435D6B: scriptExec (ruleset.c:284) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x436233: processBatch (ruleset.c:503) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x44464B: msgConsumer (rsyslogd.c:576) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x432AC2: ConsumerReg (queue.c:1897) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Address 0x0 is not stack'd, malloc'd or > > > (recently) > > > >>> >> free'd > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Process terminating with default action of > > > signal 11 > > > >>> >> (SIGSEGV) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Bad permissions for mapped region at address > > 0x0 > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== at 0x0: ??? > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x587B136: lh_table_lookup_entry (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x587B1A8: lh_table_lookup (in > > > >>> >> >>>>>>>>> /usr/lib/x86_64-linux-gnu/libjson.so.0.0.1) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x416F98: jsonVarExtract (msg.c:4218) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x41C82F: msgGetJSONPropJSON > (msg.c:2848) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x4562D0: cnfexprEval > > (rainerscript.c:1785) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x45842E: cnfexprEvalCollection > > > >>> >> (rainerscript.c:2483) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435CFC: scriptExec (ruleset.c:271) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x435D6B: scriptExec (ruleset.c:284) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x436233: processBatch (ruleset.c:503) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x44464B: msgConsumer (rsyslogd.c:576) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== by 0x432AC2: ConsumerReg (queue.c:1897) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== HEAP SUMMARY: > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== in use at exit: 961,978 bytes in 1,632 > > blocks > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== total heap usage: 2,448 allocs, 816 frees, > > > >>> 1,023,184 > > > >>> >> bytes allocated > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== LEAK SUMMARY: > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== definitely lost: 6 bytes in 1 blocks > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== indirectly lost: 0 bytes in 0 blocks > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== possibly lost: 2,592 bytes in 9 blocks > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== still reachable: 959,380 bytes in 1,622 > > blocks > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== suppressed: 0 bytes in 0 blocks > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== Rerun with --leak-check=full to see details > of > > > leaked > > > >>> >> memory > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== For counts of detected and suppressed errors, > > > rerun > > > >>> >> with: -v > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ==2284== ERROR SUMMARY: 2 errors from 2 contexts > > > (suppressed: > > > >>> 2 > > > >>> >> from 2) > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> receiving response: Connection reset by peer > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> ./diag.sh: line 17: 2284 Killed > > > $valgrind > > > >>> >> >>>>>>>>> ../tools/rsyslogd -C -n -irsyslog$3.pid > > > >>> >> -M../runtime/.libs:../.libs > > > >>> >> >>>>>>>>> -f$srcdir/testsuites/$2 > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> FAIL: json_array_looping.sh > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> Rainer > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> 2015-03-21 17:50 GMT+01:00 chenlin rao < > > > rao.chen...@gmail.com > > > >>> >: > > > >>> >> >>>>>>>>>> thanks for the information. But rsyslogd also fault > > > after I > > > >>> >> change > > > >>> >> >>>>>>>>>> mmjsonparse action config as `action ( > > type="mmjsonparse" > > > >>> >> >>>>>>>>>> name="action_jsonarray-parse"`. output as follow: > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> 6008.997308131:main Q:Reg/w1 : eval expr 0x52f18f0, > > > return > > > >>> >> datatype 'J' > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> 6009.002050327:main Q:Reg/w1 : ACTION 16 > > > >>> >> >>>>>>>>>> [builtin:omfwd:action(type="builtin:omfwd" ...)] > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> 6009.002357554:main Q:Reg/w1 : executing action 16 > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> 6009.002454575:main Q:Reg/w1 : Called action, > logging > > to > > > >>> >> builtin:omfwd > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Thread 22: > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Invalid read of size 4 > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== at 0x3A044093A0: pthread_mutex_lock (in > > > /lib64/ > > > >>> >> >>>>>>>>>> libpthread-2.12.so) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x438053: qqueueEnqMsg (queue.c:2856) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x4421AB: doSubmitToActionQ > > > (action.c:1403) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439D6C: scriptExec (ruleset.c:197) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439ECC: scriptExec (ruleset.c:284) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439CD9: scriptExec (ruleset.c:416) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439CD9: scriptExec (ruleset.c:416) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439CD9: scriptExec (ruleset.c:416) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x43A40B: processBatch (ruleset.c:503) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x44A403: msgConsumer (rsyslogd.c:575) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x438D12: ConsumerReg (queue.c:1897) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x43314B: wtiWorker (wti.c:334) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Address 0x10 is not stack'd, malloc'd or > > > (recently) > > > >>> >> free'd > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Process terminating with default action of > > > signal 11 > > > >>> >> (SIGSEGV) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Access not within mapped region at address > > 0x10 > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== at 0x3A044093A0: pthread_mutex_lock (in > > > /lib64/ > > > >>> >> >>>>>>>>>> libpthread-2.12.so) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x438053: qqueueEnqMsg (queue.c:2856) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x4421AB: doSubmitToActionQ > > > (action.c:1403) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439D6C: scriptExec (ruleset.c:197) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439ECC: scriptExec (ruleset.c:284) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439CD9: scriptExec (ruleset.c:416) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439CD9: scriptExec (ruleset.c:416) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x439CD9: scriptExec (ruleset.c:416) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x43A40B: processBatch (ruleset.c:503) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x44A403: msgConsumer (rsyslogd.c:575) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x438D12: ConsumerReg (queue.c:1897) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== by 0x43314B: wtiWorker (wti.c:334) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== If you believe this happened as a result > of a > > > stack > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== overflow in your program's main thread > > > (unlikely > > > >>> but > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== possible), you can try to increase the size > > of > > > the > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== main thread stack using the > --main-stacksize= > > > flag. > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== The main thread stack size used in this run > > was > > > >>> >> 10485760. > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== HEAP SUMMARY: > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== in use at exit: 1,181,215,468 bytes in > > > 282,120 > > > >>> >> blocks > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== total heap usage: 379,556 allocs, 97,436 > > > frees, > > > >>> >> 2,096,403,341 > > > >>> >> >>>>>>>>>> bytes allocated > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== LEAK SUMMARY: > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== definitely lost: 516 bytes in 12 blocks > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== indirectly lost: 0 bytes in 0 blocks > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== possibly lost: 33,561,793 bytes in 24 > > > blocks > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== still reachable: 1,147,653,159 bytes in > > > 282,084 > > > >>> >> blocks > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== suppressed: 0 bytes in 0 blocks > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Rerun with --leak-check=full to see details > of > > > >>> leaked > > > >>> >> memory > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== For counts of detected and suppressed > errors, > > > rerun > > > >>> >> with: -v > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== Use --track-origins=yes to see where > > > uninitialised > > > >>> >> values come from > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> ==9947== ERROR SUMMARY: 25 errors from 5 contexts > > > >>> (suppressed: > > > >>> >> 100 from 9) > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> Seems very similar with before. > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> BTW: is it the "workerthreads" options make sense to > > > >>> >> mmjsonparse/mmfields > > > >>> >> >>>>>>>>>> etc? > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>> 2015-03-22 0:07 GMT+08:00 Rainer Gerhards < > > > >>> >> rgerha...@hq.adiscon.com>: > > > >>> >> >>>>>>>>>> > > > >>> >> >>>>>>>>>>> 2015-03-21 14:50 GMT+01:00 chenlin rao < > > > >>> rao.chen...@gmail.com > > > >>> >> >: > > > >>> >> >>>>>>>>>>> > $MaxMessageSize 32m > > > >>> >> >>>>>>>>>>> > module( load="imtcp" ) > > > >>> >> >>>>>>>>>>> > module( load="imuxsock" ) > > > >>> >> >>>>>>>>>>> > module( load="imklog" ) > > > >>> >> >>>>>>>>>>> > module( load="mmfields" ) > > > >>> >> >>>>>>>>>>> > module( load="mmjsonparse" ) > > > >>> >> >>>>>>>>>>> > module( load="omelasticsearch" ) > > > >>> >> >>>>>>>>>>> > $ActionFileDefaultTemplate > > > RSYSLOG_TraditionalFileFormat > > > >>> >> >>>>>>>>>>> > $RepeatedMsgReduction off > > > >>> >> >>>>>>>>>>> > $WorkDirectory /data0/rsyslog > > > >>> >> >>>>>>>>>>> > $MainMsgQueueFilename mainQ > > > >>> >> >>>>>>>>>>> > $MainMsgQueueType LinkedList > > > >>> >> >>>>>>>>>>> > $MainMsgQueueMaxFileSize 512M > > > >>> >> >>>>>>>>>>> > $MainMsgQueueMaxDiskSpace 20G > > > >>> >> >>>>>>>>>>> > $PreserveFQDN on > > > >>> >> >>>>>>>>>>> > input(type="imtcp" port="514") > > > >>> >> >>>>>>>>>>> > template(name="local6IndexName" type="list") { > > > >>> >> >>>>>>>>>>> > constant(value="logstash-mweibo-") > > > >>> >> >>>>>>>>>>> > property(name="timereported" > > dateFormat="rfc3339" > > > >>> >> position.from="1" > > > >>> >> >>>>>>>>>>> > position.to="4") > > > >>> >> >>>>>>>>>>> > constant(value=".") > > > >>> >> >>>>>>>>>>> > property(name="timereported" > > dateFormat="rfc3339" > > > >>> >> position.from="6" > > > >>> >> >>>>>>>>>>> > position.to="7") > > > >>> >> >>>>>>>>>>> > constant(value=".") > > > >>> >> >>>>>>>>>>> > property(name="timereported" > > dateFormat="rfc3339" > > > >>> >> position.from="9" > > > >>> >> >>>>>>>>>>> > position.to="10") > > > >>> >> >>>>>>>>>>> > } > > > >>> >> >>>>>>>>>>> > template( name="local6TypeName" type="string" > > > >>> >> string="%programname%" ) > > > >>> >> >>>>>>>>>>> > template( name="local6JsonArray" type="list" ) { > > > >>> >> >>>>>>>>>>> > constant(value="{\"@timestamp\":\"") > > > >>> >> property(name="timereported" > > > >>> >> >>>>>>>>>>> > dateFormat="rfc3339") > > > >>> >> >>>>>>>>>>> > constant(value="\",\"host\":\"") > > > >>> >> property(name="hostname") > > > >>> >> >>>>>>>>>>> > constant(value="\",") property(name="$.line" > > > >>> >> position.from="2") > > > >>> >> >>>>>>>>>>> > } > > > >>> >> >>>>>>>>>>> > Ruleset( name="forwardRuleSetJsonArray" ) > > > >>> >> >>>>>>>>>>> > { > > > >>> >> >>>>>>>>>>> > action ( type="mmjsonparse" > > > >>> >> >>>>>>>>>>> > name="action_jsonarray-parse" > > > >>> >> >>>>>>>>>>> > queue.size="3000" > > > >>> >> >>>>>>>>>>> > queue.dequeuebatchsize="300" > > > >>> >> >>>>>>>>>>> > queue.maxdiskspace="15G" > > > >>> >> >>>>>>>>>>> > queue.checkpointinterval="10" > > > >>> >> >>>>>>>>>>> > queue.type="linkedlist" > > > >>> >> >>>>>>>>>>> > queue.workerthreads="30" > > > >>> >> >>>>>>>>>>> > queue.workerthreadminimummessages="100" > > > >>> >> >>>>>>>>>>> > queue.maxfilesize="500M" > > > >>> >> >>>>>>>>>>> > queue.saveonshutdown="on" > > > >>> >> >>>>>>>>>>> > ) > > > >>> >> >>>>>>>>>>> > > > >>> >> >>>>>>>>>>> running mmjsonparse on a queue (asynchronously!) > does > > > not > > > >>> make > > > >>> >> any > > > >>> >> >>>>>>>>>>> sense. When running async, the json properties will > > > never be > > > >>> >> seen by > > > >>> >> >>>>>>>>>>> the rest of the ruleset. > > > >>> >> >>>>>>>>>>> > > > >>> >> >>>>>>>>>>> Maybe this even triggers the fault... > > > >>> >> >>>>>>>>>>> > > > >>> >> >>>>>>>>>>> Rainer > > > >>> >> >>>>>>>>>>> > # maybe recieved a too large data being truncated > > > >>> >> >>>>>>>>>>> > if ( re_match($msg, ']}$') ) then { > > > >>> >> >>>>>>>>>>> > foreach ($.line in $!msg) do { > > > >>> >> >>>>>>>>>>> > action ( > > > >>> >> >>>>>>>>>>> > # test for other output modules > > > >>> >> >>>>>>>>>>> > # type="omfile" > > > >>> file="/data/rsyslog-debug.log" > > > >>> >> >>>>>>>>>>> > # type="omfwd" Target="127.0.0.1" > > > >>> Port="5140" > > > >>> >> >>>>>>>>>>> Protocol="tcp" > > > >>> >> >>>>>>>>>>> > type="omelasticsearch" server=" > > > >>> es.domain.com > > > >>> >> " > > > >>> >> >>>>>>>>>>> > dynSearchIndex="on" searchIndex="local6IndexName" > > > >>> >> dynSearchType="on" > > > >>> >> >>>>>>>>>>> > searchType="local6TypeName" asyncrepl="on" > > > bulkmode="on" > > > >>> >> >>>>>>>>>>> > template="local6JsonArray" > > > >>> >> >>>>>>>>>>> > name="action_json2log-es1003" > > > >>> >> >>>>>>>>>>> > > > > queue.filename="action_json2log-es1003" > > > >>> >> >>>>>>>>>>> > queue.size="10000" > > > >>> >> >>>>>>>>>>> > queue.dequeuebatchsize="2000" > > > >>> >> >>>>>>>>>>> > queue.maxdiskspace="15G" > > > >>> >> >>>>>>>>>>> > queue.discardseverity="3" > > > >>> >> >>>>>>>>>>> > queue.checkpointinterval="10" > > > >>> >> >>>>>>>>>>> > queue.type="linkedlist" > > > >>> >> >>>>>>>>>>> > queue.workerthreads="5" > > > >>> >> >>>>>>>>>>> > > > > queue.workerthreadminimummessages="2000" > > > >>> >> >>>>>>>>>>> > queue.maxfilesize="500M" > > > >>> >> >>>>>>>>>>> > queue.saveonshutdown="on" > > > >>> >> >>>>>>>>>>> > ) > > > >>> >> >>>>>>>>>>> > } > > > >>> >> >>>>>>>>>>> > stop > > > >>> >> >>>>>>>>>>> > } > > > >>> >> >>>>>>>>>>> > } > > > >>> >> >>>>>>>>>>> > > > > >>> >> >>>>>>>>>>> > if ( $programname == > > 'mobile_client_net_fatal_error' ) > > > >>> then > > > >>> >> >>>>>>>>>>> > { > > > >>> >> >>>>>>>>>>> > call forwardRuleSetJsonArray > > > >>> >> >>>>>>>>>>> > stop > > > >>> >> >>>>>>>>>>> > } > > > >>> >> >>>>>>>>>>> > > > > >>> >> >>>>>>>>>>> > > > >>> >> > > > >>> > > > > > > *.info;mail.none;authpriv.none;cron.none;local6.none;local7.none;user.none > > > >>> >> >>>>>>>>>>> > /var/log/messages > > > >>> >> >>>>>>>>>>> > authpriv.* > > > >>> >> /var/log/secure > > > >>> >> >>>>>>>>>>> > mail.* > > > >>> >> /var/log/maillog > > > >>> >> >>>>>>>>>>> > cron.* > > > >>> >> /var/log/cron > > > >>> >> >>>>>>>>>>> > uucp,news.crit > > > >>> >> /var/log/spooler > > > >>> >> >>>>>>>>>>> > > > > >>> >> >>>>>>>>>>> > 2015-03-21 13:14 GMT+08:00 singh.janmejay < > > > >>> >> singh.janme...@gmail.com>: > > > >>> >> >>>>>>>>>>> > > > > >>> >> >>>>>>>>>>> >> Can you please share your config as well? > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> >> Also, I'll likely be able to look at it only > after > > > 27th > > > >>> >> Mar. As of now I > > > >>> >> >>>>>>>>>>> >> don't have access to a computer and github > doesn't > > > seem > > > >>> to > > > >>> >> show line > > > >>> >> >>>>>>>>>>> >> numbers while browsing code using mobile phone. > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> >> -- > > > >>> >> >>>>>>>>>>> >> Regards, > > > >>> >> >>>>>>>>>>> >> Janmejay > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> >> PS: Please blame the typos in this mail on my > > phone's > > > >>> >> uncivilized soft > > > >>> >> >>>>>>>>>>> >> keyboard sporting it's not-so-smart-assist > > > technology. > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> >> On Mar 21, 2015 8:49 AM, "chenlin rao" < > > > >>> >> rao.chen...@gmail.com> wrote: > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> >> > I try to build rsyslogd from github master with > > > >>> >> "./configure > > > >>> >> >>>>>>>>>>> >> --enable-debug > > > >>> >> >>>>>>>>>>> >> > --enable-valgrind --enable-memcheck > > > >>> --enable-elasticsearch > > > >>> >> >>>>>>>>>>> >> > --enable-mmjsonparse --enable-mmsequence > > > >>> --enable-mmfields > > > >>> >> >>>>>>>>>>> >> > --disable-liblogging-stdlog --enable-omruleset" > > > >>> >> >>>>>>>>>>> >> > > > > >>> >> >>>>>>>>>>> >> > then process exit with: > > > >>> >> >>>>>>>>>>> >> > > > > >>> >> >>>>>>>>>>> >> > 7778.301430428:main Q[DA]:Reg/w0: ACTION 16 > > > >>> >> >>>>>>>>>>> >> > [builtin:omfwd:action(type="builtin:omfwd" > ...)] > > > >>> >> >>>>>>>>>>> >> > 7778.301676909:main Q[DA]:Reg/w0: executing > > action > > > 16 > > > >>> >> >>>>>>>>>>> >> > 7778.301791807:main Q[DA]:Reg/w0: Called > action, > > > >>> logging > > > >>> >> to > > > >>> >> >>>>>>>>>>> builtin:omfwd > > > >>> >> >>>>>>>>>>> >> > ==20833== Thread 2: > > > >>> >> >>>>>>>>>>> >> > ==20833== Invalid read of size 4 > > > >>> >> >>>>>>>>>>> >> > ==20833== at 0x3A044093A0: > pthread_mutex_lock > > > (in > > > >>> >> /lib64/ > > > >>> >> >>>>>>>>>>> >> > libpthread-2.12.so) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x438053: qqueueEnqMsg > > > (queue.c:2856) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x4421AB: doSubmitToActionQ > > > >>> >> (action.c:1403) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x439D6C: scriptExec > > > (ruleset.c:197) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x439ECC: scriptExec > > > (ruleset.c:284) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x439CD9: scriptExec > > > (ruleset.c:416) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x43A40B: processBatch > > > (ruleset.c:503) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x44A403: msgConsumer > > > (rsyslogd.c:575) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x438D12: ConsumerReg > > > (queue.c:1897) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x43314B: wtiWorker (wti.c:334) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x431BA6: wtpWorker (wtp.c:389) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x3A044079D0: start_thread (in > > > /lib64/ > > > >>> >> >>>>>>>>>>> libpthread-2.12.so > > > >>> >> >>>>>>>>>>> >> ) > > > >>> >> >>>>>>>>>>> >> > ==20833== Address 0x10 is not stack'd, > malloc'd > > or > > > >>> >> (recently) free'd > > > >>> >> >>>>>>>>>>> >> > ==20833== > > > >>> >> >>>>>>>>>>> >> > ==20833== > > > >>> >> >>>>>>>>>>> >> > ==20833== Process terminating with default > action > > > of > > > >>> >> signal 11 > > > >>> >> >>>>>>>>>>> (SIGSEGV) > > > >>> >> >>>>>>>>>>> >> > ==20833== Access not within mapped region at > > > address > > > >>> 0x10 > > > >>> >> >>>>>>>>>>> >> > ==20833== at 0x3A044093A0: > pthread_mutex_lock > > > (in > > > >>> >> /lib64/ > > > >>> >> >>>>>>>>>>> >> > libpthread-2.12.so) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x438053: qqueueEnqMsg > > > (queue.c:2856) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x4421AB: doSubmitToActionQ > > > >>> >> (action.c:1403) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x439D6C: scriptExec > > > (ruleset.c:197) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x439ECC: scriptExec > > > (ruleset.c:284) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x439CD9: scriptExec > > > (ruleset.c:416) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x43A40B: processBatch > > > (ruleset.c:503) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x44A403: msgConsumer > > > (rsyslogd.c:575) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x438D12: ConsumerReg > > > (queue.c:1897) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x43314B: wtiWorker (wti.c:334) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x431BA6: wtpWorker (wtp.c:389) > > > >>> >> >>>>>>>>>>> >> > ==20833== by 0x3A044079D0: start_thread (in > > > /lib64/ > > > >>> >> >>>>>>>>>>> libpthread-2.12.so > > > >>> >> >>>>>>>>>>> >> ) > > > >>> >> >>>>>>>>>>> >> > ==20833== If you believe this happened as a > > > result of > > > >>> a > > > >>> >> stack > > > >>> >> >>>>>>>>>>> >> > ==20833== overflow in your program's main > thread > > > >>> >> (unlikely but > > > >>> >> >>>>>>>>>>> >> > ==20833== possible), you can try to increase > the > > > size > > > >>> of > > > >>> >> the > > > >>> >> >>>>>>>>>>> >> > ==20833== main thread stack using the > > > >>> --main-stacksize= > > > >>> >> flag. > > > >>> >> >>>>>>>>>>> >> > ==20833== The main thread stack size used in > > this > > > run > > > >>> >> was 10485760. > > > >>> >> >>>>>>>>>>> >> > ==20833== > > > >>> >> >>>>>>>>>>> >> > ==20833== HEAP SUMMARY: > > > >>> >> >>>>>>>>>>> >> > ==20833== in use at exit: 44,605,326 bytes > in > > > 5,019 > > > >>> >> blocks > > > >>> >> >>>>>>>>>>> >> > ==20833== total heap usage: 10,310 allocs, > > 5,291 > > > >>> frees, > > > >>> >> 78,621,963 > > > >>> >> >>>>>>>>>>> >> bytes > > > >>> >> >>>>>>>>>>> >> > allocated > > > >>> >> >>>>>>>>>>> >> > ==20833== > > > >>> >> >>>>>>>>>>> >> > ==20833== LEAK SUMMARY: > > > >>> >> >>>>>>>>>>> >> > ==20833== definitely lost: 516 bytes in 12 > > > blocks > > > >>> >> >>>>>>>>>>> >> > ==20833== indirectly lost: 0 bytes in 0 > blocks > > > >>> >> >>>>>>>>>>> >> > ==20833== possibly lost: 33,559,553 bytes > in > > > 17 > > > >>> >> blocks > > > >>> >> >>>>>>>>>>> >> > ==20833== still reachable: 11,045,257 bytes > in > > > 4,990 > > > >>> >> blocks > > > >>> >> >>>>>>>>>>> >> > ==20833== suppressed: 0 bytes in 0 > blocks > > > >>> >> >>>>>>>>>>> >> > ==20833== Rerun with --leak-check=full to see > > > details > > > >>> of > > > >>> >> leaked memory > > > >>> >> >>>>>>>>>>> >> > ==20833== > > > >>> >> >>>>>>>>>>> >> > ==20833== For counts of detected and suppressed > > > errors, > > > >>> >> rerun with: -v > > > >>> >> >>>>>>>>>>> >> > ==20833== Use --track-origins=yes to see where > > > >>> >> uninitialised values > > > >>> >> >>>>>>>>>>> come > > > >>> >> >>>>>>>>>>> >> > from > > > >>> >> >>>>>>>>>>> >> > ==20833== ERROR SUMMARY: 11 errors from 3 > > contexts > > > >>> >> (suppressed: 100 > > > >>> >> >>>>>>>>>>> from > > > >>> >> >>>>>>>>>>> >> 9) > > > >>> >> >>>>>>>>>>> >> > 已杀死 > > > >>> >> >>>>>>>>>>> >> > > > > >>> >> >>>>>>>>>>> >> > 2015-03-20 23:29 GMT+08:00 singh.janmejay < > > > >>> >> singh.janme...@gmail.com>: > > > >>> >> >>>>>>>>>>> >> > > > > >>> >> >>>>>>>>>>> >> > > Can you please build with debug symbols and > > > repeat > > > >>> the > > > >>> >> valgrind run? > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > > -- > > > >>> >> >>>>>>>>>>> >> > > Regards, > > > >>> >> >>>>>>>>>>> >> > > Janmejay > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > > PS: Please blame the typos in this mail on my > > > phone's > > > >>> >> uncivilized > > > >>> >> >>>>>>>>>>> soft > > > >>> >> >>>>>>>>>>> >> > > keyboard sporting it's not-so-smart-assist > > > >>> technology. > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > > On Mar 20, 2015 6:03 PM, "chenlin rao" < > > > >>> >> rao.chen...@gmail.com> > > > >>> >> >>>>>>>>>>> wrote: > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > > > btw: if I change omelasticsearch/omfwd to > > > omfile, > > > >>> >> rsyslogd would > > > >>> >> >>>>>>>>>>> be > > > >>> >> >>>>>>>>>>> >> > > fine... > > > >>> >> >>>>>>>>>>> >> > > > > > > >>> >> >>>>>>>>>>> >> > > > 2015-03-20 20:13 GMT+08:00 chenlin rao < > > > >>> >> rao.chen...@gmail.com>: > > > >>> >> >>>>>>>>>>> >> > > > > > > >>> >> >>>>>>>>>>> >> > > > > 3498.767218405:main Q[DA]:Reg/w0: > > > rainerscript: > > > >>> var > > > >>> >> 200:!msg: > > > >>> >> >>>>>>>>>>> '[ { > > > >>> >> >>>>>>>>>>> >> > > "uid": > > > >>> >> >>>>>>>>>>> >> > > > > "1941604034", "request_header": > > > >>> >> >>>>>>>>>>> >> > > "{\"Accept-Encoding\":\"gzip,deflate\"}", > > > >>> >> >>>>>>>>>>> >> > > > > "network_type": "wifi", "end_time": > > > >>> >> "1426836307406", "dns_ip": > > > >>> >> >>>>>>>>>>> >> > > > > "218.15.203.34,192.168.1.1", > > "response_code": > > > >>> "200", > > > >>> >> >>>>>>>>>>> >> "response_data": > > > >>> >> >>>>>>>>>>> >> > > > "{}", > > > >>> >> >>>>>>>>>>> >> > > > > "start_time": "1426836307328", "act": > > > >>> >> "net_fatal_error", "type": > > > >>> >> >>>>>>>>>>> >> > > > > "net_fatal_error", "request_url": > > "https:\/\/ > > > >>> >> api.weibo.cn > > > >>> >> >>>>>>>>>>> >> > > > > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> > > > >>> >> > > > >>> > > > > > > \/2\/client\/url_list?accuracy_level=0&c=android&i=9eef7ba&s=0088f6a4&ua=Xiaomi-MI%202S__weibo__5.0.0__android__android4.4.4&wm=5311_4002&v_f=2&from=1050095010&gsid=4uzH00573m6YZU5oVhYra896c0y&lang=zh_CN&skin=default&oldwm=5311_4002", > > > >>> >> >>>>>>>>>>> >> > > > > "response_status_line": "HTTP\/1.1 200 > OK" > > > }, { > > > >>> >> "uid": > > > >>> >> >>>>>>>>>>> >> "1941604034", > > > >>> >> >>>>>>>>>>> >> > > > > "request_header": > > > >>> >> "{\"Accept-Encoding\":\"gzip,deflate\"}", > > > >>> >> >>>>>>>>>>> >> > > > "network_type": > > > >>> >> >>>>>>>>>>> >> > > > > "wifi", "end_time": "1426836320563", > > > "dns_ip": > > > >>> >> >>>>>>>>>>> >> > > > "218.15.203.34,192.168.1.1", > > > >>> >> >>>>>>>>>>> >> > > > > "response_code": "200", "response_data": > > > "{}", > > > >>> >> "start_time": > > > >>> >> >>>>>>>>>>> >> > > > > "1426836320505", "act": > "net_fatal_error", > > > >>> "type": > > > >>> >> >>>>>>>>>>> >> "net_fatal_error", > > > >>> >> >>>>>>>>>>> >> > > > > "request_url": "https:\/\/api.weibo.cn > > > >>> >> >>>>>>>>>>> >> > > > > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> > > > >>> >> > > > >>> > > > > > > \/2\/client\/url_list?accuracy_level=0&c=android&i=9eef7ba&s=0088f6a4&ua=Xiaomi-MI%202S__weibo__5.0.0__android__android4.4.4&wm=5311_4002&v_f=2&from=1050095010&gsid=4uzH00573m6YZU5oVhYra896c0y&lang=zh_CN&skin=default&oldwm=5311_4002", > > > >>> >> >>>>>>>>>>> >> > > > > "response_status_line": "HTTP\/1.1 200 > OK" > > } > > > ]' > > > >>> >> >>>>>>>>>>> >> > > > > 3498.767338611:main Q[DA]:Reg/w0: eval > expr > > > >>> >> 0x62e63a0, return > > > >>> >> >>>>>>>>>>> >> > datatype > > > >>> >> >>>>>>>>>>> >> > > > 'J' > > > >>> >> >>>>>>>>>>> >> > > > > 3498.770732236:main Q[DA]:Reg/w0: > > ACTION > > > 17 > > > >>> >> >>>>>>>>>>> >> > > > > > [builtin:omfwd:action(type="builtin:omfwd" > > > ...)] > > > >>> >> >>>>>>>>>>> >> > > > > 3498.770963455:main Q[DA]:Reg/w0: > executing > > > >>> action > > > >>> >> 17 > > > >>> >> >>>>>>>>>>> >> > > > > 3498.771052511:main Q[DA]:Reg/w0: Called > > > action, > > > >>> >> logging to > > > >>> >> >>>>>>>>>>> >> > > builtin:omfwd > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Thread 3: > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Invalid read of size 4 > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== at 0x4E3E3A0: > > > pthread_mutex_lock (in > > > >>> >> /lib64/ > > > >>> >> >>>>>>>>>>> >> > > > > libpthread-2.12.so) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x14228D: qqueueEnqMsg > (in > > > >>> >> /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x14BB5B: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143C4C: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143DAC: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143BB9: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x1442CB: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x15336B: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143112: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x13D671: wtiWorker (in > > > >>> >> /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x13D1C1: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x4E3C9D0: start_thread > (in > > > >>> /lib64/ > > > >>> >> >>>>>>>>>>> >> > libpthread-2.12.so) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Address 0x10 is not stack'd, > > > malloc'd > > > >>> or > > > >>> >> (recently) > > > >>> >> >>>>>>>>>>> >> free'd > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Process terminating with > default > > > action > > > >>> >> of signal 11 > > > >>> >> >>>>>>>>>>> >> > > (SIGSEGV) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Access not within mapped > region > > at > > > >>> >> address 0x10 > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== at 0x4E3E3A0: > > > pthread_mutex_lock (in > > > >>> >> /lib64/ > > > >>> >> >>>>>>>>>>> >> > > > > libpthread-2.12.so) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x14228D: qqueueEnqMsg > (in > > > >>> >> /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x14BB5B: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143C4C: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143DAC: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143BB9: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x1442CB: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x15336B: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x143112: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x13D671: wtiWorker (in > > > >>> >> /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x13D1C1: ??? (in > > > /sbin/rsyslogd) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== by 0x4E3C9D0: start_thread > (in > > > >>> /lib64/ > > > >>> >> >>>>>>>>>>> >> > libpthread-2.12.so) > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== If you believe this happened > as > > a > > > >>> result > > > >>> >> of a stack > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== overflow in your program's > main > > > thread > > > >>> >> (unlikely but > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== possible), you can try to > > > increase the > > > >>> >> size of the > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== main thread stack using the > > > >>> >> --main-stacksize= flag. > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== The main thread stack size > used > > in > > > >>> this > > > >>> >> run was > > > >>> >> >>>>>>>>>>> >> 10485760. > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== HEAP SUMMARY: > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== in use at exit: > 1,078,127,378 > > > bytes > > > >>> >> in 291,997 > > > >>> >> >>>>>>>>>>> blocks > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== total heap usage: 614,872 > > allocs, > > > >>> >> 322,875 frees, > > > >>> >> >>>>>>>>>>> >> > > > 1,586,744,205 > > > >>> >> >>>>>>>>>>> >> > > > > bytes allocated > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== LEAK SUMMARY: > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== definitely lost: 33,555,027 > > > bytes in > > > >>> >> 13 blocks > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== indirectly lost: 0 bytes in > 0 > > > blocks > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== possibly lost: 5,760 bytes > > in > > > 18 > > > >>> >> blocks > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== still reachable: > 1,044,566,591 > > > bytes > > > >>> >> in 291,966 > > > >>> >> >>>>>>>>>>> blocks > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== suppressed: 0 bytes in > 0 > > > blocks > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Rerun with --leak-check=full to > > see > > > >>> >> details of leaked > > > >>> >> >>>>>>>>>>> >> > memory > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== For counts of detected and > > > suppressed > > > >>> >> errors, rerun > > > >>> >> >>>>>>>>>>> with: > > > >>> >> >>>>>>>>>>> >> > -v > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== Use --track-origins=yes to see > > > where > > > >>> >> uninitialised > > > >>> >> >>>>>>>>>>> values > > > >>> >> >>>>>>>>>>> >> > > come > > > >>> >> >>>>>>>>>>> >> > > > > from > > > >>> >> >>>>>>>>>>> >> > > > > ==30138== ERROR SUMMARY: 1809 errors > from 5 > > > >>> contexts > > > >>> >> >>>>>>>>>>> (suppressed: > > > >>> >> >>>>>>>>>>> >> 131 > > > >>> >> >>>>>>>>>>> >> > > > from > > > >>> >> >>>>>>>>>>> >> > > > > 9) > > > >>> >> >>>>>>>>>>> >> > > > > Killed > > > >>> >> >>>>>>>>>>> >> > > > > > > > >>> >> >>>>>>>>>>> >> > > > > > > > >>> >> >>>>>>>>>>> >> > > > > 2015-03-20 8:50 GMT+08:00 singh.janmejay > < > > > >>> >> >>>>>>>>>>> singh.janme...@gmail.com > > > >>> >> >>>>>>>>>>> >> >: > > > >>> >> >>>>>>>>>>> >> > > > > > > > >>> >> >>>>>>>>>>> >> > > > >> Can you please run this with valgrind > and > > > share > > > >>> >> its output on > > > >>> >> >>>>>>>>>>> >> crash? > > > >>> >> >>>>>>>>>>> >> > > > >> > > > >>> >> >>>>>>>>>>> >> > > > >> -- > > > >>> >> >>>>>>>>>>> >> > > > >> Regards, > > > >>> >> >>>>>>>>>>> >> > > > >> Janmejay > > > >>> >> >>>>>>>>>>> >> > > > >> > > > >>> >> >>>>>>>>>>> >> > > > >> PS: Please blame the typos in this mail > on > > > my > > > >>> >> phone's > > > >>> >> >>>>>>>>>>> uncivilized > > > >>> >> >>>>>>>>>>> >> > soft > > > >>> >> >>>>>>>>>>> >> > > > >> keyboard sporting it's > not-so-smart-assist > > > >>> >> technology. > > > >>> >> >>>>>>>>>>> >> > > > >> > > > >>> >> >>>>>>>>>>> >> > > > >> On Mar 19, 2015 11:10 PM, "chenlin rao" > < > > > >>> >> rao.chen...@gmail.com > > > >>> >> >>>>>>>>>>> > > > > >>> >> >>>>>>>>>>> >> > > wrote: > > > >>> >> >>>>>>>>>>> >> > > > >> > > > >>> >> >>>>>>>>>>> >> > > > >> > Hello everyone. > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > I just learnt a foreach syntax from > > > >>> >> >>>>>>>>>>> >> > > `src/tests/json_array_looping.sh`, > > > >>> >> >>>>>>>>>>> >> > > > >> so I > > > >>> >> >>>>>>>>>>> >> > > > >> > try to parse my logdata(yes, long json > > > array > > > >>> in > > > >>> >> msg) as > > > >>> >> >>>>>>>>>>> follow: > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > ``` > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > $MaxMessageSize 256k > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > template( name="local6JsonArray" > > > type="string" > > > >>> >> >>>>>>>>>>> >> > string="%$.line%\n" ) > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > Ruleset( > name="forwardRuleSetJsonArray" > > ) > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > { > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > action( type="mmjsonparse" ) > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > foreach ($.line in $!msg) do { > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > action ( type="omfile" > > > >>> >> file="/data0/logfile" > > > >>> >> >>>>>>>>>>> >> > > > >> > template="local6JsonArray") > > > >>> >> >>>>>>>>>>> >> > > > >> > } > > > >>> >> >>>>>>>>>>> >> > > > >> > } > > > >>> >> >>>>>>>>>>> >> > > > >> > ``` > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > But I always got segment fault after > > > restarted > > > >>> >> few minutes. > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > Before the rsyslogd died , I can watch > > > some > > > >>> >> correct lines in > > > >>> >> >>>>>>>>>>> the > > > >>> >> >>>>>>>>>>> >> > > > >> > "/data0/logfile". > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > While running `rsyslogd -dn`, I watch > > the > > > last > > > >>> >> five lines > > > >>> >> >>>>>>>>>>> were: > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > ``` > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > 3295.820218609:main Q:Reg/w0 : > > > FOREACH > > > >>> >> .line IN > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > 3295.820227632:main Q:Reg/w0 : > > var > > > >>> '!msg' > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > 3295.820240109:main Q:Reg/w0 : eval > > expr > > > >>> >> 0x7fe2044fefa0, > > > >>> >> >>>>>>>>>>> type > > > >>> >> >>>>>>>>>>> >> > > 'V[86]' > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > 3295.821747011:main Q:Reg/w0 : > > > rainerscript: > > > >>> >> var 200:!msg: > > > >>> >> >>>>>>>>>>> >> > > '{"msg":[{ > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > "end_time":"142...longmsghere....\"verieval > > > >>> expr > > > >>> >> >>>>>>>>>>> 0x7fe2044fefa0, > > > >>> >> >>>>>>>>>>> >> > > > return > > > >>> >> >>>>>>>>>>> >> > > > >> > datatype 'J' > > > >>> >> >>>>>>>>>>> >> > > > >> > ``` > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > The length of such line is about > > 20k~30k, > > > far > > > >>> >> away below my > > > >>> >> >>>>>>>>>>> >> > > > >> > $MaxMessageSize. > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > So, why rsyslogd segment fault? > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> _______________________________________________ > > > >>> >> >>>>>>>>>>> >> > > > >> > rsyslog mailing list > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> >> > > > >> > What's up with rsyslog? Follow > > > >>> >> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> >> > > > >> > NOTE WELL: This is a PUBLIC mailing > > list, > > > >>> posts > > > >>> >> are ARCHIVED > > > >>> >> >>>>>>>>>>> by > > > >>> >> >>>>>>>>>>> >> a > > > >>> >> >>>>>>>>>>> >> > > > myriad > > > >>> >> >>>>>>>>>>> >> > > > >> > of sites beyond our control. PLEASE > > > >>> UNSUBSCRIBE > > > >>> >> and DO NOT > > > >>> >> >>>>>>>>>>> POST > > > >>> >> >>>>>>>>>>> >> if > > > >>> >> >>>>>>>>>>> >> > > you > > > >>> >> >>>>>>>>>>> >> > > > >> > DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> >> > > > >> > > > > >>> >> >>>>>>>>>>> >> > > > >> > > > _______________________________________________ > > > >>> >> >>>>>>>>>>> >> > > > >> rsyslog mailing list > > > >>> >> >>>>>>>>>>> >> > > > >> > > > >>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> >> > > > >> > > > http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> >> > > > >> What's up with rsyslog? Follow > > > >>> >> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> >> > > > >> NOTE WELL: This is a PUBLIC mailing > list, > > > posts > > > >>> >> are ARCHIVED > > > >>> >> >>>>>>>>>>> by a > > > >>> >> >>>>>>>>>>> >> > > myriad > > > >>> >> >>>>>>>>>>> >> > > > >> of sites beyond our control. PLEASE > > > UNSUBSCRIBE > > > >>> >> and DO NOT > > > >>> >> >>>>>>>>>>> POST if > > > >>> >> >>>>>>>>>>> >> > you > > > >>> >> >>>>>>>>>>> >> > > > >> DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> >> > > > >> > > > >>> >> >>>>>>>>>>> >> > > > > > > > >>> >> >>>>>>>>>>> >> > > > > > > > >>> >> >>>>>>>>>>> >> > > > > > _______________________________________________ > > > >>> >> >>>>>>>>>>> >> > > > rsyslog mailing list > > > >>> >> >>>>>>>>>>> >> > > > > > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> >> > > > > > http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> >> > > > What's up with rsyslog? Follow > > > >>> >> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> >> > > > NOTE WELL: This is a PUBLIC mailing list, > > > posts are > > > >>> >> ARCHIVED by a > > > >>> >> >>>>>>>>>>> >> > myriad > > > >>> >> >>>>>>>>>>> >> > > > of sites beyond our control. PLEASE > > > UNSUBSCRIBE and > > > >>> >> DO NOT POST if > > > >>> >> >>>>>>>>>>> >> you > > > >>> >> >>>>>>>>>>> >> > > > DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> >> > > > > > > >>> >> >>>>>>>>>>> >> > > > _______________________________________________ > > > >>> >> >>>>>>>>>>> >> > > rsyslog mailing list > > > >>> >> >>>>>>>>>>> >> > > > > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> >> > > > http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> >> > > What's up with rsyslog? Follow > > > >>> >> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> >> > > NOTE WELL: This is a PUBLIC mailing list, > posts > > > are > > > >>> >> ARCHIVED by a > > > >>> >> >>>>>>>>>>> >> myriad > > > >>> >> >>>>>>>>>>> >> > > of sites beyond our control. PLEASE > UNSUBSCRIBE > > > and > > > >>> DO > > > >>> >> NOT POST if > > > >>> >> >>>>>>>>>>> you > > > >>> >> >>>>>>>>>>> >> > > DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> >> > > > > > >>> >> >>>>>>>>>>> >> > _______________________________________________ > > > >>> >> >>>>>>>>>>> >> > rsyslog mailing list > > > >>> >> >>>>>>>>>>> >> > > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> >> > http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> >> > What's up with rsyslog? Follow > > > >>> >> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> >> > NOTE WELL: This is a PUBLIC mailing list, posts > > are > > > >>> >> ARCHIVED by a > > > >>> >> >>>>>>>>>>> myriad > > > >>> >> >>>>>>>>>>> >> > of sites beyond our control. PLEASE UNSUBSCRIBE > > > and DO > > > >>> >> NOT POST if you > > > >>> >> >>>>>>>>>>> >> > DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> >> _______________________________________________ > > > >>> >> >>>>>>>>>>> >> rsyslog mailing list > > > >>> >> >>>>>>>>>>> >> > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> >> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> >> What's up with rsyslog? Follow > > > >>> >> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> >> NOTE WELL: This is a PUBLIC mailing list, posts > are > > > >>> >> ARCHIVED by a myriad > > > >>> >> >>>>>>>>>>> >> of sites beyond our control. PLEASE UNSUBSCRIBE > and > > > DO > > > >>> NOT > > > >>> >> POST if you > > > >>> >> >>>>>>>>>>> >> DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> >> > > > >>> >> >>>>>>>>>>> > _______________________________________________ > > > >>> >> >>>>>>>>>>> > rsyslog mailing list > > > >>> >> >>>>>>>>>>> > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> > http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> > What's up with rsyslog? Follow > > > >>> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> > NOTE WELL: This is a PUBLIC mailing list, posts > are > > > >>> ARCHIVED > > > >>> >> by a myriad > > > >>> >> >>>>>>>>>>> of sites beyond our control. PLEASE UNSUBSCRIBE and > DO > > > NOT > > > >>> >> POST if you > > > >>> >> >>>>>>>>>>> DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> _______________________________________________ > > > >>> >> >>>>>>>>>>> rsyslog mailing list > > > >>> >> >>>>>>>>>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>>> What's up with rsyslog? Follow > > > >>> https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>>> NOTE WELL: This is a PUBLIC mailing list, posts are > > > ARCHIVED > > > >>> >> by a myriad > > > >>> >> >>>>>>>>>>> of sites beyond our control. PLEASE UNSUBSCRIBE and > DO > > > NOT > > > >>> >> POST if you > > > >>> >> >>>>>>>>>>> DON'T LIKE THAT. > > > >>> >> >>>>>>>>>>> > > > >>> >> >>>>>>>>>> _______________________________________________ > > > >>> >> >>>>>>>>>> rsyslog mailing list > > > >>> >> >>>>>>>>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>>> What's up with rsyslog? Follow > > > https://twitter.com/rgerhards > > > >>> >> >>>>>>>>>> NOTE WELL: This is a PUBLIC mailing list, posts are > > > ARCHIVED > > > >>> by > > > >>> >> a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO > > NOT > > > >>> POST if > > > >>> >> you DON'T LIKE THAT. > > > >>> >> >>>>>>>>> > > > >>> >> >>>>>>>>> _______________________________________________ > > > >>> >> >>>>>>>>> rsyslog mailing list > > > >>> >> >>>>>>>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>>> What's up with rsyslog? Follow > > > https://twitter.com/rgerhards > > > >>> >> >>>>>>>>> NOTE WELL: This is a PUBLIC mailing list, posts are > > > ARCHIVED > > > >>> by > > > >>> >> a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO > > NOT > > > >>> POST if > > > >>> >> you DON'T LIKE THAT. > > > >>> >> >>>>>>>> > > > >>> >> >>>>>>>> > > > >>> >> >>>>>>>> > > > >>> >> >>>>>>>> -- > > > >>> >> >>>>>>>> Regards, > > > >>> >> >>>>>>>> Janmejay > > > >>> >> >>>>>>>> http://codehunk.wordpress.com > > > >>> >> >>>>>>>> _______________________________________________ > > > >>> >> >>>>>>>> rsyslog mailing list > > > >>> >> >>>>>>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>>> What's up with rsyslog? Follow > > > https://twitter.com/rgerhards > > > >>> >> >>>>>>>> NOTE WELL: This is a PUBLIC mailing list, posts are > > > ARCHIVED > > > >>> by a > > > >>> >> myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO > NOT > > > POST > > > >>> if > > > >>> >> you DON'T LIKE THAT. > > > >>> >> >>>>>>> _______________________________________________ > > > >>> >> >>>>>>> rsyslog mailing list > > > >>> >> >>>>>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>>>> What's up with rsyslog? Follow > > > https://twitter.com/rgerhards > > > >>> >> >>>>>>> NOTE WELL: This is a PUBLIC mailing list, posts are > > > ARCHIVED by > > > >>> a > > > >>> >> myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO > NOT > > > POST > > > >>> if > > > >>> >> you DON'T LIKE THAT. > > > >>> >> >>>>>> > > > >>> >> >>>>>> > > > >>> >> >>>>>> > > > >>> >> >>>>>> -- > > > >>> >> >>>>>> Regards, > > > >>> >> >>>>>> Janmejay > > > >>> >> >>>>>> http://codehunk.wordpress.com > > > >>> >> >>>>> > > > >>> >> >>>>> > > > >>> >> >>>>> > > > >>> >> >>>>> -- > > > >>> >> >>>>> Regards, > > > >>> >> >>>>> Janmejay > > > >>> >> >>>>> http://codehunk.wordpress.com > > > >>> >> >>>>> _______________________________________________ > > > >>> >> >>>>> rsyslog mailing list > > > >>> >> >>>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>>> What's up with rsyslog? Follow > > https://twitter.com/rgerhards > > > >>> >> >>>>> NOTE WELL: This is a PUBLIC mailing list, posts are > ARCHIVED > > > by a > > > >>> >> myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO > NOT > > > POST > > > >>> if > > > >>> >> you DON'T LIKE THAT. > > > >>> >> >>>> _______________________________________________ > > > >>> >> >>>> rsyslog mailing list > > > >>> >> >>>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> >>>> http://www.rsyslog.com/professional-services/ > > > >>> >> >>>> What's up with rsyslog? Follow > https://twitter.com/rgerhards > > > >>> >> >>>> NOTE WELL: This is a PUBLIC mailing list, posts are > ARCHIVED > > > by a > > > >>> >> myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO > NOT > > > POST > > > >>> if > > > >>> >> you DON'T LIKE THAT. > > > >>> >> >>> > > > >>> >> >>> > > > >>> >> >>> > > > >>> >> >>> -- > > > >>> >> >>> Regards, > > > >>> >> >>> Janmejay > > > >>> >> >>> http://codehunk.wordpress.com > > > >>> >> >> > > > >>> >> >> > > > >>> >> >> > > > >>> >> >> -- > > > >>> >> >> Regards, > > > >>> >> >> Janmejay > > > >>> >> >> http://codehunk.wordpress.com > > > >>> >> > > > > >>> >> > > > > >>> >> > > > > >>> >> > -- > > > >>> >> > Regards, > > > >>> >> > Janmejay > > > >>> >> > http://codehunk.wordpress.com > > > >>> >> > > > >>> >> > > > >>> >> > > > >>> >> -- > > > >>> >> Regards, > > > >>> >> Janmejay > > > >>> >> http://codehunk.wordpress.com > > > >>> >> _______________________________________________ > > > >>> >> rsyslog mailing list > > > >>> >> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> >> http://www.rsyslog.com/professional-services/ > > > >>> >> What's up with rsyslog? Follow https://twitter.com/rgerhards > > > >>> >> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by > a > > > myriad > > > >>> >> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST > if > > > you > > > >>> >> DON'T LIKE THAT. > > > >>> >> > > > >>> > _______________________________________________ > > > >>> > rsyslog mailing list > > > >>> > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> > http://www.rsyslog.com/professional-services/ > > > >>> > What's up with rsyslog? Follow https://twitter.com/rgerhards > > > >>> > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > > > myriad > > > >>> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if > > you > > > >>> DON'T LIKE THAT. > > > >>> > > > >>> > > > >>> > > > >>> -- > > > >>> Regards, > > > >>> Janmejay > > > >>> http://codehunk.wordpress.com > > > >>> _______________________________________________ > > > >>> rsyslog mailing list > > > >>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> http://www.rsyslog.com/professional-services/ > > > >>> What's up with rsyslog? Follow https://twitter.com/rgerhards > > > >>> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > > > myriad > > > >>> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if > > you > > > >>> DON'T LIKE THAT. > > > >>> > > > >> _______________________________________________ > > > >> rsyslog mailing list > > > >> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >> http://www.rsyslog.com/professional-services/ > > > >> What's up with rsyslog? Follow https://twitter.com/rgerhards > > > >> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > > > myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST > if > > > you DON'T LIKE THAT. > > > > > > > > > > > > > > > > -- > > > > Regards, > > > > Janmejay > > > > http://codehunk.wordpress.com > > > > > > > > > > > > -- > > > Regards, > > > Janmejay > > > http://codehunk.wordpress.com > > > _______________________________________________ > > > rsyslog mailing list > > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > http://www.rsyslog.com/professional-services/ > > > What's up with rsyslog? Follow https://twitter.com/rgerhards > > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > myriad > > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > > > DON'T LIKE THAT. > > > > > _______________________________________________ > > rsyslog mailing list > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > http://www.rsyslog.com/professional-services/ > > What's up with rsyslog? Follow https://twitter.com/rgerhards > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > > DON'T LIKE THAT. > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > DON'T LIKE THAT. > _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.