Hi,
Coredump seems to be without debug symbols. Was trying to match it with the
backtrace to inspect variables involved in imxsock.c:1419, but this is what
I got.
{ gdb }
thread apply all bt
Thread 3 (LWP 6234):
#0 0x0000003a7f8e12e3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 6236):
#0 0x0000003a8000b5bc in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000000d1f6a8 in ?? ()
#3 0x0000000000d20120 in ?? ()
#4 0x0000000000000000 in ?? ()
Thread 1 (LWP 6235):
#0 0x00007f8f53a58140 in ?? ()
#1 0x0000000000000000 in ?? ()
{ gdb }
thread 3
[Switching to thread 3 (LWP 6234)]
#0 0x0000003a7f8e12e3 in ?? ()
{ gdb }
info locals
No symbol table info available.
{ gdb }
On Fri, Oct 24, 2014 at 7:26 PM, Alexander Fisher <[email protected]>
wrote:
> Hi Rainer.
>
> I've run the gdb commands and the output is below. I'm now using the
> latest v8-stable (which incidentally doesn't build for me without hacking
> msg.c - I'll open a new ticket for this)
>
> Thanks,
> Alex
>
> Reading symbols from /opt/rsyslog-8.4x/sbin/rsyslogd...done.
> (gdb) core /core.6920
> [New Thread 6921]
> [New Thread 6920]
> [New Thread 6922]
> Missing separate debuginfo for /opt/rsyslog-8.4x/lib/libestr.so.0
> Try: yum --disablerepo='*' --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/75/97892625f43b68e8e62debe0a1235c2cbb6fd4
> Missing separate debuginfo for /opt/rsyslog-8.4x/lib/libjson-c.so.2
> Try: yum --disablerepo='*' --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/5c/1b70b6914e0b9fdf10ebb4e3e2fc341076bf44
> Missing separate debuginfo for /opt/rsyslog-8.4x/lib/liblogging-stdlog.so.0
> Try: yum --disablerepo='*' --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/9d/640ae8d9f0fa29418e980026d1d7d8176e2f5e
> Missing separate debuginfo for /opt/rsyslog-8.4x/lib/rsyslog/lmnet.so
> Try: yum --disablerepo='*' --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/8b/65d5eec5562b78057ca638aac2e307c1aff6e3
> Missing separate debuginfo for /opt/rsyslog-8.4x/lib/rsyslog/imuxsock.so
> Try: yum --disablerepo='*' --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/e3/a5dae5feb5127f5cce40b123b25a18eaa5e412
> Missing separate debuginfo for
> Try: yum --disablerepo='*' --enablerepo='*-debug*' install
> /usr/lib/debug/.build-id/54/74f0d8daf3d6177e2c4b06f3892745cb43b4d5
> Reading symbols from /lib64/libz.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libz.so.1
> Reading symbols from /lib64/libpthread.so.0...(no debugging symbols
> found)...done.
> [Thread debugging using libthread_db enabled]
> Loaded symbols for /lib64/libpthread.so.0
> Reading symbols from /lib64/libdl.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libdl.so.2
> Reading symbols from /lib64/librt.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/librt.so.1
> Reading symbols from /opt/rsyslog-8.4x/lib/libestr.so.0...done.
> Loaded symbols for /opt/rsyslog-8.4x/lib/libestr.so.0
> Reading symbols from /opt/rsyslog-8.4x/lib/libjson-c.so.2...done.
> Loaded symbols for /opt/rsyslog-8.4x/lib/libjson-c.so.2
> Reading symbols from /lib64/libuuid.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libuuid.so.1
> Reading symbols from /opt/rsyslog-8.4x/lib/liblogging-stdlog.so.0...done.
> Loaded symbols for /opt/rsyslog-8.4x/lib/liblogging-stdlog.so.0
> Reading symbols from /lib64/libc.so.6...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libc.so.6
> Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/ld-linux-x86-64.so.2
> Reading symbols from /opt/rsyslog-8.4x/lib/rsyslog/lmnet.so...done.
> Loaded symbols for /opt/rsyslog-8.4x/lib/rsyslog/lmnet.so
> Reading symbols from /opt/rsyslog-8.4x/lib/rsyslog/imuxsock.so...done.
> Loaded symbols for /opt/rsyslog-8.4x/lib/rsyslog/imuxsock.so
> Core was generated by `/opt/rsyslog-8.4x/sbin/rsyslogd -nd -f
> /opt/rsyslog-8.4x/etc/rsyslog.conf'.
> Program terminated with signal 11, Segmentation fault.
> #0 0x00007fd29d4b7fc0 in runInput (pThrd=0x26a4fb0) at imuxsock.c:1419
> 1419 if ((fd = listeners[i].fd) != -1 &&
> FD_ISSET(fd, pReadfds)) {
> Missing separate debuginfos, use: debuginfo-install
> glibc-2.12-1.132.el6_5.4.x86_64 libuuid-2.17.2-12.14.el6_5.x86_64
> zlib-1.2.3-29.el6.x86_64
>
> (gdb) info thread
> 3 Thread 0x7fd297fff700 (LWP 6922) 0x0000003250a0b5bc in
> pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
> 2 Thread 0x7fd29d927740 (LWP 6920) 0x00000032502e12e3 in select () from
> /lib64/libc.so.6
> * 1 Thread 0x7fd29d3dc700 (LWP 6921) 0x00007fd29d4b7fc0 in runInput
> (pThrd=0x26a4fb0) at imuxsock.c:1419
>
> (gdb) thread apply all bt full
>
> Thread 3 (Thread 0x7fd297fff700 (LWP 6922)):
> #0 0x0000003250a0b5bc in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib64/libpthread.so.0
> No symbol table info available.
> #1 0x0000000000457336 in doIdleProcessing (pThis=0x26a4640,
> pWtp=0x26a4530, pbInactivityTOOccured=0x7fd297ffecb4) at wti.c:266
> t = {tv_sec = 24, tv_nsec = 140542469994240}
> #2 0x00000000004575f5 in wtiWorker (pThis=0x26a4640) at wti.c:344
> __cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf =
> {140542469994240, 3017125353712723148, 40519112, 140542469994944, 0, 3,
> 3017125353674974412, -2991563386703371060},
> __mask_was_saved = 0}}, __pad = {0x7fd297ffed30, 0x0, 0x0, 0x0}}
> __cancel_routine = 0x45722d <wtiWorkerCancelCleanup>
> __cancel_arg = 0x26a4640
> not_first_call = 0
> pWtp = 0x26a4530
> pAction = 0x0
> bInactivityTOOccured = 0
> localRet = RS_RET_IDLE
> terminateRet = RS_RET_OK
> wrkrInfo = 0x0
> iCancelStateSave = 0
> i = 0
> j = 0
> k = -1744835312
> iRet = RS_RET_OK
> #3 0x0000000000456704 in wtpWorker (arg=0x26a4640) at wtp.c:390
> __cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf =
> {140542469994240, 3017125353599476940, 40519112, 140542469994944, 0, 3,
> 3017125353710625996, -2991563387290311476},
> __mask_was_saved = 0}}, __pad = {0x7fd297ffef10, 0x0, 0x0, 0x0}}
> __cancel_routine = 0x4564d0 <wtpWrkrExecCancelCleanup>
> __cancel_arg = 0x26a4640
> not_first_call = 0
> pWti = 0x26a4640
> pThis = 0x26a4530
> sigSet = {__val = {1048576, 0 <repeats 15 times>}}
> pszDbgHdr = 0x26a7820 "main Q:Reg"
> thrdName = "rs:main Q:Reg", '\000' <repeats 18 times>
> #4 0x0000003250a079d1 in start_thread () from /lib64/libpthread.so.0
> No symbol table info available.
> #5 0x00000032502e886d in clone () from /lib64/libc.so.6
> No symbol table info available.
>
> Thread 2 (Thread 0x7fd29d927740 (LWP 6920)):
> #0 0x00000032502e12e3 in select () from /lib64/libc.so.6
> No symbol table info available.
> #1 0x000000000041119d in mainloop () at rsyslogd.c:1196
> ---Type <return> to continue, or q <return> to quit---
> tvSelectTimeout = {tv_sec = 597, tv_usec = 673607}
> #2 0x0000000000411415 in main (argc=4, argv=0x7fff3a3c75d8) at
> rsyslogd.c:1321
> No locals.
>
> Thread 1 (Thread 0x7fd29d3dc700 (LWP 6921)):
> #0 0x00007fd29d4b7fc0 in runInput (pThrd=0x26a4fb0) at imuxsock.c:1419
> iRet = RS_RET_OK
> maxfds = 3
> nfds = 1
> i = 0
> fd = 40517824
> readfds = {fds_bits = {8, 0 <repeats 15 times>}}
> pReadfds = 0x7fd29d3dbce0
> #1 0x000000000046abce in thrdStarter (arg=0x26a4fb0) at ../threads.c:212
> iRet = RS_RET_OK
> pThis = 0x26a4fb0
> thrdName = "in:imuxsock", '\000' <repeats 20 times>
> sigSet = {__val = {1048576, 0 <repeats 15 times>}}
> #2 0x0000003250a079d1 in start_thread () from /lib64/libpthread.so.0
> No symbol table info available.
> #3 0x00000032502e886d in clone () from /lib64/libc.so.6
> No symbol table info available.
>
> On 24 October 2014 11:36, Rainer Gerhards <[email protected]>
> wrote:
>
> > Hi,
> >
> > unfortunately, the coredump itself doesn't help me much, as I would need
> an
> > exact same environment to interpret it. It would be great if you could
> run
> > a quick set of gdb commands on it and send the outcome. Instructions are
> > here (a bit down in the segfault section):
> >
> >
> >
> http://www.rsyslog.com/doc/master/troubleshooting/troubleshoot.html#segmentation-faults
> >
> > Thanks,
> > Rainer
> >
> > 2014-10-23 15:53 GMT+02:00 Alexander Fisher <[email protected]>:
> >
> > > Hi Janmejay
> > >
> > > I've recompiled with those options and generated a coredump (attached).
> > > Thanks,
> > > Alex
> > >
> > > On 23 October 2014 13:43, singh.janmejay <[email protected]>
> > wrote:
> > >
> > > > Can you build with cflags -g3 -ggdb, enable coredump (ulimit -c
> > > unlimited)
> > > > and if we are lucky we'll soon have a dump to look at.
> > > >
> > > > If relp is involved please don't forget to compile that with g3 too.
> > > >
> > > > Also, please don't let checkinstall or any other packaging utility
> > strip
> > > > the binaries.
> > > >
> > > > --
> > > > Regards,
> > > > Janmejay
> > > >
> > > > PS: Please blame the typos in this mail on my phone's uncivilized
> soft
> > > > keyboard sporting it's not-so-smart-assist technology.
> > > >
> > > > On Oct 23, 2014 5:58 PM, "Alexander Fisher" <[email protected]>
> > > wrote:
> > > >
> > > > > Hi
> > > > >
> > > > > Can anybody reproduce or help me get to the bottom of
> > > > > https://github.com/rsyslog/rsyslog/issues/140 ?
> > > > >
> > > > > I thought I might reach a bigger audience trying on the mailing
> list.
> > > > >
> > > > > it looks like a race condition, but maybe it's got something to do
> > with
> > > > my
> > > > > configuration options.
> > > > > They are simply
> > > > >
> > > > > ./configure --prefix=/opt/rsyslog-8.4 --enable-relp=yes
> > --enable-static
> > > > >
> > > > > Kind Regards,
> > > > > Alex
> > > > >
> > > > > P.S. There's also https://github.com/rsyslog/rsyslog/issues/120
> > > > > But that's less of a priority and I can probably live without the
> > > broken
> > > > > feature.
> > > > > _______________________________________________
> > > > > rsyslog mailing list
> > > > > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > > > > http://www.rsyslog.com/professional-services/
> > > > > What's up with rsyslog? Follow https://twitter.com/rgerhards
> > > > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
> > > myriad
> > > > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if
> > you
> > > > > DON'T LIKE THAT.
> > > > >
> > > > _______________________________________________
> > > > rsyslog mailing list
> > > > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > > > http://www.rsyslog.com/professional-services/
> > > > What's up with rsyslog? Follow https://twitter.com/rgerhards
> > > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
> > myriad
> > > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if
> you
> > > > DON'T LIKE THAT.
> > > >
> > >
> > > _______________________________________________
> > > rsyslog mailing list
> > > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > > http://www.rsyslog.com/professional-services/
> > > What's up with rsyslog? Follow https://twitter.com/rgerhards
> > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a
> myriad
> > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
> > > DON'T LIKE THAT.
> > >
> > _______________________________________________
> > rsyslog mailing list
> > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > http://www.rsyslog.com/professional-services/
> > What's up with rsyslog? Follow https://twitter.com/rgerhards
> > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
> > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
> > DON'T LIKE THAT.
> >
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
> DON'T LIKE THAT.
>
--
Regards,
Janmejay
http://codehunk.wordpress.com
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
