[Bug 1532314] Re: Buffer overflow in cgmanager
They were all sockets. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to lxc in Ubuntu. https://bugs.launchpad.net/bugs/1532314 Title: Buffer overflow in cgmanager To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/1532314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
Re: [Bug 1532314] Re: Buffer overflow in cgmanager
Yes I was able to hit 1024 open fd's. On Mon, Jan 11, 2016 at 9:18 AM, Serge Hallyn <1532...@bugs.launchpad.net> wrote: > Can you show 'ls /proc/$(pidof cgmanager)/fd' at a few times? > > This is something we've run into with normal operation in go, but since > cgmanager is not threaded it should not have so many open fds. > > -- > You received this bug notification because you are subscribed to the bug > report. > https://bugs.launchpad.net/bugs/1532314 > > Title: > Buffer overflow in cgmanager > > Status in lxc package in Ubuntu: > Incomplete > > Bug description: > Host: Ubuntu 15.10 > lxc: 1.1.5-0ubuntu0.15.10.3 > cgmanager: 0.39-2ubuntu2 > Container: Ubuntu 15.10 > > Got the following trace in syslog. Please let me know what other > information will be useful for troubleshooting. > > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: *** buffer overflow > detected ***: /sbin/cgmanager terminated > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: === Backtrace: > = > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libc.so.6(+0x78c4e)[0x7f1929550c4e] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x5c)[0x7f19295f0e8c] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libc.so.6(+0x116e80)[0x7f19295eee80] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libc.so.6(+0x118dd7)[0x7f19295f0dd7] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libnih.so.1(nih_io_handle_fds+0xad)[0x7f1929d01b3d] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libnih.so.1(nih_main_loop+0x13f)[0x7f1929d05faf] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /sbin/cgmanager(+0x5145)[0x562d8fc75145] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f19294f8a40] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > /sbin/cgmanager(+0x53d9)[0x562d8fc753d9] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: === Memory map: > > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 562d8fc7-562d8fc92000 r-xp ca:01 12884 > /sbin/cgmanager > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 562d8fe92000-562d8fe94000 r--p 00022000 ca:01 12884 > /sbin/cgmanager > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 562d8fe94000-562d8fe95000 rw-p 00024000 ca:01 12884 > /sbin/cgmanager > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 562d915f8000-562d9203 rw-p 00:00 0 > [heap] > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1927d44000-7f1927d5a000 r-xp ca:01 395872 > /lib/x86_64-linux-gnu/libgcc_s.so.1 > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1927d5a000-7f1927f59000 ---p 00016000 ca:01 395872 > /lib/x86_64-linux-gnu/libgcc_s.so.1 > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1927f59000-7f1927f5a000 r--p 00015000 ca:01 395872 > /lib/x86_64-linux-gnu/libgcc_s.so.1 > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1927f5a000-7f1927f5b000 rw-p 00016000 ca:01 395872 > /lib/x86_64-linux-gnu/libgcc_s.so.1 > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1927f5b000-7f1927f67000 r-xp ca:01 403839 > /lib/x86_64-linux-gnu/libnss_files-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1927f67000-7f1928166000 ---p c000 ca:01 403839 > /lib/x86_64-linux-gnu/libnss_files-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928166000-7f1928167000 r--p b000 ca:01 403839 > /lib/x86_64-linux-gnu/libnss_files-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928167000-7f1928168000 rw-p c000 ca:01 403839 > /lib/x86_64-linux-gnu/libnss_files-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928168000-7f1928173000 r-xp ca:01 403823 > /lib/x86_64-linux-gnu/libnss_nis-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928173000-7f1928372000 ---p b000 ca:01 403823 > /lib/x86_64-linux-gnu/libnss_nis-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928372000-7f1928373000 r--p a000 ca:01 403823 > /lib/x86_64-linux-gnu/libnss_nis-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928373000-7f1928374000 rw-p b000 ca:01 403823 > /lib/x86_64-linux-gnu/libnss_nis-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f1928374000-7f192838b000 r-xp ca:01 403845 > /lib/x86_64-linux-gnu/libnsl-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f192838b000-7f192858a000 ---p 00017000 ca:01 403845 > /lib/x86_64-linux-gnu/libnsl-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: > 7f192858a000-7f192858b000 r--p 00016000 ca:01 403845 > /lib/x86_64-linux-gnu/libnsl-2.21.so > Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: >
[Bug 1532314] Re: Buffer overflow in cgmanager
The stack trace seems to indicate that FD_SETSIZE was exceeded. Specifically, FD_SET was called with an fd >= 1024 at http://bazaar.launchpad.net/~scott/libnih/trunk/view/head:/nih/io.c#L176. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to lxc in Ubuntu. https://bugs.launchpad.net/bugs/1532314 Title: Buffer overflow in cgmanager To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/1532314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1532314] Re: Buffer overflow in cgmanager
It can happen fairly often. For example, in one case it happened 5 times within a span of less than 30 minutes. Jan 8 05:35:04 ip-10-169-176-230 cgmanager[781]: *** buffer overflow detected ***: /sbin/cgmanager terminated Jan 8 05:40:23 ip-10-169-176-230 cgmanager[15954]: *** buffer overflow detected ***: /sbin/cgmanager terminated Jan 8 05:51:00 ip-10-169-176-230 cgmanager[31989]: *** buffer overflow detected ***: /sbin/cgmanager terminated Jan 8 05:56:19 ip-10-169-176-230 cgmanager[23719]: *** buffer overflow detected ***: /sbin/cgmanager terminated Jan 8 06:01:38 ip-10-169-176-230 cgmanager[5627]: *** buffer overflow detected ***: /sbin/cgmanager terminated However, I still don't know the specific condition that triggers it. I'm repeating the same test suite over and over, and sometimes it can go for a long time without triggering. I tried your commands and they trigger the crash. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to lxc in Ubuntu. https://bugs.launchpad.net/bugs/1532314 Title: Buffer overflow in cgmanager To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/1532314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1532314] Re: Buffer overflow in cgmanager
** Attachment added: "/var/crash/_sbin_cgmanager.0.crash" https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/1532314/+attachment/4546429/+files/crash -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to lxc in Ubuntu. https://bugs.launchpad.net/bugs/1532314 Title: Buffer overflow in cgmanager To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/1532314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1532314] [NEW] Buffer overflow in cgmanager
Public bug reported: Host: Ubuntu 15.10 lxc: 1.1.5-0ubuntu0.15.10.3 cgmanager: 0.39-2ubuntu2 Container: Ubuntu 15.10 Got the following trace in syslog. Please let me know what other information will be useful for troubleshooting. Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: *** buffer overflow detected ***: /sbin/cgmanager terminated Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: === Backtrace: = Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libc.so.6(+0x78c4e)[0x7f1929550c4e] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x5c)[0x7f19295f0e8c] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libc.so.6(+0x116e80)[0x7f19295eee80] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libc.so.6(+0x118dd7)[0x7f19295f0dd7] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libnih.so.1(nih_io_handle_fds+0xad)[0x7f1929d01b3d] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libnih.so.1(nih_main_loop+0x13f)[0x7f1929d05faf] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /sbin/cgmanager(+0x5145)[0x562d8fc75145] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f19294f8a40] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: /sbin/cgmanager(+0x53d9)[0x562d8fc753d9] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: === Memory map: Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 562d8fc7-562d8fc92000 r-xp ca:01 12884 /sbin/cgmanager Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 562d8fe92000-562d8fe94000 r--p 00022000 ca:01 12884 /sbin/cgmanager Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 562d8fe94000-562d8fe95000 rw-p 00024000 ca:01 12884 /sbin/cgmanager Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 562d915f8000-562d9203 rw-p 00:00 0 [heap] Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1927d44000-7f1927d5a000 r-xp ca:01 395872 /lib/x86_64-linux-gnu/libgcc_s.so.1 Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1927d5a000-7f1927f59000 ---p 00016000 ca:01 395872 /lib/x86_64-linux-gnu/libgcc_s.so.1 Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1927f59000-7f1927f5a000 r--p 00015000 ca:01 395872 /lib/x86_64-linux-gnu/libgcc_s.so.1 Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1927f5a000-7f1927f5b000 rw-p 00016000 ca:01 395872 /lib/x86_64-linux-gnu/libgcc_s.so.1 Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1927f5b000-7f1927f67000 r-xp ca:01 403839 /lib/x86_64-linux-gnu/libnss_files-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1927f67000-7f1928166000 ---p c000 ca:01 403839 /lib/x86_64-linux-gnu/libnss_files-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928166000-7f1928167000 r--p b000 ca:01 403839 /lib/x86_64-linux-gnu/libnss_files-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928167000-7f1928168000 rw-p c000 ca:01 403839 /lib/x86_64-linux-gnu/libnss_files-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928168000-7f1928173000 r-xp ca:01 403823 /lib/x86_64-linux-gnu/libnss_nis-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928173000-7f1928372000 ---p b000 ca:01 403823 /lib/x86_64-linux-gnu/libnss_nis-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928372000-7f1928373000 r--p a000 ca:01 403823 /lib/x86_64-linux-gnu/libnss_nis-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928373000-7f1928374000 rw-p b000 ca:01 403823 /lib/x86_64-linux-gnu/libnss_nis-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f1928374000-7f192838b000 r-xp ca:01 403845 /lib/x86_64-linux-gnu/libnsl-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f192838b000-7f192858a000 ---p 00017000 ca:01 403845 /lib/x86_64-linux-gnu/libnsl-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f192858a000-7f192858b000 r--p 00016000 ca:01 403845 /lib/x86_64-linux-gnu/libnsl-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f192858b000-7f192858c000 rw-p 00017000 ca:01 403845 /lib/x86_64-linux-gnu/libnsl-2.21.so Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f192858c000-7f192858e000 rw-p 00:00 0 Jan 8 19:29:24 ip-10-169-249-164 cgmanager[7725]: 7f192858e000-7f1928596000 r-xp ca:01 403841 /lib/x86_64-linux-gnu/libnss_compat-2.21.so Jan 8 19:29
[Bug 1530617] Re: FUSE in wily image with upstart installed causes chaos
Thanks for looking into it. Are there any downsides to disabling udev in the container (by removing /etc/init/udev.conf for example) if we don't need the container to be notified of new devices? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to lxc in Ubuntu. https://bugs.launchpad.net/bugs/1530617 Title: FUSE in wily image with upstart installed causes chaos To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1530617/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1530617] [NEW] FUSE in wily image with upstart installed causes chaos
Public bug reported: Host: DISTRIB_ID=Ubuntu DISTRIB_RELEASE=15.10 DISTRIB_CODENAME=wily DISTRIB_DESCRIPTION="Ubuntu 15.10" lxc version: 1.1.4-0ubuntu1 In a LXC container running Ubuntu 15.10, install upstart-sysv to replace systemd. Using FUSE then causes almost all processes in the container to be killed. The following steps reproduce the problem using sshfs: # create a wily container and attach to it sudo lxc-create -t download -n wily -- -d ubuntu -r wily -a amd64 sudo lxc-start -n wily sudo lxc-attach -n wily # inside the container, install upstart-sysv and reboot apt-get update && apt-get -y install upstart-sysv reboot # on the host, reattach to the container sudo lxc-attach -n wily # back in the container, install ssh and sshfs apt-get -y install openssh-server sshfs # create an ssh key pair in /root/.ssh ssh-keygen # set up passwordless ssh mkdir ~ubuntu/.ssh cat /root/.ssh/id_rsa.pub >> ~ubuntu/.ssh/authorized_keys eval $(ssh-agent) ssh-add /root/.ssh/id_rsa # take a note of the running processes and their PIDs ps axjf # run sshfs mkdir /fuse sshfs ubuntu@localhost:/ /fuse # we are kicked out of the container # run ps again in the container sudo lxc-attach -n wily -- ps axjf # a whole bunch of processes are now gone. the getty processes now have new PIDs, indicating they have been restarted. Other debugging performed: - On a 14.10 host with lxc version 1.1.0~alpha2-0ubuntu3.3, the problem does not occur. FUSE works fine. - On the same 14.10 host with lxc upgraded to 1.1.5-0ubuntu3~ubuntu14.04.1, the problem occurs. - On a 15.10 host, when running a wily container without upstart, the problem does not occur. - On a 15.10 host, when running a trusty container, the problem does not occur. - The problem can't be reproduced outside a container (15.10 host, install upstart-sysv, then use FUSE) ** Affects: lxc (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to lxc in Ubuntu. https://bugs.launchpad.net/bugs/1530617 Title: FUSE in wily image with upstart installed causes chaos To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/lxc/+bug/1530617/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs