Re: [lxc-users] lxc stop / lxc reboot hang
On Wed, Mar 1, 2017 at 1:56 PM, Tomasz Chmielewskiwrote: > Again seeing this issue on one of the servers: > > - "lxc stop container" will stop the container but will never exit > - "lxc restart container" will stop the container and will never exit > > > # dpkg -l|grep lxd > ii lxd 2.0.9-0ubuntu1~16.04.2 > amd64Container hypervisor based on LXC - daemon > ii lxd-client 2.0.9-0ubuntu1~16.04.2 > amd64Container hypervisor based on LXC - client > > > This gets logged to container log: > > lxc 20170301115514.738 WARN lxc_commands - > commands.c:lxc_cmd_rsp_recv:172 - Command get_cgroup failed to receive > response: Connection reset by peer. > > > How can it be debugged? Try lxc stop --verbose --debug mycontainer which should show the exact communication between the lxd-client and LXD. Have a look at https://github.com/lxc/lxd/issues I think the report titled "lxc stop waits indefinitely" is similar to your issue. Simos > > Tomasz > > > > On 2017-02-03 13:05, Tomasz Chmielewski wrote: >> >> On 2017-02-03 12:52, Tomasz Chmielewski wrote: >>> >>> Suddenly, today, I'm not able to stop or reboot any of containers: >>> >>> # lxc stop some-container >>> >>> Just sits there forever. >>> >>> >>> In /var/log/lxd/lxd.log, only this single entry shows up: >>> >>> t=2017-02-03T03:46:20+ lvl=info msg="Shutting down container" >>> creation date=2017-01-19T15:51:21+ ephemeral=false timeout=-1s >>> name=some-container action=shutdown >>> >>> >>> In /var/log/lxd/some-container/lxc.log, only this one shows up: >>> >>> lxc 20170203034624.534 WARN lxc_commands - >>> commands.c:lxc_cmd_rsp_recv:172 - command get_cgroup failed to receive >>> response >> >> >> The container actually stops (it's in STOPPED state in "lxc list"). >> >> The command just never returns. >> >> >> Tomasz Chmielewski >> https://lxadm.com >> ___ >> lxc-users mailing list >> lxc-users@lists.linuxcontainers.org >> http://lists.linuxcontainers.org/listinfo/lxc-users > > ___ > lxc-users mailing list > lxc-users@lists.linuxcontainers.org > http://lists.linuxcontainers.org/listinfo/lxc-users ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users
Re: [lxc-users] lxc stop / lxc reboot hang
Again seeing this issue on one of the servers: - "lxc stop container" will stop the container but will never exit - "lxc restart container" will stop the container and will never exit # dpkg -l|grep lxd ii lxd 2.0.9-0ubuntu1~16.04.2 amd64Container hypervisor based on LXC - daemon ii lxd-client 2.0.9-0ubuntu1~16.04.2 amd64Container hypervisor based on LXC - client This gets logged to container log: lxc 20170301115514.738 WARN lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - Command get_cgroup failed to receive response: Connection reset by peer. How can it be debugged? Tomasz On 2017-02-03 13:05, Tomasz Chmielewski wrote: On 2017-02-03 12:52, Tomasz Chmielewski wrote: Suddenly, today, I'm not able to stop or reboot any of containers: # lxc stop some-container Just sits there forever. In /var/log/lxd/lxd.log, only this single entry shows up: t=2017-02-03T03:46:20+ lvl=info msg="Shutting down container" creation date=2017-01-19T15:51:21+ ephemeral=false timeout=-1s name=some-container action=shutdown In /var/log/lxd/some-container/lxc.log, only this one shows up: lxc 20170203034624.534 WARN lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - command get_cgroup failed to receive response The container actually stops (it's in STOPPED state in "lxc list"). The command just never returns. Tomasz Chmielewski https://lxadm.com ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users
Re: [lxc-users] lxc stop / lxc reboot hang
On 2017-02-03 12:52, Tomasz Chmielewski wrote: Suddenly, today, I'm not able to stop or reboot any of containers: # lxc stop some-container Just sits there forever. In /var/log/lxd/lxd.log, only this single entry shows up: t=2017-02-03T03:46:20+ lvl=info msg="Shutting down container" creation date=2017-01-19T15:51:21+ ephemeral=false timeout=-1s name=some-container action=shutdown In /var/log/lxd/some-container/lxc.log, only this one shows up: lxc 20170203034624.534 WARN lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - command get_cgroup failed to receive response The container actually stops (it's in STOPPED state in "lxc list"). The command just never returns. Tomasz Chmielewski https://lxadm.com ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users
Re: [lxc-users] lxc stop / lxc reboot hang
--This is an automated reply.-- The person to whom to your email was addressed is no longer with MAXIMUM Communications INC. Unfortunately, due to spam control, we do NOT monitor this email address and have not received your request. If you do intend to send an email to MAXIMUM Communications INC or are a customer of MAXIMUM Communications INC , please initiate an email addressed to Service at maximumcallcenter.com. Thank you very much, MAXIMUM Communications INC ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users
Re: [lxc-users] lxc stop / lxc reboot hang
--This is an automated reply.-- The person to whom to your email was addressed is no longer with MAXIMUM Communications INC. Unfortunately, due to spam control, we do NOT monitor this email address and have not received your request. If you do intend to send an email to MAXIMUM Communications INC or are a customer of MAXIMUM Communications INC , please initiate an email addressed to Service at maximumcallcenter.com. Thank you very much, MAXIMUM Communications INC ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users
Re: [lxc-users] lxc stop / lxc reboot hang
--This is an automated reply.-- The person to whom to your email was addressed is no longer with MAXIMUM Communications INC. Unfortunately, due to spam control, we do NOT monitor this email address and have not received your request. If you do intend to send an email to MAXIMUM Communications INC or are a customer of MAXIMUM Communications INC , please initiate an email addressed to Service at maximumcallcenter.com. Thank you very much, MAXIMUM Communications INC ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users
[lxc-users] lxc stop / lxc reboot hang
Suddenly, today, I'm not able to stop or reboot any of containers: # lxc stop some-container Just sits there forever. In /var/log/lxd/lxd.log, only this single entry shows up: t=2017-02-03T03:46:20+ lvl=info msg="Shutting down container" creation date=2017-01-19T15:51:21+ ephemeral=false timeout=-1s name=some-container action=shutdown In /var/log/lxd/some-container/lxc.log, only this one shows up: lxc 20170203034624.534 WARN lxc_commands - commands.c:lxc_cmd_rsp_recv:172 - command get_cgroup failed to receive response Running these: ii lxd 2.0.8-0ubuntu1~ubuntu16.04.2 amd64Container hypervisor based on LXC - daemon ii lxd-client 2.0.8-0ubuntu1~ubuntu16.04.2 amd64Container hypervisor based on LXC - client ii liblxc1 2.0.6-0ubuntu1~ubuntu16.04.2 amd64Linux Containers userspace tools (library) ii lxc-common 2.0.6-0ubuntu1~ubuntu16.04.2 amd64Linux Containers userspace tools (common tools) ii lxcfs2.0.5-0ubuntu1~ubuntu16.04.1 amd64FUSE based filesystem for LXC # uname -a Linux lxd01 4.9.0-040900-generic #201612111631 SMP Sun Dec 11 21:33:00 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Any clues how to fix this? Tomasz Chmielewski https://lxadm.com ___ lxc-users mailing list lxc-users@lists.linuxcontainers.org http://lists.linuxcontainers.org/listinfo/lxc-users