[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
*** This bug is a duplicate of bug 589034 *** https://bugs.launchpad.net/bugs/589034 Marking as a duplicate of https://bugs.launchpad.net/ltsp/+bug/589034 since the reporter reported that disabling nbd-proxy solves the problem for him. If, for other people, disabling nbd-proxy doesn't fix your problems, please file another bug. ** This bug has been marked a duplicate of bug 589034 nbd-proxy hangs the nbd-connection to server * You can subscribe to bug 589034 by following this link: https://bugs.launchpad.net/ltsp/+bug/589034/+subscribe -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/604314 Title: Kernel deadlock when running programs from aufs over squashfs -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
Hi, I'm running into the same problem almost daily on several SMP machines (24 cpus) with high load, requiring reboot, using Ubuntu 10.04 LTS. I was initially running with with stock kernel (2.6.32-28-generic) but switched to 2.6.35 to see if it would go away, with the same result. cat /proc/version Linux version 2.6.35-23-generic (buildd@allspice) (gcc version 4.4.3 (Ubuntu 4.4.3-4ubuntu5) ) #41~lucid1-Ubuntu SMP Thu Dec 2 22:27:43 UTC 2010 cat /proc/mounts rootfs / rootfs rw 0 0 none /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 none /proc proc rw,nosuid,nodev,noexec,relatime 0 0 none /dev devtmpfs rw,relatime,size=16466640k,nr_inodes=4116660,mode=755 0 0 none /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /cow tmpfs rw,relatime,mode=755 0 0 /dev/nbd0 /rofs squashfs ro,relatime 0 0 aufs / aufs rw,relatime,si=f440d5a54f83f64d 0 0 tmpfs /cow tmpfs rw,relatime,mode=755 0 0 none /sys/fs/fuse/connections fusectl rw,relatime 0 0 none /sys/kernel/debug debugfs rw,relatime 0 0 none /sys/kernel/security securityfs rw,relatime 0 0 none /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0 none /var/run tmpfs rw,nosuid,relatime,mode=755 0 0 none /var/lock tmpfs rw,nosuid,nodev,noexec,relatime 0 0 none /lib/init/rw tmpfs rw,nosuid,relatime,mode=755 0 0 tmpfs /tmp tmpfs rw,nosuid,nodev,relatime 0 0 server:/opt /opt nfs rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.10.0.10,mountvers=3,mountproto=tcp,addr=10.10.0.10 0 0 server:/storage /storage nfs rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.10.0.10,mountvers=3,mountproto=tcp,addr=10.10.0.10 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 See the attachment with the kern.log for one of the machines. ** Attachment added: "kernel log" https://bugs.launchpad.net/ubuntu/+source/ltsp/+bug/604314/+attachment/1827299/+files/ldn3-kern.log -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/604314 Title: Kernel deadlock when running programs from aufs over squashfs -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
We're experiencing this too, here's a report from the tech that builds our LTSP servers which includes the network equipment we're using. Applying the patch (disabling nbd-proxy) doesn't completely solve things for us. We had none of these problems on 9.04. === When 2 or more switches are between client and server a failure to boot occurs before launching LDM about %50 of the time. The frequency of the failure to boot is reduced by being connected to the server with only one intermediate switch but does not go away completely. The following bugs seem to reference the same problem and indicate that it is nbd-proxy that is falling down during the boot process. https://bugs.launchpad.net/ubuntu/+source/ltsp/+bug/604314 https://bugs.launchpad.net/ltsp/+bug/589034 The latter of these references a patch that when applied disables the activation of the nbd-proxy during the client setup process. My success rate for booting clients after applying this patch rises to about %70. Load seems to effect this condition adversely as well as speed and duplex transitions such as many 10/100 clients connecting to a server attached to a gigabit port. The clients in question are Atom based and include gigabit ethernet ports but are connected to 10/100 ports in the classroom. Switches being used include HP Pro-curve edge products as well as a variety of unmanaged 10/100 5-8 port switches. -- Kernel deadlock when running programs from aufs over squashfs https://bugs.launchpad.net/bugs/604314 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
>Update: >1) If I entirely disable nbd-proxy, and add the --persist option to >nbd-client, the problem goes away. >2) The problem also seems to arise only if the client has to go over a couple >of switches and routers to reach the server. Clients that are plugged into the >same switch as the server do not seem affected. I didn't try to disable nbd-proxy, and add the --persist option to nbd- client, but i switched to nfs+aufs on thin client. The situatuion is same. If thin client plugged into server's switch - it works perfectly, but in next switches thin client aren't boot. Nevertheless thin clients in same network topology (couple of switches) are boot perfectly with LTSP on ubuntu 9.10 and early. Problem appears only on LTSP of 10.04 (ku|edu|xu)buntu version. -- Kernel deadlock when running programs from aufs over squashfs https://bugs.launchpad.net/bugs/604314 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
Problem seems to be in userspace with nbd-proxy and nbd-client. ** Changed in: linux (Ubuntu) Status: Incomplete => Invalid -- Kernel deadlock when running programs from aufs over squashfs https://bugs.launchpad.net/bugs/604314 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
Hi Nikolaus, If you could also please test the latest upstream kernel available that would be great. It will allow additional upstream developers to examine the issue. Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Once you've tested the upstream kernel, please remove the 'needs-upstream-testing' tag. This can be done by clicking on the yellow pencil icon next to the tag located at the bottom of the bug description and deleting the 'needs-upstream-testing' text. Please let us know your results. Thanks in advance. [This is an automated message. Apologies if it has reached you inappropriately; please just reply to this message indicating so.] ** Tags added: needs-upstream-testing ** Tags added: kj-triage ** Changed in: linux (Ubuntu) Status: New => Incomplete -- Kernel deadlock when running programs from aufs over squashfs https://bugs.launchpad.net/bugs/604314 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 604314] Re: Kernel deadlock when running programs from aufs over squashfs
Update: 1) If I entirely disable nbd-proxy, and add the --persist option to nbd- client, the problem goes away. 2) The problem also seems to arise only if the client has to go over a couple of switches and routers to reach the server. Clients that are plugged into the same switch as the server do not seem affected. -- Kernel deadlock when running programs from aufs over squashfs https://bugs.launchpad.net/bugs/604314 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
