Re: [Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Raring is EOL since January 27: https://wiki.ubuntu.com/Releases Excerpts from Alessandro Moscatelli's message of 2014-06-12 22:23:52 UTC: > It looks I have this problem with Ubuntu Raring > kernel version : 3.8.13 > > I attached a screenshot with dmesg after I tried to start again my > containers. > > Should I open a new bug ? > > Thank you in advance > > > ** Attachment added: "screenshot" > > https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+attachment/4130637/+files/5.png > > -- > You received this bug notification because you are subscribed to the bug > report. > https://bugs.launchpad.net/bugs/1021471 > > Title: > clone() hang when creating new network namespace (dmesg show > unregister_netdevice: waiting for lo to become free. Usage count = 2) > > Status in The Linux Kernel: > Confirmed > Status in “linux” package in Ubuntu: > Fix Released > Status in “linux” source package in Precise: > Fix Released > Status in “linux” source package in Quantal: > Fix Released > > Bug description: > SRU Justification: > > Impact: > When creating new network namespace dmesg can show the following > unregister_netdevice: waiting for lo to become free. Usage count = 1 > > Fix: > Stefan Bader's SAUCE patch has fixed this for Quantal: > UBUNTU: SAUCE: net/ipv4: Always flush route cache on unregister batch > call > > Testcase: > The sourcecode found here: > https://lists.debian.org/debian-kernel/2012/05/msg00494.html > can be compiled and run as follows: > > sudo ./reproducer > #ctrl+c > sudo ./reproducer > #wait for a while > dmesg | grep unregister > > > -- > > I'm not sure how I triggered this. I've been moving around between > networks and suspending/resuming all day. > > Earlier in this boot I successfully used a container (start, > networking and stop). I came to start the same one later and noticed > that it didn't come up. Trying to attach to the console with lxc- > console informed me that it wasn't running. I then saw suspicious > content in dmesg: > > [25800.412234] INFO: task lxc-start:25817 blocked for more than 120 seconds. > [25800.412243] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables > this message. > [25800.412254] lxc-start D 88013fd13980 0 25817 1 > 0x > [25800.412266] 880007b43cc0 0086 88003ba4c500 > 880007b43fd8 > [25800.412275] 880007b43fd8 880007b43fd8 880134c65c00 > 88003ba4c500 > [25800.412284] 80d0 81ca7c00 88003ba4c500 > 81ca7c04 > [25800.412288] Call Trace: > [25800.412306] [] schedule+0x29/0x70 > [25800.412313] [] schedule_preempt_disabled+0xe/0x10 > [25800.412323] [] __mutex_lock_slowpath+0xd7/0x150 > [25800.412331] [] mutex_lock+0x2a/0x50 > [25800.412340] [] copy_net_ns+0x71/0x100 > [25800.412350] [] create_new_namespaces+0xdb/0x190 > [25800.412357] [] copy_namespaces+0x8c/0xd0 > [25800.412367] [] copy_process.part.22+0x902/0x1520 > [25800.412375] [] do_fork+0x135/0x390 > [25800.412385] [] ? kmem_cache_free+0x20/0x100 > [25800.412395] [] ? putname+0x33/0x50 > [25800.412402] [] ? do_sys_open+0x16c/0x200 > [25800.412410] [] sys_clone+0x28/0x30 > [25800.412418] [] stub_clone+0x13/0x20 > [25800.412424] [] ? system_call_fastpath+0x16/0x1b > [25806.312385] unregister_netdevice: waiting for lo to become free. Usage > count = 1 > > ProblemType: Bug > DistroRelease: Ubuntu 12.10 > Package: linux-image-generic 3.5.0.3.3 > ProcVersionSignature: Ubuntu 3.5.0-2.2-generic 3.5.0-rc4 > Uname: Linux 3.5.0-2-generic x86_64 > NonfreeKernelModules: nvidia wl > AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.25. > ApportVersion: 2.2.5-0ubuntu2 > Architecture: amd64 > ArecordDevices: > List of CAPTURE Hardware Devices > card 0: NVidia [HDA NVidia], device 0: Cirrus Analog [Cirrus Analog] > Subdevices: 1/1 > Subdevice #0: subdevice #0 > AudioDevicesInUse: > USER PID ACCESS COMMAND > /dev/snd/controlC0: laney 2787 F pulseaudio > CRDA: Error: command ['iw', 'reg', 'get'] failed with exit code 1: nl80211 > not found. > Card0.Amixer.info: > Card hw:0 'NVidia'/'HDA NVidia at 0xd348 irq 22' > Mixer name: 'Nvidia MCP89 HDMI' > Components: 'HDA:10134206,106b0d00,00100301 > HDA:10de000c,10de0101,00100200' > Controls : 37 > Simple ctrls : 13 > Date: Thu Jul 5 21:26:08 2012 > HibernationDevice: RESUME=UUID=1c5b3f2c-2c89-4fa1-9ed8-0e238de8fe47 > InstallationMedia: Ubuntu 10.04.1 LTS "Lucid Lynx" - Release amd64 > (20100729) > MachineType: Apple Inc. MacBookPro7,1 > ProcFB: 0 VESA VGA > ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.5.0-2-generic > root=UUID=2228fdfe-3834-40b2-b7b4-efea7463e3c1 ro quiet splash reboot=pci > vt.handoff=7 > RelatedPackageVersi
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
It looks I have this problem with Ubuntu Raring kernel version : 3.8.13 I attached a screenshot with dmesg after I tried to start again my containers. Should I open a new bug ? Thank you in advance ** Attachment added: "screenshot" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+attachment/4130637/+files/5.png -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
This bug was fixed in the package linux - 3.2.0-63.95 --- linux (3.2.0-63.95) precise; urgency=low [ Kamal Mostafa ] * Revert "rtlwifi: Set the link state" - LP: #1319735 * Release Tracking Bug - re-used previous tracking bug linux (3.2.0-63.94) precise; urgency=low [ Kamal Mostafa ] * Merged back Ubuntu-3.2.0-61.93 security release * Revert "n_tty: Fix n_tty_write crash when echoing in raw mode" - LP: #1314762 * Release Tracking Bug - LP: #1316703 [ Stefan Bader ] * SAUCE: net/ipv4: Always flush route cache on unregister batch call - LP: #1021471 [ Upstream Kernel Changes ] * ipv6: don't set DST_NOCOUNT for remotely added routes - LP: #1293726 - CVE-2014-2309 * vhost: fix total length when packets are too short - LP: #1312984 - CVE-2014-0077 * n_tty: Fix n_tty_write crash when echoing in raw mode - LP: #1314762 - CVE-2014-0196 * floppy: ignore kernel-only members in FDRAWCMD ioctl input - LP: #1316729 - CVE-2014-1737 * floppy: don't write kernel-only members to FDRAWCMD ioctl output - LP: #1316735 - CVE-2014-1738 linux (3.2.0-62.93) precise; urgency=low [ Joseph Salisbury ] * Release Tracking Bug - LP: #1313807 [ Joseph Salisbury ] * [Config] updateconfigs after Linux v3.2.57 update [ Upstream Kernel Changes ] * rds: prevent dereference of a NULL device in rds_iw_laddr_check - LP: #130 - CVE-2014-2678 * rtlwifi: Set the link state - LP: #1310763 * rtlwifi: rtl8192cu: Fix some code in RF handling - LP: #1310763 * NFSv4: OPEN must handle the NFS4ERR_IO return code correctly - LP: #1310763 * selinux: process labeled IPsec TCP SYN-ACK packets properly in selinux_ip_postroute() - LP: #1310763 * parport: parport_pc: remove double PCI ID for NetMos - LP: #1310763 * staging: vt6656: [BUG] BBvUpdatePreEDThreshold Always set sensitivity on bScanning - LP: #1310763 * bfa: Chinook quad port 16G FC HBA claim issue - LP: #1310763 * usb: option: add new zte 3g modem pids to option driver - LP: #1310763 * dib8000: make 32 bits read atomic - LP: #1310763 * serial: add support for 400 and 800 v3 series Titan cards - LP: #1310763 * serial: add support for 200 v3 series Titan card - LP: #1310763 * x86/efi: Fix off-by-one bug in EFI Boot Services reservation - LP: #1310763 * rtc-cmos: Add an alarm disable quirk - LP: #1310763 * slub: Fix calculation of cpu slabs - LP: #1310763 * mtd: mxc_nand: remove duplicated ecc_stats counting - LP: #1310763 * USB: pl2303: fix data corruption on termios updates - LP: #1310763 * USB: serial: add support for iBall 3.5G connect usb modem - LP: #1310763 * USB: Nokia 502 is an unusual device - LP: #1310763 * USB: cypress_m8: fix ring-indicator detection and reporting - LP: #1310763 * ALSA: rme9652: fix a missing comma in channel_map_9636_ds[] - LP: #1310763 * sunrpc: Fix infinite loop in RPC state machine - LP: #1310763 * SELinux: Fix memory leak upon loading policy - LP: #1310763 * drm/radeon: warn users when hw_i2c is enabled (v2) - LP: #1310763 * USB: ftdi_sio: added CS5 quirk for broken smartcard readers - LP: #1310763 * serial: 8250: enable UART_BUG_NOMSR for Tegra - LP: #1310763 * dm: wait until embedded kobject is released before destroying a device - LP: #1310763 * dm space map common: make sure new space is used during extend - LP: #1310763 * ASoC: adau1701: Fix ADAU1701_SEROCTL_WORD_LEN_16 constant - LP: #1310763 * radeon/pm: Guard access to rdev->pm.power_state array - LP: #1310763 * staging: r8712u: Set device type to wlan - LP: #1310763 * ALSA: Enable CONFIG_ZONE_DMA for smaller PCI DMA masks - LP: #1310763 * staging:iio:ad799x fix error_free_irq which was freeing an irq that may not have been requested - LP: #1310763 * mmc: atmel-mci: fix timeout errors in SDIO mode when using DMA - LP: #1310763 * ftrace: Use schedule_on_each_cpu() as a heavy synchronize_sched() - LP: #1310763 * ftrace: Fix synchronization location disabling and freeing ftrace_ops - LP: #1310763 * rtlwifi: rtl8192cu: Add new device ID - LP: #1310763 * nfs4.1: properly handle ENOTSUP in SECINFO_NO_NAME - LP: #1310763 * usb: ehci: add freescale imx28 special write register method - LP: #1310763 * dm sysfs: fix a module unload race - LP: #1310763 * KVM: x86: limit PIT timer frequency - LP: #1310763 * md/raid5: fix long-standing problem with bitmap handling on write failure. - LP: #1310763 * x86: Add check for number of available vectors before CPU down - LP: #1310763 * libata: disable LPM for some WD SATA-I devices - LP: #1310763 * mmc: sdhci: fix lockdep error in tuning routine - LP: #1310763 * turbostat: Use GCC's CPUID functions to support PIC - LP: #1310763 * drm/radeon: disable ss on D
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
This bug was fixed in the package linux - 3.2.0-63.95 --- linux (3.2.0-63.95) precise; urgency=low [ Kamal Mostafa ] * Revert "rtlwifi: Set the link state" - LP: #1319735 * Release Tracking Bug - re-used previous tracking bug linux (3.2.0-63.94) precise; urgency=low [ Kamal Mostafa ] * Merged back Ubuntu-3.2.0-61.93 security release * Revert "n_tty: Fix n_tty_write crash when echoing in raw mode" - LP: #1314762 * Release Tracking Bug - LP: #1316703 [ Stefan Bader ] * SAUCE: net/ipv4: Always flush route cache on unregister batch call - LP: #1021471 [ Upstream Kernel Changes ] * ipv6: don't set DST_NOCOUNT for remotely added routes - LP: #1293726 - CVE-2014-2309 * vhost: fix total length when packets are too short - LP: #1312984 - CVE-2014-0077 * n_tty: Fix n_tty_write crash when echoing in raw mode - LP: #1314762 - CVE-2014-0196 * floppy: ignore kernel-only members in FDRAWCMD ioctl input - LP: #1316729 - CVE-2014-1737 * floppy: don't write kernel-only members to FDRAWCMD ioctl output - LP: #1316735 - CVE-2014-1738 linux (3.2.0-62.93) precise; urgency=low [ Joseph Salisbury ] * Release Tracking Bug - LP: #1313807 [ Joseph Salisbury ] * [Config] updateconfigs after Linux v3.2.57 update [ Upstream Kernel Changes ] * rds: prevent dereference of a NULL device in rds_iw_laddr_check - LP: #130 - CVE-2014-2678 * rtlwifi: Set the link state - LP: #1310763 * rtlwifi: rtl8192cu: Fix some code in RF handling - LP: #1310763 * NFSv4: OPEN must handle the NFS4ERR_IO return code correctly - LP: #1310763 * selinux: process labeled IPsec TCP SYN-ACK packets properly in selinux_ip_postroute() - LP: #1310763 * parport: parport_pc: remove double PCI ID for NetMos - LP: #1310763 * staging: vt6656: [BUG] BBvUpdatePreEDThreshold Always set sensitivity on bScanning - LP: #1310763 * bfa: Chinook quad port 16G FC HBA claim issue - LP: #1310763 * usb: option: add new zte 3g modem pids to option driver - LP: #1310763 * dib8000: make 32 bits read atomic - LP: #1310763 * serial: add support for 400 and 800 v3 series Titan cards - LP: #1310763 * serial: add support for 200 v3 series Titan card - LP: #1310763 * x86/efi: Fix off-by-one bug in EFI Boot Services reservation - LP: #1310763 * rtc-cmos: Add an alarm disable quirk - LP: #1310763 * slub: Fix calculation of cpu slabs - LP: #1310763 * mtd: mxc_nand: remove duplicated ecc_stats counting - LP: #1310763 * USB: pl2303: fix data corruption on termios updates - LP: #1310763 * USB: serial: add support for iBall 3.5G connect usb modem - LP: #1310763 * USB: Nokia 502 is an unusual device - LP: #1310763 * USB: cypress_m8: fix ring-indicator detection and reporting - LP: #1310763 * ALSA: rme9652: fix a missing comma in channel_map_9636_ds[] - LP: #1310763 * sunrpc: Fix infinite loop in RPC state machine - LP: #1310763 * SELinux: Fix memory leak upon loading policy - LP: #1310763 * drm/radeon: warn users when hw_i2c is enabled (v2) - LP: #1310763 * USB: ftdi_sio: added CS5 quirk for broken smartcard readers - LP: #1310763 * serial: 8250: enable UART_BUG_NOMSR for Tegra - LP: #1310763 * dm: wait until embedded kobject is released before destroying a device - LP: #1310763 * dm space map common: make sure new space is used during extend - LP: #1310763 * ASoC: adau1701: Fix ADAU1701_SEROCTL_WORD_LEN_16 constant - LP: #1310763 * radeon/pm: Guard access to rdev->pm.power_state array - LP: #1310763 * staging: r8712u: Set device type to wlan - LP: #1310763 * ALSA: Enable CONFIG_ZONE_DMA for smaller PCI DMA masks - LP: #1310763 * staging:iio:ad799x fix error_free_irq which was freeing an irq that may not have been requested - LP: #1310763 * mmc: atmel-mci: fix timeout errors in SDIO mode when using DMA - LP: #1310763 * ftrace: Use schedule_on_each_cpu() as a heavy synchronize_sched() - LP: #1310763 * ftrace: Fix synchronization location disabling and freeing ftrace_ops - LP: #1310763 * rtlwifi: rtl8192cu: Add new device ID - LP: #1310763 * nfs4.1: properly handle ENOTSUP in SECINFO_NO_NAME - LP: #1310763 * usb: ehci: add freescale imx28 special write register method - LP: #1310763 * dm sysfs: fix a module unload race - LP: #1310763 * KVM: x86: limit PIT timer frequency - LP: #1310763 * md/raid5: fix long-standing problem with bitmap handling on write failure. - LP: #1310763 * x86: Add check for number of available vectors before CPU down - LP: #1310763 * libata: disable LPM for some WD SATA-I devices - LP: #1310763 * mmc: sdhci: fix lockdep error in tuning routine - LP: #1310763 * turbostat: Use GCC's CPUID functions to support PIC - LP: #1310763 * drm/radeon: disable ss on D
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Verified on 3.2.0-63-virtual. ** Tags removed: verification-needed-precise ** Tags added: verification-done-precise -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed- precise' to 'verification-done-precise'. If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you! ** Tags added: verification-needed-precise -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Changed in: linux (Ubuntu Precise) Status: In Progress => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Description changed: + SRU Justification: + + Impact: + When creating new network namespace dmesg can show the following : unregister_netdevice: waiting for lo to become free. Usage count = 1 + + Fix: + Stefan Bader's SAUCE patch has fixed this for Quantal: UBUNTU: SAUCE: net/ipv4: Always flush route cache on unregister batch call + + Testcase: + The sourcecode found here: https://lists.debian.org/debian-kernel/2012/05/msg00494.html can be compiled and run as follows: + - sudo ./reproducer + - ctrl+c + - sudo ./reproducer + wait for a while + - dmesg | grep unregister + + -- + I'm not sure how I triggered this. I've been moving around between networks and suspending/resuming all day. Earlier in this boot I successfully used a container (start, networking and stop). I came to start the same one later and noticed that it didn't come up. Trying to attach to the console with lxc-console informed me that it wasn't running. I then saw suspicious content in dmesg: [25800.412234] INFO: task lxc-start:25817 blocked for more than 120 seconds. [25800.412243] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [25800.412254] lxc-start D 88013fd13980 0 25817 1 0x [25800.412266] 880007b43cc0 0086 88003ba4c500 880007b43fd8 [25800.412275] 880007b43fd8 880007b43fd8 880134c65c00 88003ba4c500 [25800.412284] 80d0 81ca7c00 88003ba4c500 81ca7c04 [25800.412288] Call Trace: [25800.412306] [] schedule+0x29/0x70 [25800.412313] [] schedule_preempt_disabled+0xe/0x10 [25800.412323] [] __mutex_lock_slowpath+0xd7/0x150 [25800.412331] [] mutex_lock+0x2a/0x50 [25800.412340] [] copy_net_ns+0x71/0x100 [25800.412350] [] create_new_namespaces+0xdb/0x190 [25800.412357] [] copy_namespaces+0x8c/0xd0 [25800.412367] [] copy_process.part.22+0x902/0x1520 [25800.412375] [] do_fork+0x135/0x390 [25800.412385] [] ? kmem_cache_free+0x20/0x100 [25800.412395] [] ? putname+0x33/0x50 [25800.412402] [] ? do_sys_open+0x16c/0x200 [25800.412410] [] sys_clone+0x28/0x30 [25800.412418] [] stub_clone+0x13/0x20 [25800.412424] [] ? system_call_fastpath+0x16/0x1b [25806.312385] unregister_netdevice: waiting for lo to become free. Usage count = 1 ProblemType: Bug DistroRelease: Ubuntu 12.10 Package: linux-image-generic 3.5.0.3.3 ProcVersionSignature: Ubuntu 3.5.0-2.2-generic 3.5.0-rc4 Uname: Linux 3.5.0-2-generic x86_64 NonfreeKernelModules: nvidia wl AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.25. ApportVersion: 2.2.5-0ubuntu2 Architecture: amd64 ArecordDevices: - List of CAPTURE Hardware Devices - card 0: NVidia [HDA NVidia], device 0: Cirrus Analog [Cirrus Analog] -Subdevices: 1/1 -Subdevice #0: subdevice #0 + List of CAPTURE Hardware Devices + card 0: NVidia [HDA NVidia], device 0: Cirrus Analog [Cirrus Analog] + Subdevices: 1/1 + Subdevice #0: subdevice #0 AudioDevicesInUse: - USER PID ACCESS COMMAND - /dev/snd/controlC0: laney 2787 F pulseaudio + USER PID ACCESS COMMAND + /dev/snd/controlC0: laney 2787 F pulseaudio CRDA: Error: command ['iw', 'reg', 'get'] failed with exit code 1: nl80211 not found. Card0.Amixer.info: - Card hw:0 'NVidia'/'HDA NVidia at 0xd348 irq 22' -Mixer name : 'Nvidia MCP89 HDMI' -Components : 'HDA:10134206,106b0d00,00100301 HDA:10de000c,10de0101,00100200' -Controls : 37 -Simple ctrls : 13 + Card hw:0 'NVidia'/'HDA NVidia at 0xd348 irq 22' + Mixer name : 'Nvidia MCP89 HDMI' + Components : 'HDA:10134206,106b0d00,00100301 HDA:10de000c,10de0101,00100200' + Controls : 37 + Simple ctrls : 13 Date: Thu Jul 5 21:26:08 2012 HibernationDevice: RESUME=UUID=1c5b3f2c-2c89-4fa1-9ed8-0e238de8fe47 InstallationMedia: Ubuntu 10.04.1 LTS "Lucid Lynx" - Release amd64 (20100729) MachineType: Apple Inc. MacBookPro7,1 ProcFB: 0 VESA VGA ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.5.0-2-generic root=UUID=2228fdfe-3834-40b2-b7b4-efea7463e3c1 ro quiet splash reboot=pci vt.handoff=7 RelatedPackageVersions: - linux-restricted-modules-3.5.0-2-generic N/A - linux-backports-modules-3.5.0-2-generic N/A - linux-firmware 1.82 + linux-restricted-modules-3.5.0-2-generic N/A + linux-backports-modules-3.5.0-2-generic N/A + linux-firmware 1.82 SourcePackage: linux UpgradeStatus: Upgraded to quantal on 2012-01-13 (173 days ago) dmi.bios.date: 03/25/10 dmi.bios.vendor: Apple Inc. dmi.bios.version: MBP71.88Z.0039.B05.1003251322 dmi.board.name: Mac-F222BEC8 dmi.board.vendor: Apple Inc. dmi.chassis.type: 10 dmi.chassis.vendor: Apple Inc. dmi.chassis.version: Mac-F222BEC8 dmi.modalias: dmi:bvnAppleInc.:bvrMBP71.88Z.0039.B05.1003251322:bd03/25/10:svnAppleInc.:pnMacBookPro7,1:pvr
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Also affects: linux (Ubuntu Precise) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Precise) Assignee: (unassigned) => Chris J Arges (arges) ** Changed in: linux (Ubuntu Precise) Importance: Undecided => Medium ** Changed in: linux (Ubuntu Precise) Status: New => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
I guess, yes: the other bug causing refcount leaks: bug #1065434. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
I'm running 3.5.0-19-generic (3.5.0-19.30) and I still get this bug. Am I missing something? zoolook@venkman:~$ apt-cache policy linux-image-extra-3.5.0-19-generic linux-image-extra-3.5.0-19-generic: Instalados: 3.5.0-19.30 Candidato: 3.5.0-19.30 Tabla de versión: *** 3.5.0-19.30 0 500 http://archive.ubuntu.com/ubuntu/ quantal-proposed/main amd64 Packages 100 /var/lib/dpkg/status -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Branch linked: lp:~ubuntu-branches/ubuntu/precise/linux-lts-quantal /precise-proposed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
This bug was fixed in the package linux - 3.5.0-17.28 --- linux (3.5.0-17.28) quantal-proposed; urgency=low [ Andy Whitcroft ] * [packaging] we already have a valid src_pkg_name * [packaging] allow us to select which builds have uefi signed versions [ James M Leddy ] * SAUCE: input: fix weird issue of synaptics psmouse sync lost after resume - LP: #717970 [ Paolo Pisati ] * SAUCE: omap3 clocks .dev_id = NULL - LP: #1061599 * [Config] omap: disable USB_[EHCI|OHCI]_HCD_PLATFORM - LP: #1061599 * [Config] omap: enforce USB_[EHCI|OHCI]_HCD_PLATFORM=n - LP: #1061599 [ Stefan Bader ] * SAUCE: net/ipv4: Always flush route cache on unregister batch call - LP: #1021471 [ Upstream Kernel Changes ] * Bluetooth: Add USB_VENDOR_AND_INTERFACE_INFO() for Broadcom/Foxconn - LP: #1030233 [ Wen-chien Jesse Sung ] * SAUCE: Bluetooth: Remove rules for matching Broadcom vendor specific IDs - LP: #1030233 -- Leann OgasawaraTue, 09 Oct 2012 11:23:41 -0700 ** Changed in: linux (Ubuntu Quantal) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Branch linked: lp:ubuntu/quantal-proposed/linux-ti-omap4 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Branch linked: lp:ubuntu/quantal-proposed/linux-lowlatency -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Tags removed: kernel-key -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Ok, it is probably obvious that we went ahead and applied at least the patch to the first half. Clint, probably we/you should open a second report for the remaining issue to have things cleanly separated. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Changed in: linux (Ubuntu Quantal) Status: Triaged => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Further information, this appears to be related to the wl proprietary drivers. When I tried on my MacBookPro with wired network, the problem did not surface, but upon switching to wireless, the problem did surface. This suggests that the real problem lies somewhere in the wl driver. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Ok, I think I'm ready to say that there are really just two bugs. One is about the route cache, and is addressed by smb's most recent patch. The other one seems only to affect my macbookair. I have not been able to get the repro.sh script to reproduce the problem on any other machines with that kernel or a 3.6 kernel installed. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
ok I can reproduce with just this shell script. The weird thing is, it only reproduces if I watch the log and kill the container after it fully boots. cloud init will report that it is done booting like this: cloud-init boot finished at Fri, 05 Oct 2012 20:15:32 +. Up 200.15 seconds if you run the script, and wait until you see that message, then press enter, which triggers stop/destroy, the bug will reproduce on 3.6.0 upstream kernel [1] as well as quantal's [1] http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.6-quantal/ ** Attachment added: "repro.sh" https://bugs.launchpad.net/ubuntu/quantal/+source/linux/+bug/1021471/+attachment/3377289/+files/repro.sh -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Certainly something is very wrong with the numbers. Looking at the numbers reported we get 5/13/-17/0 which sums up to 1 which is exactly the refcount complained about. But looking at the individual numbers, the counter for CPU#0 starts with 5 not 0. And just adding up the dev_hold and dev_put calls I underrun down to -4. So it looks a bit like some magic suddenly warps the counter and we release more often than we appear to take the reference and still end up one too high. It is a bit too late to think about it but maybe loopback gets assigned elements from another interface and that count is off by one. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
The full environments.yaml, btw, should be environments: local: type: local control-bucket: puppies-kittens-goblins admin-secret: abcdefghijklmnop0987654321 data-dir: /tmp/juju-data default-series: precise juju-origin: lp:~clint-fewbar/juju/local-cloud-img -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Attaching syslog for latest fail. BTW, the way I'm reproducing this is with a branch of juju that I've been working on: You'll need this in ~/.juju/environments.yaml: local: type: local control-bucket: puppies-kittens-goblins admin-secret: abcdefghijklmnop0987654321 data-dir: /tmp/juju-data default-series: precise juju-origin: lp:~clint-fewbar/juju/local-cloud-img mkdir /tmp/juju-data bzr branch lp:~clint-fewbar/juju/local-cloud-img cd local-cloud-img export PYTHONPATH=$PWD export PATH=$PWD/bin:$PATH juju bootstrap -e local juju deploy wordpress -e local # wait for the wordpress service to have 'agent-state: started' watch juju status juju destroy-environment -e local # unregister_netdevice messages now start spitting out on dmesg ** Attachment added: "syslog-17.26+smb2.log.gz" https://bugs.launchpad.net/ubuntu/quantal/+source/linux/+bug/1021471/+attachment/3376671/+files/syslog-17.26%2Bsmb2.log.gz -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Clint, could you please write down exactly which steps you do to reproduce the issue that leads to the single reference remaining? Which arguments to lxc-create/-start/-stop? Any special network setup? I think that with the last patch I made we fixed one issue, though that (while easier to reproduce) is not the same as the case which leaves one reference and does not resolve itself over time. Now the other question is whether it will be possible to fix the other issue in time and on the other side whether adding the fix we already have on last minute, even though it does not completely fix things. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Changed in: linux (Ubuntu Quantal) Milestone: ubuntu-12.10-beta-2 => ubuntu-12.10 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Here is a syslog of the latest failure with the "#26+smb1" kernel showing refcount only stuck at 1, instead of 2 ** Attachment added: "syslog-with-#26-smb1.txt.gz" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+attachment/3372792/+files/syslog-with-%2326-smb1.txt.gz -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Changed in: linux Status: Unknown => Confirmed ** Changed in: linux Importance: Unknown => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Another step towards solving this. After it turned out in the upstream discussions that actually the route cache should be flushed when unregistering by doing the NETDEV_UNREGISTER_BATCH notify call, I could check to find out that this fails because the notify handler checks for dereferenced pointer that is not only not set but also not really necessary. Moving the handler around a bit should actually fix this. ** Patch added: "Iteration step 3" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+attachment/3371401/+files/0001-net-ipv4-Always-flush-route-cache-on-unregister-batc.patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
When looking at the patch uploaded I realized something went wrong on the update. Re-attaching. ** Patch added: "0001-UBUNTU-SAUCE-net-flush-rt-cache-on-unregister.patch" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+attachment/3365724/+files/0001-UBUNTU-SAUCE-net-flush-rt-cache-on-unregister.patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
This second attempt goes the path of forcing the route cache to be cleaned of entries belonging to a net device that is torn down. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
It seems that after about 5 minutes the references really get cleaned up without any change (so the question would be why that takes so long... [ 44.099279] lo(88003cc3c000)[0]+= 1 [ 44.099337] lo(88003cc3c000)[0]+= 2 [ 44.099344] lo(88003cc3c000)[0]+= 3 [ 44.099358] lo(88003cc3c000)[0]+= 4 [ 44.099364] lo(88003cc3c000)[0]+= 5 [ 44.099416] lo(88003cc3c000)[0]+= 6 [ 44.099422] lo(88003cc3c000)[0]+= 7 [ 44.099580] lo(88003cc3c000)[0]+= 8 [ 44.099596] lo(88003cc3c000)[0]+= 9 [ 46.728441] lo(88003cc3c000)[1] -= -1 [ 46.728556] lo(88003cc3c000)[1] -= -2 [ 46.728565] lo(88003cc3c000)[1] -= -3 [ 46.729266] lo(88003cc3c000)[1] -= -4 [ 46.729313] lo(88003cc3c000)[1] -= -5 [ 46.729975] lo(88003cc3c000)[1] -= -6 [ 46.732279] lo(88003cc3c000)[1] -= -7 [ 338.896671] lo(88003cc3c000)[0] -= 8 [ 338.896677] lo(88003cc3c000)[0] -= 7 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
As testing with lxc containers showed, the clever idea does not work there because that is a case where there is at least one of the addresses (actually it seems both) is set. So it more and more looks like the real problem is that whenever the namespace is to be torn down, there is nothing enforcing to immediately evicting and releasing elements in the route cache that belong to the interfaces in that namespace. One observation I made while fiddling around with this a bit more. Running the test program, then abort it with ctrl-c starts the messages about lo having a refcount of 2. Trying to start the same test will hang on the first listen. That would indicate that something that still hold some required lock or mutex is still running (the tear down has not finished). This will end after a longer time (I have not measured but process blocked is triggered at least once). And after that time the test programs connect will work again. That could mean two things: 1. Cleanup did finally succeed 2. Cleanup was aborted, we leak the bits in the route cache but at least new net namespaces are possible. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Tags added: patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
This is an experimental change that at least avoids the problem when running the test case. But while I saw no immediate problem, it isn't guaranteed to have no side effects and neither I can be sure there is not another case (only either source address or destination address not set) that would still suffer from the problem. I added the same patch to the upstream bug report in the hope that this causes someone there to help with some information. ** Patch added: "0001-UBUNTU-net-ipv4-Do-not-create-routes-with-daddr-sadd.patch" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+attachment/3361444/+files/0001-UBUNTU-net-ipv4-Do-not-create-routes-with-daddr-sadd.patch -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
I guess I am at the limits of my knowledge. So far it looks like ip_connect_route initially calls __ip_route_output_key to fill in source and destination address. And this seems to cause a routing cache entry to be created with source and destination address 0. It could be wrong to cache that or to create it with 0 addresses or both... I added all that info to the upstream bug in the hope of someone there knows details... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Repeating the comment in the upstream bug I just made: I added debugging to dev_hold and dev_put as Eric suggested and used the reproducer attached to this bug. What I saw was creation and destruction would be balanced. However on the connect call, there were another two dev_hold() calls that seem to be exactly those references not been returned. system_call_fastpath+0x1a/0x1f sys_connect+0xeb/0x110 inet_stream_connect+0x11c/0x310 tcp_v4_connect+0x13c/0x510 ip_route_connect+???/??? __ip_route_output_key+0x39a/0xb10 ip_route_output_slow __mkroute_output rt_dst_alloc+0x3e/0x40 dst_alloc+0xc5/0x1c0 +1 = 8 rt_set_nexthop.isra.45+0x131/0x2d0 ? rt_intern_hash+0x133/0x670 rt_bind_neighbour+0x1d/0x40 ipv4_neigh_lookup+0xe7/0x120 neigh_create+0x1bd/0x5d0 +9 Unfortunately the stack traces miss the details about going into ip_route_connect, but with more printks I know that ip_route_output_flow() is the one failing with -EINVAL. Comparing functions between 3.5 and current linux-HEAD I was not very successful in spotting the important difference. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Also affects: linux via http://bugzilla.kernel.org/show_bug.cgi?id=47181 Importance: Unknown Status: Unknown -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
Reassigning to Stefan. ** Changed in: linux (Ubuntu Quantal) Assignee: Bryan Wu (cooloney) => Stefan Bader (stefan-bader-canonical) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
I run into this bug daily, it severely cripples the juju local provider on quantal. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
>From Eric's reply, I found this issue is a little bit complex to backport some patches from 3.6-rc1, because from 3.5 to 3.6-rc1 some fundamental stuffs were changed. -- As I recall the routing cache was removed between 3.5 and 3.6-rc1 so there are some significant changes to the fundamentals. What to look for failure of dev_hold and dev_put to pair. The kernel configuration may play a role. I remember times when there was a small bug in ipv6 multicast routing with respect to this. So a more minimal configuration may not reproduce the problem. I would also assume that the different reproducers exercise different code paths so you are probably dealing with more than one bug, between the ubuntu and the debian bug trackers. I hope those hints help. -- But we won't use 3.6 kernel for our Quantal release. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
As Eric W. Biederman said in the bugzilla, 3.6-rc1 mainline version works. I've testing our Ubuntu mainline build like 3.6-rc1 and 3.6-rc5, which all work fine. But for 3.5.3 mainline build, this test failed. Our latest Quantal kernel is based on 3.5.3 kernel. So obviously this issue was fixed during 3.6-rc1, I'm going to do some investigation and backport those fixing patches. -Bryan -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
** Also affects: linux (Ubuntu Quantal) Importance: High Assignee: Bryan Wu (cooloney) Status: Triaged ** Changed in: linux (Ubuntu Quantal) Milestone: None => ubuntu-12.10-beta-2 ** Tags removed: rls-q-incoming -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
I filed an upstream kernel bug: https://bugzilla.kernel.org/show_bug.cgi?id=47181 ** Bug watch added: Linux Kernel Bug Tracker #47181 http://bugzilla.kernel.org/show_bug.cgi?id=47181 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1021471] Re: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2)
I update the bug title to better match what we're seeing. The oops from the description is indeed just a timeout from some user space task that's stuck on clone(). So it looks like there's something wrong either in the cleanup code when flushing a network namespace (when the last process in the namespace dies) or something wrong with the refcount. ** Summary changed: - stuck on mutex_lock creating a new network namespace when starting a container + clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1021471 Title: clone() hang when creating new network namespace (dmesg show unregister_netdevice: waiting for lo to become free. Usage count = 2) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1021471/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
