Hmm - 73 zombies?! And systemd is in an uninterruptible sleep. It moreover has not accumulated any time since I first ran top, so I'd say it's still in the *same* uninterruptible sleep... for at least 14 minutes. Also, the number of zombies has been increasing, as of right now, it's 187. I don't have the ability to live debug this kernel, but I'm morally convinced that if we could trace the resource systemd is waiting on,
--- top - 08:34:16 up 3 days, 11:44, 2 users, load average: 10.00, 9.99, 8.69 Tasks: 472 total, 5 running, 280 sleeping, 0 stopped, 187 zombie %Cpu(s): 1.2 us, 0.4 sy, 0.1 ni, 98.1 id, 0.2 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem : 8140712 total, 1037684 free, 336272 used, 6766756 buff/cache KiB Swap: 7781712 total, 7495516 free, 286196 used. 7137692 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 2527 arlie 20 0 0 0 0 Z 106.7 0.0 60:36.87 compiz 1 root 20 0 120072 3980 2132 D 0.0 0.0 0:06.37 systemd 2 root 20 0 0 0 0 S 0.0 0.0 0:00.02 kthreadd --- And look at this, we have a defunct pager!! arlie@ansuz$ ps -Fa -p1 UID PID PPID C SZ RSS PSR STIME TTY TIME CMD root 1 0 0 30018 3980 3 Apr15 ? 00:00:06 /sbin/init splash arlie 24386 1 0 0 0 3 08:15 pts/2 00:00:00 [pager] <defunct> arlie 24859 24139 0 9342 3284 3 08:37 pts/2 00:00:00 ps -Fa -p1 -- I can't get the WCHAN for systemd out of ps. Sorry. -- arlie@ansuz$ ps -e -o pid,wchan=WIDE-WCHAN-COLUMN -o comm | head PID WIDE-WCHAN-COLUMN COMMAND 1 - systemd 2 - kthreadd 3 - ksoftirqd/0 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1680502 Title: Hang after upgrade to 16.04 Status in linux package in Ubuntu: Incomplete Status in linux source package in Xenial: Incomplete Bug description: Last week I upgraded from 12.04 LTS to 14.04 LTS and then immediately to 16.04 LTS. 12.04 was not entirely stable; something was crashing regularly, and the Ubuntu tools make it hard for a user to determine what. The upgrade went moderately well; I now get error messages during system startup (about an unnamed file not being found) and a couple of other bits of flakiness, but I counted it as a success and the system as functional. This morning I tried to wake up my screen, and nothing much happened. I then attempted to ssh to the ubuntu box from another system. This requested my password almost instantly, as normal - but then nothing else happened, and the connection eventually dropped. I conclude that IP and TCP are functional, and it's possible for some processes to respond, but not many. So it's not a complete kernel hang. (In particular, I'm seeing evidence that it's getting beyond things done at interrupt level.) I don't have any debugging aids installed, so I don't believe I can get a kernel crash dump, which is what I'd want if I were debugging this. I *can* potentially retrieve and attach logs, but you'll have to tell me which ones are relevant, and do so before they rollover. (Also, logging will have to be functioning; IIRC, there were syslog issues in 12.04, and while I'd implemented whatever fix was reccommended at the time, I haven't looked at my logs since the upgrade.) This is a desk top system originally from System 76 - i.e. built for linux - that's also running a bunch of server software (postfix, apache, ...) I was not (knowingly) running anythign unusual at the time - probably Unity, a few shells, firefox, maybe guncash and/or emacs - and all the usual demons. IIRC, I was not at the very latest versions of all software installed - some new versions ahd come out since I upgraded, and I was going to deal with installing them on the weekend. I'm going to hard reboot the system now. I can then gather identifying info. If I have time this AM before work, I'll check for standard things you want in all bugs, and add them. (Right now I'm posting from my Mac laptop ;-)) --- ApportVersion: 2.20.1-0ubuntu2.5 Architecture: amd64 AudioDevicesInUse: USER PID ACCESS COMMAND /dev/snd/controlC1: arlie 2507 F.... pulseaudio /dev/snd/controlC0: arlie 2507 F.... pulseaudio CurrentDesktop: Unity DistroRelease: Ubuntu 16.04 HibernationDevice: RESUME=UUID=e206b01d-6cec-4b56-b469-25b106536f09 InstallationDate: Installed on 2012-04-26 (1811 days ago) InstallationMedia: Ubuntu 12.04 LTS "Precise Pangolin" - Release amd64 (20120425) MachineType: System76, Inc. Wild Dog Performance NonfreeKernelModules: nvidia Package: linux (not installed) ProcFB: ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-72-generic root=UUID=96551326-e461-4071-ab9c-0e81ad7015d7 ro quiet splash ProcVersionSignature: Ubuntu 4.4.0-72.93-generic 4.4.49 RelatedPackageVersions: linux-restricted-modules-4.4.0-72-generic N/A linux-backports-modules-4.4.0-72-generic N/A linux-firmware 1.157.8 RfKill: 0: phy0: Wireless LAN Soft blocked: yes Hard blocked: no Tags: xenial Uname: Linux 4.4.0-72-generic x86_64 UpgradeStatus: Upgraded to xenial on 2017-03-31 (11 days ago) UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo _MarkForUpload: True dmi.bios.date: 02/24/2012 dmi.bios.vendor: Intel Corp. dmi.bios.version: KCH7710H.86A.0069.2012.0224.1825 dmi.board.name: DH77KC dmi.board.vendor: Intel Corporation dmi.board.version: AAG39641-400 dmi.chassis.type: 3 dmi.chassis.vendor: System76, Inc. dmi.chassis.version: WilP9 dmi.modalias: dmi:bvnIntelCorp.:bvrKCH7710H.86A.0069.2012.0224.1825:bd02/24/2012:svnSystem76,Inc.:pnWildDogPerformance:pvrwilp9:rvnIntelCorporation:rnDH77KC:rvrAAG39641-400:cvnSystem76,Inc.:ct3:cvrWilP9: dmi.product.name: Wild Dog Performance dmi.product.version: wilp9 dmi.sys.vendor: System76, Inc. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1680502/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp