[Bug 1634519] Re: linux autopkgtest: eternal hang/ BUG: soft lockup
*** This bug is a duplicate of bug 1634496 *** https://bugs.launchpad.net/bugs/1634496 ** This bug has been marked a duplicate of bug 1634496 proc_keys_show crash when reading /proc/keys -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1634519 Title: linux autopkgtest: eternal hang/ BUG: soft lockup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1634519/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1634519] Re: linux autopkgtest: eternal hang/ BUG: soft lockup
*** This bug is a duplicate of bug 1634496 *** https://bugs.launchpad.net/bugs/1634496 This is reproduceable on my QEMU instance: 13:16:59 DEBUG| [stdout] opcode PASSED 13:17:10 DEBUG| [stdout] open PASSED 13:17:20 DEBUG| [stdout] personality PASSED 13:17:30 DEBUG| [stdout] pipe PASSED 13:17:40 DEBUG| [stdout] poll PASSED And we get: [ 5361.167961] Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: 84f6b18e [ 5361.167961] [ 5361.171800] CPU: 1 PID: 19248 Comm: Tainted: GW OE 4.8.0-26-generic #28-Ubuntu [ 5361.173179] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Ubuntu-1.8.2-1ubuntu2 04/01/2014 [ 5361.175119] 0086 94818d37 8b7b72acbc78 8502f5b2 [ 5361.176740] 94f6b400 85883520 8b7b72acbd00 84d9e71c [ 5361.178356] 8b7b0010 8b7b72acbd10 8b7b72acbca8 94818d37 [ 5361.179938] Call Trace: [ 5361.180420] [] dump_stack+0x63/0x81 [ 5361.181401] [] panic+0xe4/0x226 [ 5361.182310] [] ? proc_keys_show+0x3ce/0x3d0 [ 5361.183487] [] __stack_chk_fail+0x19/0x30 [ 5361.184478] [] proc_keys_show+0x3ce/0x3d0 [ 5361.185476] [] ? key_validate+0x50/0x50 [ 5361.187078] [] ? key_default_cmp+0x20/0x20 [ 5361.188277] [] seq_read+0x2e9/0x3c0 [ 5361.189303] [] proc_reg_read+0x42/0x70 [ 5361.190234] [] __vfs_read+0x18/0x40 [ 5361.190813] [] vfs_read+0x96/0x130 [ 5361.191732] [] SyS_read+0x55/0xc0 [ 5361.192739] [] entry_SYSCALL_64_fastpath+0x1e/0xa8 [ 5361.194353] Kernel Offset: 0x3c0 from 0x8100 (relocation range: 0x8000-0xbfff) [ 5361.197761] ---[ end Kernel panic - not syncing: stack-protector: Kernel stack is corrupted in: 84f6b18e This is because of bug 1634496. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1634519 Title: linux autopkgtest: eternal hang/ BUG: soft lockup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1634519/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1634519] Re: linux autopkgtest: eternal hang/ BUG: soft lockup
Second run: Nothing useful at all in "nova console-log" (just the normal boot up to "login:"), test output tail is 07:32:01 DEBUG| [stdout] nice PASSED 07:32:11 DEBUG| [stdout] null PASSED 07:32:21 DEBUG| [stdout] opcode PASSED 07:32:31 DEBUG| [stdout] open PASSED 07:32:41 DEBUG| [stdout] personality PASSED 07:32:51 DEBUG| [stdout] pipe PASSED 07:33:01 DEBUG| [stdout] poll PASSED dmesg tail is more interesting, as it has some trace: [1.568250] AppArmor: AppArmor sha1 policy hashing enabled [21/1103] [1.569433] ima: No TPM chip found, activating TPM-bypass! [1.570642] evm: HMAC attrs: 0x1 [1.571783] Magic number: 4:640:161 [1.572860] rtc_cmos 00:00: setting system clock to 2016-10-21 04:10:09 UTC (1477023009) [1.574813] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found [1.576127] EDD information not available. [1.577057] PM: Hibernation image not present or could not be loaded. [1.653017] isapnp: No Plug & Play device found [1.654764] Freeing unused kernel memory: 984K (d3c21000 - d3d17000) [1.656407] Write protecting the kernel text: 8252k [1.657711] Write protecting the kernel read-only data: 3324k [1.658992] NX-protecting the kernel data: 6084k [1.660357] [ cut here ] [1.661352] WARNING: CPU: 0 PID: 1 at /build/linux-yFroJZ/linux-4.8.0/arch/x86/mm/dump_pagetables.c:225 note_page+0x6a1/0x880 [1.663740] x86/mm: Found insecure W+X mapping at address c00a/0xc00a [1.665280] Modules linked in: [1.666020] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 4.8.0-26-generic #28-Ubuntu [1.667603] Hardware name: OpenStack Foundation OpenStack Nova, BIOS Bochs 01/01/2011 [1.669270] d3b54967 625585ec 00200286 d7cabe70 d33da625 d7cabeb4 d3a38b68 d7cabea0 [1.669270] d3071b9a d3a38b30 d7cabed4 0001 d3a38b68 00e1 d30682a1 00e1 [1.669270] d7cabf34 8000 d7cabec0 d3071c06 0009 d7cabeb4 [1.669270] Call Trace: [1.669270] [] dump_stack+0x58/0x73 [1.669270] [] __warn+0xea/0x110 [1.669270] [] ? note_page+0x6a1/0x880 [1.669270] [] warn_slowpath_fmt+0x46/0x60 [1.669270] [] note_page+0x6a1/0x880 [1.669270] [] ptdump_walk_pgd_level_core+0x1f5/0x300 [1.669270] [] ptdump_walk_pgd_level_checkwx+0x16/0x20 [1.669270] [] mark_rodata_ro+0xfd/0x130 [1.669270] [] kernel_init+0x2c/0x100 [1.669270] [] ? schedule_tail+0x11/0x50 [1.669270] [] ret_from_kernel_thread+0xe/0x24 [1.669270] [] ? rest_init+0x70/0x70 [1.688344] ---[ end trace c05a9abbb5340752 ]--- [1.689410] x86/mm: Checked W+X mappings: FAILED, 96 W+X pages found. [1.708425] random: systemd-udevd: uninitialized urandom read (16 bytes read) [1.710325] random: udevadm: uninitialized urandom read (16 bytes read) [1.710853] random: udevadm: uninitialized urandom read (16 bytes read) [1.711745] random: udevadm: uninitialized urandom read (16 bytes read) [1.711864] random: udevadm: uninitialized urandom read (16 bytes read) [1.712433] random: udevadm: uninitialized urandom read (16 bytes read) [1.712560] random: udevadm: uninitialized urandom read (16 bytes read) [1.712670] random: udevadm: uninitialized urandom read (16 bytes read) [1.712787] random: udevadm: uninitialized urandom read (16 bytes read) [1.712907] random: udevadm: uninitialized urandom read (16 bytes read) [1.763408] virtio_net virtio0 ens2: renamed from eth0 [1.787845] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [1.790353] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [1.809191] FDC 0 is a S82078B [1.960057] raid6: mmxx1gen() 1882 MB/s [2.028044] raid6: mmxx2gen() 3964 MB/s [2.096071] raid6: sse1x1 gen() 1800 MB/s [2.164055] raid6: sse1x2 gen() 3682 MB/s [2.232054] raid6: sse2x1 gen() 3614 MB/s [2.300046] raid6: sse2x1 xor() 3707 MB/s [2.368047] raid6: sse2x2 gen() 6710 MB/s [2.436044] raid6: sse2x2 xor() 4994 MB/s [2.437024] raid6: using algorithm sse2x2 gen() 6710 MB/s [2.438174] raid6: xor() 4994 MB/s, rmw enabled [2.439221] raid6: using ssse3x1 recovery algorithm [2.445977] xor: automatically using best checksumming function: avx [2.506401] Btrfs loaded, crc32c=crc32c-intel [2.579605] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null) [2.686394] ip_tables: (C) 2000-2006 Netfilter Core Team [2.689931] random: fast init done [2.725766] systemd[1]: systemd 231 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [
[Bug 1634519] Re: linux autopkgtest: eternal hang/ BUG: soft lockup
The tests (both yakkety and zesty) are still looping, I'm afraid. I
didn't see the "BUG soft lockup" in the one instance I was watching.
There were no obvious kernel call traces in dmesg, and the test output
tail is just:
06:27:14 DEBUG| [stdout]
Killed
DEBUG - Leave sh
ERROR - The command (AUTOTEST_PATH=/home/ubuntu/autotest sudo -E
autotest/client/autotest-local --verbose
autotest/client/tests/ubuntu_qrt_apparmor/control) return
ed a non-zero exit status (137).
ERROR - 06:03:39 INFO | Writing results to
/tmp/autopkgtest.XDxmzj/build.2sj/linux-4.8.0/autotest/client/results/default
ERROR - 06:03:39 DEBUG| Initializing the state engine
ERROR - 06:03:39 DEBUG| Persistent state client.steps now set to []
ERROR - 06:03:39 DEBUG| Persistent option harness now set to None
ERROR - 06:03:39 DEBUG| Persistent option harness_args now set to None
ERROR - 06:03:39 DEBUG| Selected harness: standalone
ERROR - 06:03:39 INFO | START timestamp=1477029819
localtime=Oct 21 06:03:39
ERROR - 06:03:39 DEBUG| Persistent state client._record_indent now set to 1
ERROR - 06:03:39 DEBUG| Test has timeout: 7200 sec.
ERROR - 06:03:39 INFO | START ubuntu_qrt_apparmor.setup
ubuntu_qrt_apparmor.setup timestamp=1477029819timeout=7200
localtime=Oct 21 06
:03:39
ERROR - 06:03:39 DEBUG| Persistent state client._record_indent now set to 2
ERROR - 06:03:39 DEBUG| Persistent state client.unexpected_reboot now set to
('ubuntu_qrt_apparmor.setup', 'ubuntu_qrt_apparmor.setup')
ERROR - 06:03:39 DEBUG| Waiting for pid 2611 for 7200 seconds
ERROR - 06:03:39 DEBUG| Running 'apt-get update'
[...]
ERROR - 06:05:02 DEBUG| [stdout] Unpacking libgraphite2-3:i386 (1.3.8-1ubuntu1)
...
ERROR - 06:05:02 DEBUG| [stdout] Selecting previously unselected package
libharfbuzz0b:i386.
ERROR - 06:05:02 DEBUG| [stdout] Preparing to unpack
.../035-libharfbuzz0b_1.2.7-1_i386.deb ...
ERROR - 06:05:02 DEBUG| [stdout] Unpacking libharfbuzz0b:i386 (1.2.7-1) ...
ERROR - 06:05:02 DEBUG| [stdout] Selecting previously unselected package
libpangoft2-1.0-0:i386.
ERROR - 06:05:02 DEBUG| [stdout] Preparing to unpack
.../036-libpangoft2-1.0-0_1.40.3-2_i386.deb ...
ERROR - 06:05:02 DEBUG| [stdout] Unpacking libpangoft2-1.0-0:i386 (1.40.3-2) ...
Killed
Connection to 10.220.46.18 closed by remote host.
Exit request sent.
autopkgtest [06:31:15]: ERROR: testbed failure: testbed auxverb failed with
exit code 255
So this time it seems apt gets killed. The VM went away after that, so I
don't have it any more for investigation.
I'm watching another current run and will get its journalctl -f and test
output tail, and will then kill the current runs again as there are a
lot of them, they loop, and they block large amounts of capacity.
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1634519
Title:
linux autopkgtest: eternal hang/ BUG: soft lockup
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1634519/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1634519] Re: linux autopkgtest: eternal hang/ BUG: soft lockup
Hi Martin, I've pushed another minor change to our tests, do you mind re-running this. I've run it on QEMU on my system and it runs through to completion, so I am hopeful that this may resolve the issues. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1634519 Title: linux autopkgtest: eternal hang/ BUG: soft lockup To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1634519/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1634519] Re: linux autopkgtest: eternal hang/ BUG: soft lockup
The local QEMU run also doesn't time out cleanly:
qqemu-system-x86_64: /build/qemu-3KpUoe/qemu-2.6.1+dfsg/hw/char/serial.c:231:
serial_xmit: Assertion `!(s->lsr & UART_LSR_TEMT)' failed.
autopkgtest [16:03:27]: ERROR: timed out on command "[...]" (kind: test)
autopkgtest [16:03:28]: test ubuntu-regression-suite: ---]
Traceback (most recent call last):
File "/tmp/autopkgtest-virt-qemu._36vlf46/runcmd", line 63, in
s.connect('/tmp/autopkgtest-virt-qemu._36vlf46/ttyS1')
ConnectionRefusedError: [Errno 111] Connection refused
I. e. it also breaks the status of ttyS1 somehow.
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1634519
Title:
linux autopkgtest: eternal hang/ BUG: soft lockup
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1634519/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
