Am Sonntag, 17. Mai 2009 schrieb Bastian Blank: > Please provide the complete kernel log from the failing system.
I tried to reconstruct the kernel panic with a XEN virtual machine because the machine the bug occurred originally is far off and I have no chance to attach a serial console to it. Log is attached. Kind regards Markus -- Just because I'm not paranoid doesn't mean they're not out to get me!
[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Linux version 2.6.26-2-xen-amd64 (Debian 2.6.26-15lenny2) (da...@debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Wed May 13 18:43:45 UTC 2009 [ 0.000000] Command line: root=/dev/sda2 ro ro selinux=1 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] Xen: 0000000000000000 - 0000000040800000 (usable) [ 0.000000] max_pfn_mapped = 264192 [ 0.000000] init_memory_mapping [ 0.000000] early res: 0 [200000-631917] TEXT DATA BSS [ 0.000000] early res: 1 [632000-1d5bfff] Xen provided [ 0.000000] early res: 2 [1d5c000-1f63fff] PGTABLE [ 0.000000] Zone PFN ranges: [ 0.000000] DMA 0 -> 4096 [ 0.000000] DMA32 4096 -> 1048576 [ 0.000000] Normal 1048576 -> 1048576 [ 0.000000] Movable zone start PFN for each node [ 0.000000] early_node_map[1] active PFN ranges [ 0.000000] 0: 0 -> 264192 [ 0.000000] PERCPU: Allocating 22192 bytes of per cpu data [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 260580 [ 0.000000] Kernel command line: root=/dev/sda2 ro ro selinux=1 [ 0.000000] Initializing CPU#0 [ 0.000000] PID hash table entries: 4096 (order: 12, 32768 bytes) [ 0.000000] Xen reported: 2666.760 MHz processor. [ 0.004000] Console: colour dummy device 80x25 [ 0.004000] console [tty0] enabled [ 0.004000] console [hvc0] enabled [ 0.004000] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.004000] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.004000] Software IO TLB disabled [ 0.004000] Memory: 1001944k/1056768k available (2275k kernel code, 46284k reserved, 1023k data, 216k init) [ 0.684060] Calibrating delay using timer specific routine.. 5337.62 BogoMIPS (lpj=10675251) [ 0.684117] Security Framework initialized [ 0.684128] SELinux: Initializing. [ 0.684152] selinux_register_security: Registering secondary module capability [ 0.684159] Capability LSM initialized as secondary [ 0.684180] Mount-cache hash table entries: 256 [ 0.684357] Initializing cgroup subsys ns [ 0.684367] Initializing cgroup subsys cpuacct [ 0.684372] Initializing cgroup subsys devices [ 0.684406] CPU: L1 I cache: 32K, L1 D cache: 32K [ 0.684414] CPU: L2 cache: 4096K [ 0.684421] CPU: Physical Processor ID: 0 [ 0.684425] CPU: Processor Core ID: 0 [ 0.684438] SMP alternatives: switching to UP code [ 0.691512] Brought up 1 CPUs [ 0.693937] net_namespace: 1224 bytes [ 0.694103] NET: Registered protocol family 16 [ 0.709746] SMP alternatives: switching to SMP code [ 0.716019] Initializing CPU#1 [ 0.716019] CPU: L1 I cache: 32K<6>Brought up 2 CPUs [ 0.716019] PCI: Fatal: No config space access function found [ 0.716019] PCI: setting up Xen PCI frontend stub [ 0.716019] , L1 D cache: 32K [ 0.716019] CPU: L2 cache: 4096K [ 0.716019] CPU: Physical Processor ID: 3 [ 0.716019] CPU: Processor Core ID: 0 [ 0.716023] ACPI: Interpreter disabled. [ 0.716023] Linux Plug and Play Support v0.97 (c) Adam Belay [ 0.716023] pnp: PnP ACPI: disabled [ 0.720030] suspend: event channel 11 [ 0.720424] xen_mem: Initialising balloon driver. [ 0.721791] usbcore: registered new interface driver usbfs [ 0.721848] usbcore: registered new interface driver hub [ 0.721888] usbcore: registered new device driver usb [ 0.722036] PCI: System does not support PCI [ 0.722040] PCI: System does not support PCI [ 0.738025] NET: Registered protocol family 2 [ 0.781111] IP route cache hash table entries: 32768 (order: 6, 262144 bytes) [ 0.781429] TCP established hash table entries: 131072 (order: 9, 2097152 bytes) [ 0.782182] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 0.782590] TCP: Hash tables configured (established 131072 bind 65536) [ 0.782596] TCP reno registered [ 0.793147] NET: Registered protocol family 1 [ 0.793267] checking if image is initramfs... it is [ 0.815891] Freeing initrd memory: 21584k freed [ 0.827896] platform rtc_cmos: registered platform RTC device (no PNP device found) [ 0.828286] audit: initializing netlink socket (disabled) [ 0.828286] type=2000 audit(1242586973.080:1): initialized [ 0.828286] VFS: Disk quotas dquot_6.5.1 [ 0.828286] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.828286] msgmni has been set to 2090 [ 0.828286] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253) [ 0.828286] io scheduler noop registered [ 0.828286] io scheduler anticipatory registered [ 0.828286] io scheduler deadline registered [ 0.828286] io scheduler cfq registered (default) [ 0.832268] Linux agpgart interface v0.103 [ 0.832268] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled [ 0.836264] brd: module loaded [ 0.836264] input: Macintosh mouse button emulation as /class/input/input0 [ 0.836264] Xen virtual console successfully installed as hvc0 [ 0.836264] Event-channel device installed. [ 0.849333] netfront: Initialising virtual ethernet driver. [ 0.853335] PNP: No PS/2 controller found. Probing ports directly. [ 0.854162] xen-vbd: registered block device major 8 [ 0.854162] blkfront: sda1: barriers enabled [ 0.853335] i8042.c: No controller found. [ 0.862348] blkfront: sda2: barriers enabled [ 0.866612] mice: PS/2 mouse device common for all mice [ 0.866905] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0 [ 0.867296] No iBFT detected. [ 0.867702] TCP cubic registered [ 0.867707] NET: Registered protocol family 17 [ 0.868045] registered taskstats version 1 [ 0.868073] XENBUS: Device with no driver: device/console/0 [ 0.868078] drivers/rtc/hctosys.c: unable to open rtc device (rtc0) [ 0.868089] Freeing unused kernel memory: 216k freed Loading, please wait... Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... FATAL: Error inserting fan (/lib/modules/2.6.26-2-xen-amd64/kernel/drivers/acpi/fan.ko): No such device WARNING: Error inserting processor (/lib/modules/2.6.26-2-xen-amd64/kernel/drivers/acpi/processor.ko): No such device [ 1.024238] thermal: Unknown symbol acpi_processor_set_thermal_limit FATAL: Error inserting thermal (/lib/modules/2.6.26-2-xen-amd64/kernel/drivers/acpi/thermal.ko): Unknown symbol in module, or unknown parameter (see dmesg) done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... [ 1.277282] device-mapper: uevent: version 1.0.3 [ 1.277282] device-mapper: ioctl: 4.13.0-ioctl (2007-10-18) initialised: dm-de...@redhat.com done. Begin: Running /scripts/local-premount ... done. [ 1.319818] EXT3-fs: INFO: recovery required on readonly filesystem. [ 1.319831] EXT3-fs: write access will be enabled during recovery. [ 1.320105] kjournald starting. Commit interval 5 seconds [ 1.320117] EXT3-fs: recovery complete. [ 1.320246] EXT3-fs: mounted filesystem with ordered data mode. Begin: Running /scripts/local-bottom ... done. done. Begin: Running /scripts/init-bottom ... done. [ 1.570304] SELinux: policy loaded with handle_unknown=deny [ 1.570324] type=1403 audit(1242586973.809:2): policy loaded auid=4294967295 ses=4294967295 INIT: version 2.86 booting Starting the hotplug events dispatcher: udevd[ 2.320632] udevd version 125 started . Synthesizing the initial hotplug events...done. Waiting for /dev to be fully populated...done. Activating swap...[ 2.965233] Adding 524280k swap on /dev/sda1. Priority:-1 extents:1 across:524280k done. Checking root file system...fsck 1.41.3 (12-Oct-2008) /dev/sda2: clean, 17560/3276800 files, 369731/13107200 blocks done. [ 3.198362] EXT3 FS on sda2, internal journal Cleaning up ifupdown.... Loading kernel modules...done. Checking file systems...fsck 1.41.3 (12-Oct-2008) done. Setting kernel variables (/etc/sysctl.conf)...done. Mounting local filesystems...done. Activating swapfile swap...done. Checking SELinux contexts: selinux-basics . Setting up networking.... Configuring network interfaces...done. INIT: Entering runlevel: 2 Starting enhanced syslogd: rsyslogd. Starting OpenBSD Secure Shell server: sshd[ 4.615473] NET: Registered protocol family 10 [ 4.615473] lo: Disabled Privacy Extensions [ 4.623558] ------------[ cut here ]------------ [ 4.623569] kernel BUG at security/selinux/avc.c:883! [ 4.623574] invalid opcode: 0000 [1] SMP [ 4.625758] CPU 0 [ 4.625762] Modules linked in: ipv6 evdev ext3 jbd mbcache dm_mirror dm_log dm_snapshot dm_mod thermal_sys [ 4.625781] Pid: 0, comm: swapper Not tainted 2.6.26-2-xen-amd64 #1 [ 4.625786] RIP: e030:[<ffffffff802e61dd>] [<ffffffff802e61dd>] avc_has_perm_noaudit+0x26/0x379 [ 4.625801] RSP: e02b:ffffffff80595a80 EFLAGS: 00010246 [ 4.625806] RAX: 0000000000000000 RBX: 0000000000000011 RCX: 0000000000000000 [ 4.625811] RDX: 0000000000000011 RSI: 0000000000000009 RDI: 0000000000000001 [ 4.625816] RBP: 0000000000000009 R08: 0000000000000000 R09: ffffffff80595b30 [ 4.625821] R10: 0000000000000007 R11: ffffffff802e71e0 R12: 0000000000000011 [ 4.625826] R13: 0000000000000001 R14: 0000000000000009 R15: ffffffff80595bc0 [ 4.625835] FS: 00007fc1bde26790(0000) GS:ffffffff80539000(0000) knlGS:0000000000000000 [ 4.625841] CS: e033 DS: 0000 ES: 0000 [ 4.625845] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 4.625851] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 4.625857] Process swapper (pid: 0, threadinfo ffffffff80552000, task ffffffff804fe460) [ 4.625863] Stack: ffffffff805fb290 ffffffff80595b30 00000000014a1480 0000001200000000 [ 4.625875] 0012000000000012 0000000100000077 ffffffff804fe460 ffffffff3fdf3b48 [ 4.625884] 00000000ffffffff 00000001ffffffff 0000000000000077 ffffffff802f110d [ 4.625892] Call Trace: [ 4.625897] <IRQ> [<ffffffff802f110d>] ? sidtab_context_to_sid+0x196/0x1d9 [ 4.625907] [<ffffffff802e7049>] ? avc_has_perm+0x2b/0x5b [ 4.625914] [<ffffffff802efd58>] ? sel_netport_sid+0x13b/0x16b [ 4.625920] [<ffffffff802e9ec1>] ? selinux_ip_postroute+0x1eb/0x38b [ 4.625928] [<ffffffff803dfab8>] ? nf_iterate+0x41/0x7d [ 4.625949] [<ffffffffa00628ac>] ? :ipv6:ip6_output_finish+0x0/0xd0 [ 4.625956] [<ffffffff803dfb51>] ? nf_hook_slow+0x5d/0xbe [ 4.625974] [<ffffffffa00628ac>] ? :ipv6:ip6_output_finish+0x0/0xd0 [ 4.625982] [<ffffffff80435712>] ? _read_lock_bh+0x9/0x19 [ 4.626000] [<ffffffffa0063051>] ? :ipv6:ip6_output2+0x234/0x251 [ 4.626007] [<ffffffff80235c42>] ? lock_timer_base+0x26/0x4b [ 4.626025] [<ffffffffa0063d5c>] ? :ipv6:ip6_output+0xc11/0xc37 [ 4.626032] [<ffffffff80235de8>] ? __mod_timer+0xd4/0xe3 [ 4.626054] [<ffffffffa007ad63>] ? :ipv6:mld_sendpack+0x1dc/0x363 [ 4.626077] [<ffffffffa007bdd2>] ? :ipv6:mld_ifc_timer_expire+0x1ca/0x1f9 [ 4.626099] [<ffffffffa007bc08>] ? :ipv6:mld_ifc_timer_expire+0x0/0x1f9 [ 4.626107] [<ffffffff802356b7>] ? run_timer_softirq+0x190/0x237 [ 4.626114] [<ffffffff80231ca0>] ? __do_softirq+0x77/0x103 [ 4.626120] [<ffffffff8020c13c>] ? call_softirq+0x1c/0x28 [ 4.626127] [<ffffffff8020e08a>] ? do_softirq+0x55/0xbb [ 4.626132] [<ffffffff8020e16d>] ? do_IRQ+0x7d/0x9a [ 4.626139] [<ffffffff8037d41c>] ? evtchn_do_upcall+0x13c/0x1fc [ 4.626146] [<ffffffff8020bbde>] ? do_hypervisor_callback+0x1e/0x30 [ 4.626150] <EOI> [<ffffffff8020e795>] ? xen_safe_halt+0x90/0xa6 [ 4.626160] [<ffffffff8020a0c8>] ? xen_idle+0x2e/0x66 [ 4.626165] [<ffffffff80209cd6>] ? cpu_idle+0x97/0xb9 [ 4.626171] [ 4.626173] [ 4.626176] Code: 41 5e 41 5f c3 41 57 41 56 41 89 f6 41 55 41 89 fd 41 54 55 53 48 83 ec 68 85 c9 89 4c 24 18 44 89 44 24 14 4c 89 4c 24 08 75 04 <0f> 0b eb fe 0f b7 f2 48 c7 c0 50 f6 58 80 46 8d 24 b5 00 00 00 [ 4.626243] RIP [<ffffffff802e61dd>] avc_has_perm_noaudit+0x26/0x379 [ 4.626250] RSP <ffffffff80595a80> [ 4.626257] ---[ end trace f39b0237fe35a277 ]--- [ 4.626262] Kernel panic - not syncing: Aiee, killing interrupt handler!