Panic on 1 oct 2012 kernel
Hi, Just got a panic from an nginx webserver of ours. Can produce ps and trace since ddb send symbol unknown when we send the command. This is what was captured from my camera phone; panic: kernel diagnostic assertion __mp_lock_held(sched_lock) == 0 failed: file ../../../../kern/kern_lock.c, line 363 Stopped at Debugger+0x5: leave Thanks, Insan Praja SW OpenBSD 5.2-current (IMS-AMD64.MP) #3: Mon Oct 1 14:49:48 WIT 2012 r...@development.xxx.net:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 2145189888 (2045MB) avail mem = 2065670144 (1969MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.33 @ 0x7fee2000 (29 entries) bios0: vendor IBM version IBM BIOS Version 1.35-[G9E135AUS-1.35]- date 09/29/2007 bios0: IBM IBM System x3250 -[436442A]- acpi0 at bios0: rev 0 acpi0: sleep states S0 S4 S5 acpi0: tables DSDT FACP MCFG APIC BOOT SPCR SSDT acpi0: wakeup devices PEG_(S4) PEG2(S4) EXP1(S4) EXP5(S4) EXP6(S4) PCIB(S4) COM1(S4) COM2(S4) USB1(S4) USB2(S4) USB3(S4) USB4(S4) EUSB(S4) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimcfg0 at acpi0 addr 0xe000, bus 0-25 acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz, 1866.98 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF cpu0: 2MB 64b/line 8-way L2 cache cpu0: apic clock running at 266MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz, 1866.73 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF cpu1: 2MB 64b/line 8-way L2 cache ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 12 (PEG_) acpiprt2 at acpi0: bus 6 (PEG2) acpiprt3 at acpi0: bus 5 (EXP1) acpiprt4 at acpi0: bus 1 (EXP5) acpiprt5 at acpi0: bus 3 (EXP6) acpiprt6 at acpi0: bus 26 (PCIB) acpicpu0 at acpi0: PSS acpicpu1 at acpi0: PSS acpibtn0 at acpi0: PWRB ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 1866 MHz: speeds: 1867, 1600 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 Intel E7230 Host rev 0xc0 ppb0 at pci0 dev 1 function 0 Intel E7230 PCIE rev 0xc0: msi pci1 at ppb0 bus 12 ppb1 at pci0 dev 3 function 0 Intel 82975X PCIE rev 0xc0: msi pci2 at ppb1 bus 6 ppb2 at pci0 dev 28 function 0 Intel 82801GB PCIE rev 0x01: msi pci3 at ppb2 bus 5 ppb3 at pci0 dev 28 function 4 Intel 82801G PCIE rev 0x01: msi pci4 at ppb3 bus 1 bge0 at pci4 dev 0 function 0 Broadcom BCM5721 rev 0x21, BCM5750 C1 (0x4201): apic 2 int 16, address 00:1a:64:6e:a0:9a brgphy0 at bge0 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 ppb4 at pci0 dev 28 function 5 Intel 82801G PCIE rev 0x01: msi pci5 at ppb4 bus 3 bge1 at pci5 dev 0 function 0 Broadcom BCM5721 rev 0x21, BCM5750 C1 (0x4201): apic 2 int 17, address 00:1a:64:6e:a0:9b brgphy1 at bge1 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 uhci0 at pci0 dev 29 function 0 Intel 82801GB USB rev 0x01: apic 2 int 23 uhci1 at pci0 dev 29 function 1 Intel 82801GB USB rev 0x01: apic 2 int 19 uhci2 at pci0 dev 29 function 2 Intel 82801GB USB rev 0x01: apic 2 int 18 uhci3 at pci0 dev 29 function 3 Intel 82801GB USB rev 0x01: apic 2 int 16 ehci0 at pci0 dev 29 function 7 Intel 82801GB USB rev 0x01: apic 2 int 23 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1 ppb5 at pci0 dev 30 function 0 Intel 82801BA Hub-to-PCI rev 0xe1 pci6 at ppb5 bus 26 vga1 at pci6 dev 4 function 0 ATI ES1000 rev 0x02 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) radeondrm0 at vga1: apic 2 int 18 drm0 at radeondrm0 pcib0 at pci0 dev 31 function 0 Intel 82801GB LPC rev 0x01 pciide0 at pci0 dev 31 function 2 Intel 82801GB SATA rev 0x01: DMA, channel 0 wired to compatibility, channel 1 wired to compatibility wd0 at pciide0 channel 0 drive 0: Hitachi HDS721616PLA380 IBM wd0: 16-sector PIO, LBA48, 152626MB, 312579695 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 atapiscsi0 at pciide0 channel 1 drive 0 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: TSSTcorp, CD-ROM TS-L162C, IB02 ATAPI 5/cdrom removable cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2 ichiic0 at pci0 dev 31 function 3 Intel 82801GB SMBus rev 0x01: apic 2 int 19 iic0 at ichiic0 spdmem0 at iic0 addr 0x50: 512MB DDR2 SDRAM ECC PC2-5300CL5 spdmem1 at iic0 addr 0x51: 512MB DDR2 SDRAM ECC PC2-5300CL5 spdmem2 at iic0 addr 0x52: 512MB DDR2 SDRAM ECC PC2-5300CL5 spdmem3 at iic0 addr 0x53: 512MB DDR2 SDRAM ECC PC2-5300CL5 usb1 at uhci0: USB revision 1.0 uhub1 at usb1 Intel UHCI root hub rev 1.00/1.00 addr 1 usb2 at uhci1: USB revision 1.0 uhub2 at usb2 Intel UHCI root
Re: Panic on 1 oct 2012 kernel
On 4 October 2012 12:06, Insan Praja SW insan.pr...@gmail.com wrote: Hi, Just got a panic from an nginx webserver of ours. Can produce ps and trace since ddb send symbol unknown when we send the command. This is what was captured from my camera phone; You mean can't ? can you paste exactly what happens when you try to get a trace ? Looks like some code path is trying to grab the kernel_lock with the sched_lock held. panic: kernel diagnostic assertion __mp_lock_held(sched_lock) == 0 failed: file ../../../../kern/kern_lock.c, line 363 Stopped at Debugger+0x5: leave Thanks, Insan Praja SW OpenBSD 5.2-current (IMS-AMD64.MP) #3: Mon Oct 1 14:49:48 WIT 2012 r...@development.xxx.net:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 2145189888 (2045MB) avail mem = 2065670144 (1969MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.33 @ 0x7fee2000 (29 entries) bios0: vendor IBM version IBM BIOS Version 1.35-[G9E135AUS-1.35]- date 09/29/2007 bios0: IBM IBM System x3250 -[436442A]- acpi0 at bios0: rev 0 acpi0: sleep states S0 S4 S5 acpi0: tables DSDT FACP MCFG APIC BOOT SPCR SSDT acpi0: wakeup devices PEG_(S4) PEG2(S4) EXP1(S4) EXP5(S4) EXP6(S4) PCIB(S4) COM1(S4) COM2(S4) USB1(S4) USB2(S4) USB3(S4) USB4(S4) EUSB(S4) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimcfg0 at acpi0 addr 0xe000, bus 0-25 acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz, 1866.98 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF cpu0: 2MB 64b/line 8-way L2 cache cpu0: apic clock running at 266MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz, 1866.73 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF cpu1: 2MB 64b/line 8-way L2 cache ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 12 (PEG_) acpiprt2 at acpi0: bus 6 (PEG2) acpiprt3 at acpi0: bus 5 (EXP1) acpiprt4 at acpi0: bus 1 (EXP5) acpiprt5 at acpi0: bus 3 (EXP6) acpiprt6 at acpi0: bus 26 (PCIB) acpicpu0 at acpi0: PSS acpicpu1 at acpi0: PSS acpibtn0 at acpi0: PWRB ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 1866 MHz: speeds: 1867, 1600 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 Intel E7230 Host rev 0xc0 ppb0 at pci0 dev 1 function 0 Intel E7230 PCIE rev 0xc0: msi pci1 at ppb0 bus 12 ppb1 at pci0 dev 3 function 0 Intel 82975X PCIE rev 0xc0: msi pci2 at ppb1 bus 6 ppb2 at pci0 dev 28 function 0 Intel 82801GB PCIE rev 0x01: msi pci3 at ppb2 bus 5 ppb3 at pci0 dev 28 function 4 Intel 82801G PCIE rev 0x01: msi pci4 at ppb3 bus 1 bge0 at pci4 dev 0 function 0 Broadcom BCM5721 rev 0x21, BCM5750 C1 (0x4201): apic 2 int 16, address 00:1a:64:6e:a0:9a brgphy0 at bge0 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 ppb4 at pci0 dev 28 function 5 Intel 82801G PCIE rev 0x01: msi pci5 at ppb4 bus 3 bge1 at pci5 dev 0 function 0 Broadcom BCM5721 rev 0x21, BCM5750 C1 (0x4201): apic 2 int 17, address 00:1a:64:6e:a0:9b brgphy1 at bge1 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 uhci0 at pci0 dev 29 function 0 Intel 82801GB USB rev 0x01: apic 2 int 23 uhci1 at pci0 dev 29 function 1 Intel 82801GB USB rev 0x01: apic 2 int 19 uhci2 at pci0 dev 29 function 2 Intel 82801GB USB rev 0x01: apic 2 int 18 uhci3 at pci0 dev 29 function 3 Intel 82801GB USB rev 0x01: apic 2 int 16 ehci0 at pci0 dev 29 function 7 Intel 82801GB USB rev 0x01: apic 2 int 23 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1 ppb5 at pci0 dev 30 function 0 Intel 82801BA Hub-to-PCI rev 0xe1 pci6 at ppb5 bus 26 vga1 at pci6 dev 4 function 0 ATI ES1000 rev 0x02 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) radeondrm0 at vga1: apic 2 int 18 drm0 at radeondrm0 pcib0 at pci0 dev 31 function 0 Intel 82801GB LPC rev 0x01 pciide0 at pci0 dev 31 function 2 Intel 82801GB SATA rev 0x01: DMA, channel 0 wired to compatibility, channel 1 wired to compatibility wd0 at pciide0 channel 0 drive 0: Hitachi HDS721616PLA380 IBM wd0: 16-sector PIO, LBA48, 152626MB, 312579695 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 atapiscsi0 at pciide0 channel 1 drive 0 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: TSSTcorp, CD-ROM TS-L162C, IB02 ATAPI 5/cdrom removable cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2 ichiic0 at pci0 dev 31 function 3 Intel 82801GB SMBus rev 0x01: apic 2 int 19 iic0 at ichiic0 spdmem0 at iic0 addr 0x50: 512MB DDR2 SDRAM ECC PC2-5300CL5 spdmem1 at iic0 addr
Re: Panic on 1 oct 2012 kernel
Hi, On Thu, 04 Oct 2012 17:52:24 +0700, Christiano F. Haesbaert haesba...@haesbaert.org wrote: On 4 October 2012 12:06, Insan Praja SW insan.pr...@gmail.com wrote: Hi, Just got a panic from an nginx webserver of ours. Can produce ps and trace since ddb send symbol unknown when we send the command. This is what was captured from my camera phone; You mean can't ? can you paste exactly what happens when you try to get a trace ? Yap. Sorry for that. Looks like some code path is trying to grab the kernel_lock with the sched_lock held. panic: kernel diagnostic assertion __mp_lock_held(sched_lock) == 0 failed: file ../../../../kern/kern_lock.c, line 363 Stopped at Debugger+0x5: leave Thanks, Insan Praja SW OpenBSD 5.2-current (IMS-AMD64.MP) #3: Mon Oct 1 14:49:48 WIT 2012 r...@development.xxx.net:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 2145189888 (2045MB) avail mem = 2065670144 (1969MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.33 @ 0x7fee2000 (29 entries) bios0: vendor IBM version IBM BIOS Version 1.35-[G9E135AUS-1.35]- date 09/29/2007 bios0: IBM IBM System x3250 -[436442A]- acpi0 at bios0: rev 0 acpi0: sleep states S0 S4 S5 acpi0: tables DSDT FACP MCFG APIC BOOT SPCR SSDT acpi0: wakeup devices PEG_(S4) PEG2(S4) EXP1(S4) EXP5(S4) EXP6(S4) PCIB(S4) COM1(S4) COM2(S4) USB1(S4) USB2(S4) USB3(S4) USB4(S4) EUSB(S4) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimcfg0 at acpi0 addr 0xe000, bus 0-25 acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz, 1866.98 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF cpu0: 2MB 64b/line 8-way L2 cache cpu0: apic clock running at 266MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: Intel(R) Xeon(R) CPU 3040 @ 1.86GHz, 1866.73 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF cpu1: 2MB 64b/line 8-way L2 cache ioapic0 at mainbus0: apid 2 pa 0xfec0, version 20, 24 pins acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 12 (PEG_) acpiprt2 at acpi0: bus 6 (PEG2) acpiprt3 at acpi0: bus 5 (EXP1) acpiprt4 at acpi0: bus 1 (EXP5) acpiprt5 at acpi0: bus 3 (EXP6) acpiprt6 at acpi0: bus 26 (PCIB) acpicpu0 at acpi0: PSS acpicpu1 at acpi0: PSS acpibtn0 at acpi0: PWRB ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 1866 MHz: speeds: 1867, 1600 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 Intel E7230 Host rev 0xc0 ppb0 at pci0 dev 1 function 0 Intel E7230 PCIE rev 0xc0: msi pci1 at ppb0 bus 12 ppb1 at pci0 dev 3 function 0 Intel 82975X PCIE rev 0xc0: msi pci2 at ppb1 bus 6 ppb2 at pci0 dev 28 function 0 Intel 82801GB PCIE rev 0x01: msi pci3 at ppb2 bus 5 ppb3 at pci0 dev 28 function 4 Intel 82801G PCIE rev 0x01: msi pci4 at ppb3 bus 1 bge0 at pci4 dev 0 function 0 Broadcom BCM5721 rev 0x21, BCM5750 C1 (0x4201): apic 2 int 16, address 00:1a:64:6e:a0:9a brgphy0 at bge0 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 ppb4 at pci0 dev 28 function 5 Intel 82801G PCIE rev 0x01: msi pci5 at ppb4 bus 3 bge1 at pci5 dev 0 function 0 Broadcom BCM5721 rev 0x21, BCM5750 C1 (0x4201): apic 2 int 17, address 00:1a:64:6e:a0:9b brgphy1 at bge1 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 uhci0 at pci0 dev 29 function 0 Intel 82801GB USB rev 0x01: apic 2 int 23 uhci1 at pci0 dev 29 function 1 Intel 82801GB USB rev 0x01: apic 2 int 19 uhci2 at pci0 dev 29 function 2 Intel 82801GB USB rev 0x01: apic 2 int 18 uhci3 at pci0 dev 29 function 3 Intel 82801GB USB rev 0x01: apic 2 int 16 ehci0 at pci0 dev 29 function 7 Intel 82801GB USB rev 0x01: apic 2 int 23 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 Intel EHCI root hub rev 2.00/1.00 addr 1 ppb5 at pci0 dev 30 function 0 Intel 82801BA Hub-to-PCI rev 0xe1 pci6 at ppb5 bus 26 vga1 at pci6 dev 4 function 0 ATI ES1000 rev 0x02 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) radeondrm0 at vga1: apic 2 int 18 drm0 at radeondrm0 pcib0 at pci0 dev 31 function 0 Intel 82801GB LPC rev 0x01 pciide0 at pci0 dev 31 function 2 Intel 82801GB SATA rev 0x01: DMA, channel 0 wired to compatibility, channel 1 wired to compatibility wd0 at pciide0 channel 0 drive 0: Hitachi HDS721616PLA380 IBM wd0: 16-sector PIO, LBA48, 152626MB, 312579695 sectors wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6 atapiscsi0 at pciide0 channel 1 drive 0 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: TSSTcorp, CD-ROM TS-L162C, IB02 ATAPI 5/cdrom removable cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2 ichiic0 at pci0 dev 31 function 3 Intel 82801GB SMBus rev 0x01: apic 2 int 19 iic0 at ichiic0 spdmem0 at iic0 addr 0x50: 512MB
Re: Panic on 1 oct 2012 kernel
On 4 October 2012 12:56, Insan Praja SW insan.pr...@gmail.com wrote: Hi, On Thu, 04 Oct 2012 17:52:24 +0700, Christiano F. Haesbaert haesba...@haesbaert.org wrote: On 4 October 2012 12:06, Insan Praja SW insan.pr...@gmail.com wrote: Hi, Just got a panic from an nginx webserver of ours. Can produce ps and trace since ddb send symbol unknown when we send the command. This is what was captured from my camera phone; You mean can't ? can you paste exactly what happens when you try to get a trace ? Yap. Sorry for that. You're not using generic, what did you change ? Can you show me what happens when you try to get a trace/ps ? Did you reboot the machine ? If you're screwing with the kernel and asking for support at least try to tell us what have you changed.
