Got the following error on 2 identical firewalls last night: uvm_fault(0xd0891180, 0x0 0, 3) -> e kernel: page fault trap, code=0 Stopped at pf_test_rule+0xa87: movl %ecx,0x4(%eax)
OpenBSD 4.6 installed from the ISO /OpenBSD/4.6/i386/install46.iso Hardware is a Dell R200 with 2 onboard broadcom NIC interfaces and a 4 port Intel PRO/1000 card. 2GB RAM and a single SATA hard drive. We have 2 of these servers in a failover configuration using PFsync and CARP utilising 5 NICs: 2 connected to external lines and 2 to internal departments and a 5th for pfsync. Having previously been up for a couple of weeks both were rebooted at the weekend but then both crashed last night after little more than 24h uptime. They crashed at different times in the night. Both were at the DDB prompt and showing exactly the same error: uvm_fault(0xd0891180, 0x0 0, 3) -> e kernel: page fault trap, code=0 Stopped at pf_test_rule+0xa87: movl %ecx,0x4(%eax) and then the ddb{0}> prompt. no mention of a panic picture here - http://img121.imageshack.us/img121/4571/cpicture.jpg Unfortunately both were rebooted before I could do a trace. Below is a dmesg output. I realise this isnt much to go on but if anyone had any suggestions it would be much appreciated. Alastair Johnson DMESG output ============ OpenBSD 4.6 (GENERIC.MP) #89: Thu Jul 9 21:32:39 MDT 2009 dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP cpu0: Intel(R) Xeon(R) CPU E3120 @ 3.16GHz ("GenuineIntel" 686-class) 3.17 GHz cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,SMX,EST,TM2,CX16,xTPR real mem = 2145689600 (2046MB) avail mem = 2065969152 (1970MB) mainbus0 at root bios0 at mainbus0: AT/286+ BIOS, date 05/15/09, BIOS32 rev. 0 @ 0xfac90, SMBIOS rev. 2.5 @ 0x7ff9c000 (46 entries) bios0: vendor Dell Inc. version "1.4.3" date 05/15/2009 bios0: Dell Inc. PowerEdge R200 acpi0 at bios0: rev 2 acpi0: tables DSDT FACP APIC SPCR HPET MCFG WD__ SLIC ERST HEST BERT EINJ SSDT SSDT SSDT acpi0: wakeup devices PCI0(S5) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: apic clock running at 333MHz cpu1 at mainbus0: apid 1 (application processor) cpu1: Intel(R) Xeon(R) CPU E3120 @ 3.16GHz ("GenuineIntel" 686-class) 3.17 GHz cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,SMX,EST,TM2,CX16,xTPR ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins ioapic0: misconfigured as apic 0, remapped to apid 2 acpihpet0 at acpi0: 14318179 Hz acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 1 (PEX1) acpiprt2 at acpi0: bus 2 (SBE0) acpiprt3 at acpi0: bus 6 (SBE4) acpiprt4 at acpi0: bus 7 (SBE5) acpiprt5 at acpi0: bus 8 (COMP) acpicpu0 at acpi0: PSS acpicpu1 at acpi0: PSS bios0: ROM list: 0xc0000/0x9000 0xc9000/0x1000 0xca000/0x1800 0xec000/0x4000! ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 3167 MHz: speeds: 3166, 2667, 2333, 2000 MHz pci0 at mainbus0 bus 0: configuration mode 1 (bios) pchb0 at pci0 dev 0 function 0 "Intel 3200/3210 Host" rev 0x01 ppb0 at pci0 dev 1 function 0 "Intel 3200/3210 PCIE" rev 0x01: apic 2 int 16 (irq 15) pci1 at ppb0 bus 1 ppb1 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02: apic 2 int 16 (irq 15) pci2 at ppb1 bus 2 ppb2 at pci2 dev 0 function 0 "IDT 89HPES12N3A" rev 0x0e pci3 at ppb2 bus 3 ppb3 at pci3 dev 2 function 0 "IDT 89HPES12N3A" rev 0x0e pci4 at ppb3 bus 4 em0 at pci4 dev 0 function 0 "Intel PRO/1000 QP (82575GB)" rev 0x02: apic 2 int 18 (irq 14), address 00:1b:21:3f:1c:80 em1 at pci4 dev 0 function 1 "Intel PRO/1000 QP (82575GB)" rev 0x02: apic 2 int 19 (irq 5), address 00:1b:21:3f:1c:81 ppb4 at pci3 dev 4 function 0 "IDT 89HPES12N3A" rev 0x0e pci5 at ppb4 bus 5 em2 at pci5 dev 0 function 0 "Intel PRO/1000 QP (82575GB)" rev 0x02: apic 2 int 16 (irq 15), address 00:1b:21:3f:1c:84 em3 at pci5 dev 0 function 1 "Intel PRO/1000 QP (82575GB)" rev 0x02: apic 2 int 17 (irq 14), address 00:1b:21:3f:1c:85 ppb5 at pci0 dev 28 function 4 "Intel 82801I PCIE" rev 0x02 pci6 at ppb5 bus 6 bge0 at pci6 dev 0 function 0 "Broadcom BCM5721" rev 0x21, BCM5750 C1 (0x4201): apic 2 int 16 (irq 15), address 00:25:64:3a:e4:41 brgphy0 at bge0 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 ppb6 at pci0 dev 28 function 5 "Intel 82801I PCIE" rev 0x02 pci7 at ppb6 bus 7 bge1 at pci7 dev 0 function 0 "Broadcom BCM5721" rev 0x21, BCM5750 C1 (0x4201): apic 2 int 17 (irq 14), address 00:25:64:3a:e4:42 brgphy1 at bge1 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 uhci0 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 2 int 21 (irq 11) uhci1 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 2 int 20 (irq 10) uhci2 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 2 int 21 (irq 11) ehci0 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 2 int 21 (irq 11) usb0 at ehci0: USB revision 2.0 uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb7 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92 pci8 at ppb7 bus 8 vga1 at pci8 dev 5 function 0 "ATI ES1000" rev 0x02 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) radeondrm0 at vga1: apic 2 int 19 (irq 5) drm0 at radeondrm0 ichpcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02: PM disabled pciide0 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI pciide0: using apic 2 int 23 (irq 6) for native-PCI interrupt wd0 at pciide0 channel 0 drive 0: <ST3250310NS> wd0: 16-sector PIO, LBA48, 238418MB, 488281250 sectors atapiscsi0 at pciide0 channel 0 drive 1 scsibus0 at atapiscsi0: 2 targets cd0 at scsibus0 targ 0 lun 0: <PLDS, DVD+-RW DS-8W2S, 1D11> ATAPI 5/cdrom removable wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5 cd0(pciide0:0:1): using PIO mode 4, Ultra-DMA mode 5 usb1 at uhci0: USB revision 1.0 uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb2 at uhci1: USB revision 1.0 uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb3 at uhci2: USB revision 1.0 uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1 isa0 at ichpcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo pckbc0 at isa0 port 0x60/5 pckbd0 at pckbc0 (kbd slot) pckbc0: using irq 1 for kbd slot wskbd0 at pckbd0: console keyboard, using wsdisplay0 pcppi0 at isa0 port 0x61 midi0 at pcppi0: <PC speaker> spkr0 at pcppi0 npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16 mtrr: Pentium Pro MTRR support uhub4 at uhub0 port 5 "Cypress Semiconductor USB2 Hub" rev 2.00/0.0b addr 2 softraid0 at root root on wd0a swap on wd0b dump on wd0b WARNING: / was not properly unmounted carp3: state transition: BACKUP -> MASTER carp1: state transition: BACKUP -> MASTER carp2: state transition: BACKUP -> MASTER carp4: state transition: BACKUP -> MASTER