> From: Dave Voutila <d...@sisu.io> > Date: Wed, 05 Jun 2024 14:56:45 -0400 > > >Synopsis: witness panic: acquiring blockable sleep lock with spinlock > or critical section held (rwlock) vmmaplk > >Category: <PR category (one line)> > >Environment: > System : OpenBSD 7.5 > Details : OpenBSD 7.5-current (GENERIC.MP) #5: Wed Jun 5 20:07:42 > CEST 2024 > > dv@current1.openbsd.amsterdam:/home/dv/src/sys/arch/amd64/compile/GENERIC.MP > > Architecture: OpenBSD.amd64 > Machine : amd64 > >Description: > > Was running a vmm test on some dual-socket intel xeon hardware with > Witness enabled when I hit this panic. I've hit it now twice with the > same panic from the reaper tearing down uvm maps. > > This is using a kernel built locally (because of Witness) where the last > commit was Wed Jun 5 13:36:28 2024 UTC. > > Abbreviated backtrace from prior to witness_checkorder on CPU 4: > > rw_enter_read(...) at +0x50 > uvmfault_lookup(..., 0) at +0x8a > uvm_fault_check(...) at +0x36 > uvm_fault(0xffffffff827d1558, 0x80010000, 0, 1) at +0xfb > kpageflttrap(0xffff8000594811f0, 0x80010039) at +0x158 > kerntrap() at +0xaf > alltraps_kern_meltdown() at +0x7b > pmap_remove_ptes(...) at +0x16e > pmap_do_remove(...) at +0x2db > uvm_unmap_kill_entry_withlock(..., ..., 0) at +0x14b > uvm_map_teardown(...) at +0x1c4
So somehow pmap_remove_ptes() is accessing a (likely bogus) userland address here. That shouldn't happen; I suspect your page tables are corrupt. If your system supported SMAP you would have seen a "attempt to access user address 0x80010039 in supervisor mode" panic. But your system doesn't. So you go down an unexpected error path with a mutex held, with the witness panic as a consequence. This probably would have produced a: "uvm_fault(...) -> ..." panic on a non-witness kernel. > "show all locks" output: > > CPU 4: > exclusive mutex &(curpg)->mdpage.pv_mtx > exclusive mutex &pmap->pm_mtx > Process 45917 (reaper) thread ... > exclusive rwlock vmmaplk > exclusive mutex &(curpg)->mdpage.pv_mtx > exclusive mutex &pmap->pm_mtx > > "show all procs /o" output abbreviated: > uid cpu command > 107 12 vmd > 0 4 reaper > 0 6 softnet0 > 0 0 softclock > > > >How-To-Repeat: > > I've been trying to isolate (unrelated?) amap and anon pool corruption > caused by vmm on dual-socket Intel hardware. I'm booting ramdisk kernels > and disk-based vms, letting them boot a bit, and tearing them down. > > >Fix: > ??? > > dmesg: > OpenBSD 7.5-current (GENERIC.MP) #5: Wed Jun 5 20:07:42 CEST 2024 > > dv@current1.openbsd.amsterdam:/home/dv/src/sys/arch/amd64/compile/GENERIC.MP > real mem = 412202078208 (393106MB) > avail mem = 396673601536 (378297MB) > random: good seed from bootblocks > mpath0 at root > scsibus0 at mpath0: 256 targets > mainbus0 at root > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x7a32f000 (77 entries) > bios0: vendor Dell Inc. version "2.19.0" date 12/12/2023 > bios0: Dell Inc. PowerEdge R630 > acpi0 at bios0: ACPI 4.0 > acpi0: sleep states S0 S5 > acpi0: tables DSDT FACP MCEJ WD__ SLIC HPET APIC MCFG MSCT SLIT SRAT SSDT > SSDT SSDT PRAD DMAR HEST BERT ERST EINJ > acpi0: wakeup devices PCI0(S4) BR1A(S4) BR1B(S4) BR2A(S4) BR2B(S4) BR2C(S4) > BR2D(S4) BR3A(S4) BR3B(S4) BR3C(S4) BR3D(S4) XHC_(S0) RP02(S4) RP03(S4) > RP05(S4) RP08(S4) [...] > acpitimer0 at acpi0: 3579545 Hz, 24 bits > acpihpet0 at acpi0: 14318179 Hz > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat > cpu0 at mainbus0: apid 0 (boot processor) > cpu0: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.02 MHz, 06-3f-02, patch > 00000049 > cpu0: cpuid 1 > edx=bfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > > ecx=77fefbff<SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND> > cpu0: cpuid 6 eax=77<SENSOR,ARAT> ecx=9<EFFFREQ> > cpu0: cpuid 7.0 > ebx=37ab<FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM> > edx=9c000400<MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD> > cpu0: cpuid a vers=3, gp=4, gpwidth=48, ff=3, ffwidth=48 > cpu0: cpuid d.1 eax=1<XSAVEOPT> > cpu0: cpuid 80000001 edx=2c100800<NXE,PAGE1GB,RDTSCP,LONG> ecx=21<LAHF,ABM> > cpu0: cpuid 80000007 edx=100<ITSC> > cpu0: MELTDOWN > cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB > 64b/line 8-way L2 cache, 20MB 64b/line 20-way L3 cache > cpu0: smt 0, core 0, package 0 > mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges > cpu0: apic clock running at 99MHz > cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE > cpu1 at mainbus0: apid 16 (application processor) > cpu1: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.40 MHz, 06-3f-02, patch > 00000049 > cpu1: smt 0, core 0, package 1 > cpu2 at mainbus0: apid 2 (application processor) > cpu2: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.05 MHz, 06-3f-02, patch > 00000049 > cpu2: smt 0, core 1, package 0 > cpu3 at mainbus0: apid 18 (application processor) > cpu3: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2401.63 MHz, 06-3f-02, patch > 00000049 > cpu3: smt 0, core 1, package 1 > cpu4 at mainbus0: apid 4 (application processor) > cpu4: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.08 MHz, 06-3f-02, patch > 00000049 > cpu4: smt 0, core 2, package 0 > cpu5 at mainbus0: apid 20 (application processor) > cpu5: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.05 MHz, 06-3f-02, patch > 00000049 > cpu5: smt 0, core 2, package 1 > cpu6 at mainbus0: apid 6 (application processor) > cpu6: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.12 MHz, 06-3f-02, patch > 00000049 > cpu6: smt 0, core 3, package 0 > cpu7 at mainbus0: apid 22 (application processor) > cpu7: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.10 MHz, 06-3f-02, patch > 00000049 > cpu7: smt 0, core 3, package 1 > cpu8 at mainbus0: apid 8 (application processor) > cpu8: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2401.21 MHz, 06-3f-02, patch > 00000049 > cpu8: smt 0, core 4, package 0 > cpu9 at mainbus0: apid 24 (application processor) > cpu9: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.20 MHz, 06-3f-02, patch > 00000049 > cpu9: smt 0, core 4, package 1 > cpu10 at mainbus0: apid 10 (application processor) > cpu10: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.66 MHz, 06-3f-02, > patch 00000049 > cpu10: smt 0, core 5, package 0 > cpu11 at mainbus0: apid 26 (application processor) > cpu11: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.18 MHz, 06-3f-02, > patch 00000049 > cpu11: smt 0, core 5, package 1 > cpu12 at mainbus0: apid 12 (application processor) > cpu12: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2401.58 MHz, 06-3f-02, > patch 00000049 > cpu12: smt 0, core 6, package 0 > cpu13 at mainbus0: apid 28 (application processor) > cpu13: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.98 MHz, 06-3f-02, > patch 00000049 > cpu13: smt 0, core 6, package 1 > cpu14 at mainbus0: apid 14 (application processor) > cpu14: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2401.41 MHz, 06-3f-02, > patch 00000049 > cpu14: smt 0, core 7, package 0 > cpu15 at mainbus0: apid 30 (application processor) > cpu15: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.39 MHz, 06-3f-02, > patch 00000049 > cpu15: smt 0, core 7, package 1 > cpu16 at mainbus0: apid 1 (application processor) > cpu16: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.44 MHz, 06-3f-02, > patch 00000049 > cpu16: smt 1, core 0, package 0 > cpu17 at mainbus0: apid 17 (application processor) > cpu17: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.59 MHz, 06-3f-02, > patch 00000049 > cpu17: smt 1, core 0, package 1 > cpu18 at mainbus0: apid 3 (application processor) > cpu18: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.63 MHz, 06-3f-02, > patch 00000049 > cpu18: smt 1, core 1, package 0 > cpu19 at mainbus0: apid 19 (application processor) > cpu19: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.29 MHz, 06-3f-02, > patch 00000049 > cpu19: smt 1, core 1, package 1 > cpu20 at mainbus0: apid 5 (application processor) > cpu20: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.59 MHz, 06-3f-02, > patch 00000049 > cpu20: smt 1, core 2, package 0 > cpu21 at mainbus0: apid 21 (application processor) > cpu21: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.79 MHz, 06-3f-02, > patch 00000049 > cpu21: smt 1, core 2, package 1 > cpu22 at mainbus0: apid 7 (application processor) > cpu22: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.52 MHz, 06-3f-02, > patch 00000049 > cpu22: smt 1, core 3, package 0 > cpu23 at mainbus0: apid 23 (application processor) > cpu23: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.23 MHz, 06-3f-02, > patch 00000049 > cpu23: smt 1, core 3, package 1 > cpu24 at mainbus0: apid 9 (application processor) > cpu24: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.31 MHz, 06-3f-02, > patch 00000049 > cpu24: smt 1, core 4, package 0 > cpu25 at mainbus0: apid 25 (application processor) > cpu25: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2402.23 MHz, 06-3f-02, > patch 00000049 > cpu25: smt 1, core 4, package 1 > cpu26 at mainbus0: apid 11 (application processor) > cpu26: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.53 MHz, 06-3f-02, > patch 00000049 > cpu26: smt 1, core 5, package 0 > cpu27 at mainbus0: apid 27 (application processor) > cpu27: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.28 MHz, 06-3f-02, > patch 00000049 > cpu27: smt 1, core 5, package 1 > cpu28 at mainbus0: apid 13 (application processor) > cpu28: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.57 MHz, 06-3f-02, > patch 00000049 > cpu28: smt 1, core 6, package 0 > cpu29 at mainbus0: apid 29 (application processor) > cpu29: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.82 MHz, 06-3f-02, > patch 00000049 > cpu29: smt 1, core 6, package 1 > cpu30 at mainbus0: apid 15 (application processor) > cpu30: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.81 MHz, 06-3f-02, > patch 00000049 > cpu30: smt 1, core 7, package 0 > cpu31 at mainbus0: apid 31 (application processor) > cpu31: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz, 2400.36 MHz, 06-3f-02, > patch 00000049 > cpu31: smt 1, core 7, package 1 > ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins > ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins > ioapic2 at mainbus0: apid 10 pa 0xfec40000, version 20, 24 pins > acpimadt0: unknown apic structure type 7f > acpimadt0: unknown apic structure type 7f > acpimcfg0 at acpi0 > acpimcfg0: addr 0x80000000, bus 0-255 > acpiprt0 at acpi0: bus 255 (UNC1) > acpiprt1 at acpi0: bus 127 (UNC0) > acpiprt2 at acpi0: bus 0 (PCI0) > acpiprt3 at acpi0: bus 2 (BR1A) > acpiprt4 at acpi0: bus -1 (BR1B) > acpiprt5 at acpi0: bus 3 (BR2A) > acpiprt6 at acpi0: bus -1 (BR2B) > acpiprt7 at acpi0: bus -1 (BR2C) > acpiprt8 at acpi0: bus -1 (BR2D) > acpiprt9 at acpi0: bus 1 (BR3A) > acpiprt10 at acpi0: bus -1 (BR3B) > acpiprt11 at acpi0: bus 4 (BR3C) > acpiprt12 at acpi0: bus -1 (BR3D) > acpiprt13 at acpi0: bus -1 (RP02) > acpiprt14 at acpi0: bus -1 (RP03) > acpiprt15 at acpi0: bus 6 (RP05) > acpiprt16 at acpi0: bus 7 (RP08) > acpiprt17 at acpi0: bus 128 (PCI1) > acpiprt18 at acpi0: bus -1 (QRP0) > acpiprt19 at acpi0: bus 129 (QR1A) > acpiprt20 at acpi0: bus -1 (QR1B) > acpiprt21 at acpi0: bus -1 (QR2A) > acpiprt22 at acpi0: bus -1 (QR2B) > acpiprt23 at acpi0: bus -1 (QR2C) > acpiprt24 at acpi0: bus -1 (QR2D) > acpiprt25 at acpi0: bus 130 (QR3A) > acpiprt26 at acpi0: bus -1 (QR3B) > acpiprt27 at acpi0: bus -1 (QR3C) > acpiprt28 at acpi0: bus -1 (QR3D) > acpipci0 at acpi0 UNC1: 0x00000000 0x00000011 0x00000001 > acpipci1 at acpi0 UNC0: 0x00000010 0x00000011 0x00000000 > "ACPI0004" at acpi0 not configured > "ACPI0004" at acpi0 not configured > "PNP0C33" at acpi0 not configured > "PNP0C14" at acpi0 not configured > acpipci2 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001 > "PNP0003" at acpi0 not configured > "PNP0C14" at acpi0 not configured > acpicmos0 at acpi0 > com1 at acpi0 COMA addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo > com0 at acpi0 COMB addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo > acpipci3 at acpi0 PCI1: 0x00000000 0x00000011 0x00000001 > acpicpu0 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu1 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu2 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu3 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu4 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu5 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu6 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu7 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu8 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu9 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu10 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu11 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu12 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu13 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu14 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu15 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu16 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu17 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu18 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu19 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu20 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu21 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu22 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu23 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu24 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu25 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu26 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu27 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu28 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu29 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu30 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > acpicpu31 at acpi0: C2(350@41 mwait.3@0x20), C1(1000@1 mwait.1) > ipmi at mainbus0 not configured > cpu0: using VERW MDS workaround (except on vmm entry) > pci0 at mainbus0 bus 255 > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 3 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 3 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 0 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 1 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 0 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 1 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 3 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 4 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 5 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 6 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 7 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 0 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 1 not configured > "Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 4 not configured > "Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 5 not configured > "Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 6 not configured > "Intel E5 v3 PCIE Ring" rev 0x02 at pci0 dev 16 function 0 not configured > "Intel E5 v3 PCIE Monitor" rev 0x02 at pci0 dev 16 function 1 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 5 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 6 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 7 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 0 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 1 not configured > "Intel E5 v3 Home Agent Debug" rev 0x02 at pci0 dev 18 function 2 not > configured > "Intel E5 v3 Memory" rev 0x02 at pci0 dev 19 function 0 not configured > "Intel E5 v3 RAS" rev 0x02 at pci0 dev 19 function 1 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 2 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 3 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 4 not configured > "Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 5 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 3 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 3 not configured > "Intel E5 v3 TA" rev 0x02 at pci0 dev 22 function 0 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci0 dev 23 function 0 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 7 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 0 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 1 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 2 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 3 not configured > "Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 4 not configured > "Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 0 not configured > "Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 2 not configured > pci1 at mainbus0 bus 127 > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 3 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 0 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 2 not configured > "Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 3 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 0 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 1 not configured > "Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 0 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 1 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 2 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 3 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 4 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 5 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 6 not configured > "Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 7 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 0 not configured > "Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 1 not configured > "Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 4 not configured > "Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 5 not configured > "Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 6 not configured > "Intel E5 v3 PCIE Ring" rev 0x02 at pci1 dev 16 function 0 not configured > "Intel E5 v3 PCIE Monitor" rev 0x02 at pci1 dev 16 function 1 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 5 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 6 not configured > "Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 7 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 0 not configured > "Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 1 not configured > "Intel E5 v3 Home Agent Debug" rev 0x02 at pci1 dev 18 function 2 not > configured > "Intel E5 v3 Memory" rev 0x02 at pci1 dev 19 function 0 not configured > "Intel E5 v3 RAS" rev 0x02 at pci1 dev 19 function 1 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 2 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 3 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 4 not configured > "Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 5 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 3 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 0 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 1 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 2 not configured > "Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 3 not configured > "Intel E5 v3 TA" rev 0x02 at pci1 dev 22 function 0 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 6 not configured > "Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 7 not configured > "Intel E5 v3 Thermal" rev 0x02 at pci1 dev 23 function 0 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 4 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 5 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 6 not configured > "Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 7 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 0 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 1 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 2 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 3 not configured > "Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 4 not configured > "Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 0 not configured > "Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 2 not configured > pci2 at mainbus0 bus 0 > pchb0 at pci2 dev 0 function 0 "Intel E5 v3 Host" rev 0x02 > ppb0 at pci2 dev 1 function 0 "Intel E5 v3 PCIE" rev 0x02 > pci3 at ppb0 bus 2 > mfii0 at pci3 dev 0 function 0 "Symbios Logic MegaRAID SAS3108" rev 0x02: msi > mfii0: "PERC H730 Mini", firmware 25.5.9.0001, 1024MB cache > scsibus1 at mfii0: 64 targets > sd0 at scsibus1 targ 0 lun 0: <DELL, PERC H730 Mini, 4.30> > naa.6b083fe0e59859002c89ecc00529c1c7 > sd0: 139392MB, 512 bytes/sector, 285474816 sectors > sd1 at scsibus1 targ 1 lun 0: <DELL, PERC H730 Mini, 4.30> > naa.6b083fe0e59859002c89ecc905b44d92 > sd1: 857856MB, 512 bytes/sector, 1756889088 sectors > scsibus2 at mfii0: 256 targets > ppb1 at pci2 dev 2 function 0 "Intel E5 v3 PCIE" rev 0x02: msi > pci4 at ppb1 bus 3 > ppb2 at pci2 dev 3 function 0 "Intel E5 v3 PCIE" rev 0x02 > pci5 at ppb2 bus 1 > ix0 at pci5 dev 0 function 0 "Intel X540T" rev 0x01, msix, 16 queues, address > ec:f4:bb:cb:3d:c8 > ix1 at pci5 dev 0 function 1 "Intel X540T" rev 0x01, msix, 16 queues, address > ec:f4:bb:cb:3d:ca > ppb3 at pci2 dev 3 function 2 "Intel E5 v3 PCIE" rev 0x02 > pci6 at ppb3 bus 4 > "Intel E5 v3 Address Map" rev 0x02 at pci2 dev 5 function 0 not configured > "Intel E5 v3 Hot Plug" rev 0x02 at pci2 dev 5 function 1 not configured > "Intel E5 v3 Error Reporting" rev 0x02 at pci2 dev 5 function 2 not configured > "Intel E5 v3 I/O APIC" rev 0x02 at pci2 dev 5 function 4 not configured > "Intel C610 MS SPSR" rev 0x05 at pci2 dev 17 function 0 not configured > ahci0 at pci2 dev 17 function 4 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3 > scsibus3 at ahci0: 32 targets > "Intel C610 MEI" rev 0x05 at pci2 dev 22 function 0 not configured > "Intel C610 MEI" rev 0x05 at pci2 dev 22 function 1 not configured > ehci0 at pci2 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18 > usb0 at ehci0: USB revision 2.0 > uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 > addr 1 > ppb4 at pci2 dev 28 function 0 "Intel C610 PCIE" rev 0xd5 > pci7 at ppb4 bus 5 > ppb5 at pci2 dev 28 function 4 "Intel C610 PCIE" rev 0xd5: msi > pci8 at ppb5 bus 6 > em0 at pci8 dev 0 function 0 "Intel I350" rev 0x01: msi, address > ec:f4:bb:cb:3d:cc > em1 at pci8 dev 0 function 1 "Intel I350" rev 0x01: msi, address > ec:f4:bb:cb:3d:cd > ppb6 at pci2 dev 28 function 7 "Intel C610 PCIE" rev 0xd5: msi > pci9 at ppb6 bus 7 > ppb7 at pci9 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00 > pci10 at ppb7 bus 8 > ppb8 at pci10 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00 > pci11 at ppb8 bus 9 > ppb9 at pci11 dev 0 function 0 "Renesas SH7758 PCIE-PCI" rev 0x00 > pci12 at ppb9 bus 10 > vga1 at pci12 dev 0 function 0 "Matrox MGA G200eR" rev 0x01 > wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) > wsdisplay0: screen 1-5 added (80x25, vt100 emulation) > ehci1 at pci2 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18 > usb1 at ehci1: USB revision 2.0 > uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev 2.00/1.00 > addr 1 > pcib0 at pci2 dev 31 function 0 "Intel C610 LPC" rev 0x05 > ahci1 at pci2 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3 > scsibus4 at ahci1: 32 targets > isa0 at pcib0 > isadma0 at isa0 > pckbc0 at isa0 port 0x60/5 irq 1 irq 12 > pcppi0 at isa0 port 0x61 > spkr0 at pcppi0 > pci13 at mainbus0 bus 128 > ppb10 at pci13 dev 1 function 0 "Intel E5 v3 PCIE" rev 0x02: msi > pci14 at ppb10 bus 129 > ppb11 at pci13 dev 3 function 0 "Intel E5 v3 PCIE" rev 0x02: msi > pci15 at ppb11 bus 130 > "Intel E5 v3 Address Map" rev 0x02 at pci13 dev 5 function 0 not configured > "Intel E5 v3 Hot Plug" rev 0x02 at pci13 dev 5 function 1 not configured > "Intel E5 v3 Error Reporting" rev 0x02 at pci13 dev 5 function 2 not > configured > "Intel E5 v3 I/O APIC" rev 0x02 at pci13 dev 5 function 4 not configured > vmm0 at mainbus0: VMX/EPT > uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" > rev 2.00/0.05 addr 2 > uhub3 at uhub2 port 6 configuration 1 interface 0 "no manufacturer Gadget USB > HUB" rev 2.00/0.00 addr 3 > uhidev0 at uhub3 port 1 configuration 1 interface 0 "Avocent Keyboard/Mouse > Function" rev 2.00/0.00 addr 4 > uhidev0: iclass 3/1 > ukbd0 at uhidev0: 8 variable keys, 6 key codes > wskbd0 at ukbd0: console keyboard, using wsdisplay0 > uhidev1 at uhub3 port 1 configuration 1 interface 1 "Avocent Keyboard/Mouse > Function" rev 2.00/0.00 addr 4 > uhidev1: iclass 3/1 > ums0 at uhidev1: 3 buttons, Z dir > wsmouse0 at ums0 mux 0 > uhidev2 at uhub3 port 1 configuration 1 interface 2 "Avocent Keyboard/Mouse > Function" rev 2.00/0.00 addr 4 > uhidev2: iclass 3/1 > ums1 at uhidev2: 3 buttons, Z dir > wsmouse1 at ums1 mux 0 > umass0 at uhub3 port 5 configuration 1 interface 0 "Avocent Mass Storage > Function" rev 2.00/0.00 addr 5 > umass0: using SCSI over Bulk-Only > scsibus5 at umass0: 2 targets, initiator 0 > cd0 at scsibus5 targ 1 lun 0: <iDRAC, OBSD75, 0329> removable > uhub4 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub" > rev 2.00/0.05 addr 2 > vscsi0 at root > scsibus6 at vscsi0: 256 targets > softraid0 at root > scsibus7 at softraid0: 256 targets > root on sd0a (ebe9acee5d9eb3f5.a) swap on sd0b dump on sd0b > ukbd0: was console keyboard > wskbd0 detached > ukbd0 detached > uhidev0 detached > wsmouse0 detached > ums0 detached > uhidev1 detached > wsmouse1 detached > ums1 detached > uhidev2 detached > WARNING: / was not properly unmounted > uhidev0 at uhub3 port 1 configuration 1 interface 0 "Avocent Keyboard/Mouse > Function" rev 2.00/0.00 addr 4 > uhidev0: iclass 3/1 > ukbd0 at uhidev0: 8 variable keys, 6 key codes > wskbd0 at ukbd0: console keyboard, using wsdisplay0 > uhidev1 at uhub3 port 1 configuration 1 interface 1 "Avocent Keyboard/Mouse > Function" rev 2.00/0.00 addr 4 > uhidev1: iclass 3/1 > ums0 at uhidev1: 3 buttons, Z dir > wsmouse0 at ums0 mux 0 > uhidev2 at uhub3 port 1 configuration 1 interface 2 "Avocent Keyboard/Mouse > Function" rev 2.00/0.00 addr 4 > uhidev2: iclass 3/1 > ums1 at uhidev2: 3 buttons, Z dir > wsmouse1 at ums1 mux 0 > >
