Hi, one machine I'm testing NetBSD on feels sort of sluggish, which is strange because it's got lots of RAM (128GB) and a pair of Xeon(R) CPU E5-2650 CPUs, for a total of 16 physical cores and 32 with hyperthreading.
It looks like one of the CPUs is using most of its time doing interrupt processing, "systat vm" often shows ***** in "Intr" and I have a constant buzz of 6.3% System CPU: Proc:r d s Csw Traps SysCal Intr Soft Fault PAGING SWAPPING 1 7 557 281 355 ***** 64 277 in out in out ops 6.3% Sy 0.0% Us 0.0% Ni 0.1% In 93.6% Id pages | | | | | | | | | | | === 2 forks 2 fkppw Checking further: stest: {8} vmstat -i interrupt total rate TLB shootdown 4677209 0 cpu0 timer 1046424629 99 msix2 vec 0 62702425 5 msix6 vec 0 3294854 0 ioapic0 pin 21 84 0 ioapic0 pin 20 21074226 2 ioapic0 pin 17 3344590700017 319462 ioapic0 pin 4 12722 0 Total 3345728886166 319570 stest: {9} grep 'ioapic0 pin 17' /var/run/dmesg.boot pciide0: using ioapic0 pin 17 for native-PCI interrupt stest: {10} pciide0 only has the built-in CD drive, if I see correctly. Full dmesg attached below. Any hints about what's going on and how to further diagnose and eventually cure it? Regards, - HÃ¥vard
Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021 The NetBSD Foundation, Inc. All rights reserved. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. NetBSD 9.99.81 (GENERIC) #2: Wed May 5 11:59:20 UTC 2021 h...@stest.urc.uninett.no:/usr/obj/sys/arch/amd64/compile/GENERIC total memory = 127 GB avail memory = 123 GB entropy: entering seed from bootloader with 256 bits of entropy entropy: ready timecounter: Timecounters tick every 10.000 msec Kernelized RAIDframe activated timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100 HP ProLiant DL380p Gen8 mainbus0 (root) ACPI: RSDP 0x00000000000F4F00 000024 (v02 HP ) ACPI: XSDT 0x00000000BDDAED00 0000EC (v01 HP ProLiant 00000002 ?? 0000162E) ACPI: FACP 0x00000000BDDAEE40 0000F4 (v03 HP ProLiant 00000002 ?? 0000162E) Firmware Warning (ACPI): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20210331/tbfadt-742) Firmware Warning (ACPI): Invalid length for FADT/Pm2ControlBlock: 32, using default 8 (20210331/tbfadt-742) ACPI: DSDT 0x00000000BDDAEF40 0026DC (v01 HP DSDT 00000001 INTL 20030228) ACPI: FACS 0x00000000BDDAC140 000040 ACPI: SPCR 0x00000000BDDAC180 000050 (v01 HP SPCRRBSU 00000001 ?? 0000162E) ACPI: MCFG 0x00000000BDDAC200 00003C (v01 HP ProLiant 00000001 00000000) ACPI: HPET 0x00000000BDDAC240 000038 (v01 HP ProLiant 00000002 ?? 0000162E) ACPI: FFFF 0x00000000BDDAC280 000064 (v02 HP ProLiant 00000002 ?? 0000162E) ACPI: SPMI 0x00000000BDDAC300 000040 (v05 HP ProLiant 00000001 ?? 0000162E) ACPI: FFFF 0x00000000BDDAC340 000230 (v01 HP ProLiant 00000001 ?? 0000162E) ACPI: APIC 0x00000000BDDAC580 00026A (v01 HP ProLiant 00000002 00000000) ACPI: SRAT 0x00000000BDDAC800 000750 (v01 HP Proliant 00000001 ?? 0000162E) ACPI: FFFF 0x00000000BDDACF80 000176 (v01 HP ProLiant 00000001 ?? 0000162E) ACPI: FFFF 0x00000000BDDAD100 000030 (v01 HP ProLiant 00000001 ?? 0000162E) ACPI: FFFF 0x00000000BDDAD140 0000BC (v01 HP ProLiant 00000001 ?? 0000162E) ACPI: DMAR 0x00000000BDDAD200 000558 (v01 HP ProLiant 00000001 ?? 0000162E) ACPI: FFFF 0x00000000BDDAEC40 000030 (v01 HP ProLiant 00000001 00000000) ACPI: PCCT 0x00000000BDDAEC80 00006E (v01 HP Proliant 00000001 PH 0000504D) ACPI: SSDT 0x00000000BDDB1640 0007EA (v01 HP DEV_PCI1 00000001 INTL 20120503) ACPI: SSDT 0x00000000BDDB1E40 000103 (v03 HP CRSPCI0 00000002 HP 00000001) ACPI: SSDT 0x00000000BDDB1F80 000098 (v03 HP CRSPCI1 00000002 HP 00000001) ACPI: SSDT 0x00000000BDDB2040 00038A (v02 HP riser0 00000002 INTL 20030228) ACPI: SSDT 0x00000000BDDB2400 000536 (v03 HP riser1a 00000002 INTL 20030228) ACPI: SSDT 0x00000000BDDB2940 000537 (v03 HP riser2a 00000002 INTL 20030228) ACPI: SSDT 0x00000000BDDB2E80 000BB9 (v01 HP pcc 00000001 INTL 20120503) ACPI: SSDT 0x00000000BDDB3A40 000377 (v01 HP pmab 00000001 INTL 20120503) ACPI: SSDT 0x00000000BDDB3DC0 005524 (v01 HP pcc2 00000001 INTL 20120503) ACPI: SSDT 0x00000000BDDB9300 004604 (v01 INTEL PPM RCM 00000001 INTL 20061109) ACPI: 11 ACPI AML tables successfully acquired and loaded ioapic0 at mainbus0 apid 8: pa 0xfec00000, version 0x20, 24 pins ioapic1 at mainbus0 apid 0: pa 0xfec10000, version 0x20, 24 pins ioapic2 at mainbus0 apid 10: pa 0xfec40000, version 0x20, 24 pins x2APIC available but disabled by DMAR table cpu0 at mainbus0 apid 0 cpu0: Use lfence to serialize rdtsc cpu0: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu0: node 0, package 0, core 0, smt 0 cpu1 at mainbus0 apid 2 cpu1: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu1: node 0, package 0, core 1, smt 0 cpu2 at mainbus0 apid 4 cpu2: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu2: node 0, package 0, core 2, smt 0 cpu3 at mainbus0 apid 6 cpu3: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu3: node 0, package 0, core 3, smt 0 cpu4 at mainbus0 apid 8 cpu4: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu4: node 0, package 0, core 4, smt 0 cpu5 at mainbus0 apid 10 cpu5: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu5: node 0, package 0, core 5, smt 0 cpu6 at mainbus0 apid 12 cpu6: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu6: node 0, package 0, core 6, smt 0 cpu7 at mainbus0 apid 14 cpu7: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu7: node 0, package 0, core 7, smt 0 cpu8 at mainbus0 apid 32 cpu8: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu8: node 1, package 1, core 0, smt 0 cpu9 at mainbus0 apid 34 cpu9: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu9: node 1, package 1, core 1, smt 0 cpu10 at mainbus0 apid 36 cpu10: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu10: node 1, package 1, core 2, smt 0 cpu11 at mainbus0 apid 38 cpu11: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu11: node 1, package 1, core 3, smt 0 cpu12 at mainbus0 apid 40 cpu12: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu12: node 1, package 1, core 4, smt 0 cpu13 at mainbus0 apid 42 cpu13: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu13: node 1, package 1, core 5, smt 0 cpu14 at mainbus0 apid 44 cpu14: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu14: node 1, package 1, core 6, smt 0 cpu15 at mainbus0 apid 46 cpu15: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu15: node 1, package 1, core 7, smt 0 cpu16 at mainbus0 apid 1 cpu16: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu16: node 0, package 0, core 0, smt 1 cpu17 at mainbus0 apid 3 cpu17: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu17: node 0, package 0, core 1, smt 1 cpu18 at mainbus0 apid 5 cpu18: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu18: node 0, package 0, core 2, smt 1 cpu19 at mainbus0 apid 7 cpu19: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu19: node 0, package 0, core 3, smt 1 cpu20 at mainbus0 apid 9 cpu20: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu20: node 0, package 0, core 4, smt 1 cpu21 at mainbus0 apid 11 cpu21: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu21: node 0, package 0, core 5, smt 1 cpu22 at mainbus0 apid 13 cpu22: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu22: node 0, package 0, core 6, smt 1 cpu23 at mainbus0 apid 15 cpu23: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu23: node 0, package 0, core 7, smt 1 cpu24 at mainbus0 apid 33 cpu24: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu24: node 1, package 1, core 0, smt 1 cpu25 at mainbus0 apid 35 cpu25: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu25: node 1, package 1, core 1, smt 1 cpu26 at mainbus0 apid 37 cpu26: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu26: node 1, package 1, core 2, smt 1 cpu27 at mainbus0 apid 39 cpu27: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu27: node 1, package 1, core 3, smt 1 cpu28 at mainbus0 apid 41 cpu28: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu28: node 1, package 1, core 4, smt 1 cpu29 at mainbus0 apid 43 cpu29: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu29: node 1, package 1, core 5, smt 1 cpu30 at mainbus0 apid 45 cpu30: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu30: node 1, package 1, core 6, smt 1 cpu31 at mainbus0 apid 47 cpu31: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz, id 0x206d7 cpu31: node 1, package 1, core 7, smt 1 acpi0 at mainbus0: Intel ACPICA 20210331 acpi0: X/RSDT: OemId <HP ,ProLiant,00000002>, AslId < <2147483602>^D,0000162e> acpi0: MCFG: segment 0, bus 0-255, address 0x00000000c0000000 acpi0: SCI interrupting at int 9 acpi0: fixed power button present timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000 hpet0 at acpi0: high precision event timer (mem 0xfed00000-0xfed00400) timecounter: Timecounter "hpet0" frequency 14318180 Hz quality 2000 ipmi_acpi0 at acpi0 (MI0, IPI0001-0): io 0xca2-0xca3 ipmi0 at ipmi_acpi0 attimer1 at acpi0 (TIME, PNP0100): io 0x40-0x43 irq 0 pcppi1 at acpi0 (BEEP, PNP0800): io 0x61 spkr0 at pcppi1: PC Speaker wsbell at spkr0 not configured midi0 at pcppi1: PC speaker sysbeep0 at pcppi1 COMA (PNP0501) at acpi0 not configured pckbc1 at acpi0 (KBD, PNP0303) (kbd port): io 0x60,0x64 irq 1 pckbc2 at acpi0 (PS2M, PNP0F13) (aux port): irq 12 PMI0 (ACPI000D) at acpi0 not configured acpitz0 at acpi0 (THM0): cpu0 acpitz0: levels: critical 31.3 C, passive 9.8 C, passive cooling attimer1: attached to pcppi1 pckbd0 at pckbc1 (kbd slot) pckbc1: using irq 1 for kbd slot wskbd0 at pckbd0 mux 1 pms0 at pckbc1 (aux slot) pckbc1: using irq 12 for aux slot wsmouse0 at pms0 mux 0 pci0 at mainbus0 bus 0: configuration mode 1 pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok pchb0 at pci0 dev 0 function 0: Intel E5 Host (rev. 0x07) ppb0 at pci0 dev 1 function 0: Intel E5 PCIe x8 or x4 (rev. 0x07) ppb0: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s ppb0: link is x8 @ 5.0GT/s pci1 at ppb0 bus 7 pci1: i/o space, memory space enabled, rd/line, wr/inv ok ixg0 at pci1 dev 0 function 0: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 4.0.1-k ixg0: clearing prefetchable bit ixg0: device 82599EB ixg0: ETrackID 80000208 ixg0: for TX/RX, interrupting at msix0 vec 0, bound queue 0 to cpu 0 ixg0: for TX/RX, interrupting at msix0 vec 1, bound queue 1 to cpu 1 ixg0: for TX/RX, interrupting at msix0 vec 2, bound queue 2 to cpu 2 ixg0: for TX/RX, interrupting at msix0 vec 3, bound queue 3 to cpu 3 ixg0: for TX/RX, interrupting at msix0 vec 4, bound queue 4 to cpu 4 ixg0: for TX/RX, interrupting at msix0 vec 5, bound queue 5 to cpu 5 ixg0: for TX/RX, interrupting at msix0 vec 6, bound queue 6 to cpu 6 ixg0: for TX/RX, interrupting at msix0 vec 7, bound queue 7 to cpu 7 ixg0: for TX/RX, interrupting at msix0 vec 8, bound queue 8 to cpu 8 ixg0: for TX/RX, interrupting at msix0 vec 9, bound queue 9 to cpu 9 ixg0: for TX/RX, interrupting at msix0 vec 10, bound queue 10 to cpu 10 ixg0: for TX/RX, interrupting at msix0 vec 11, bound queue 11 to cpu 11 ixg0: for TX/RX, interrupting at msix0 vec 12, bound queue 12 to cpu 12 ixg0: for TX/RX, interrupting at msix0 vec 13, bound queue 13 to cpu 13 ixg0: for TX/RX, interrupting at msix0 vec 14, bound queue 14 to cpu 14 ixg0: for TX/RX, interrupting at msix0 vec 15, bound queue 15 to cpu 15 ixg0: for TX/RX, interrupting at msix0 vec 16, bound queue 16 to cpu 16 ixg0: for TX/RX, interrupting at msix0 vec 17, bound queue 17 to cpu 17 ixg0: for TX/RX, interrupting at msix0 vec 18, bound queue 18 to cpu 18 ixg0: for TX/RX, interrupting at msix0 vec 19, bound queue 19 to cpu 19 ixg0: for TX/RX, interrupting at msix0 vec 20, bound queue 20 to cpu 20 ixg0: for TX/RX, interrupting at msix0 vec 21, bound queue 21 to cpu 21 ixg0: for TX/RX, interrupting at msix0 vec 22, bound queue 22 to cpu 22 ixg0: for TX/RX, interrupting at msix0 vec 23, bound queue 23 to cpu 23 ixg0: for TX/RX, interrupting at msix0 vec 24, bound queue 24 to cpu 24 ixg0: for TX/RX, interrupting at msix0 vec 25, bound queue 25 to cpu 25 ixg0: for TX/RX, interrupting at msix0 vec 26, bound queue 26 to cpu 26 ixg0: for TX/RX, interrupting at msix0 vec 27, bound queue 27 to cpu 27 ixg0: for TX/RX, interrupting at msix0 vec 28, bound queue 28 to cpu 28 ixg0: for TX/RX, interrupting at msix0 vec 29, bound queue 29 to cpu 29 ixg0: for TX/RX, interrupting at msix0 vec 30, bound queue 30 to cpu 30 ixg0: for TX/RX, interrupting at msix0 vec 31, bound queue 31 to cpu 31 ixg0: for link, interrupting at msix0 vec 32, affinity to cpu 0 ixg0: Using MSI-X interrupts with 33 vectors ixg0: Ethernet address 0c:c4:7a:1f:82:dc ixg0: PCI Express Bus: Speed 5.0GT/s Width x8 ixg0: feature cap 0x1780<LEGACY_TX,FDIR,MSI,MSIX,LEGACY_IRQ> ixg0: feature ena 0x400<MSIX> ixg1 at pci1 dev 0 function 1: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 4.0.1-k ixg1: clearing prefetchable bit ixg1: device 82599EB ixg1: ETrackID 80000208 ixg1: for TX/RX, interrupting at msix1 vec 0, bound queue 0 to cpu 0 ixg1: for TX/RX, interrupting at msix1 vec 1, bound queue 1 to cpu 1 ixg1: for TX/RX, interrupting at msix1 vec 2, bound queue 2 to cpu 2 ixg1: for TX/RX, interrupting at msix1 vec 3, bound queue 3 to cpu 3 ixg1: for TX/RX, interrupting at msix1 vec 4, bound queue 4 to cpu 4 ixg1: for TX/RX, interrupting at msix1 vec 5, bound queue 5 to cpu 5 ixg1: for TX/RX, interrupting at msix1 vec 6, bound queue 6 to cpu 6 ixg1: for TX/RX, interrupting at msix1 vec 7, bound queue 7 to cpu 7 ixg1: for TX/RX, interrupting at msix1 vec 8, bound queue 8 to cpu 8 ixg1: for TX/RX, interrupting at msix1 vec 9, bound queue 9 to cpu 9 ixg1: for TX/RX, interrupting at msix1 vec 10, bound queue 10 to cpu 10 ixg1: for TX/RX, interrupting at msix1 vec 11, bound queue 11 to cpu 11 ixg1: for TX/RX, interrupting at msix1 vec 12, bound queue 12 to cpu 12 ixg1: for TX/RX, interrupting at msix1 vec 13, bound queue 13 to cpu 13 ixg1: for TX/RX, interrupting at msix1 vec 14, bound queue 14 to cpu 14 ixg1: for TX/RX, interrupting at msix1 vec 15, bound queue 15 to cpu 15 ixg1: for TX/RX, interrupting at msix1 vec 16, bound queue 16 to cpu 16 ixg1: for TX/RX, interrupting at msix1 vec 17, bound queue 17 to cpu 17 ixg1: for TX/RX, interrupting at msix1 vec 18, bound queue 18 to cpu 18 ixg1: for TX/RX, interrupting at msix1 vec 19, bound queue 19 to cpu 19 ixg1: for TX/RX, interrupting at msix1 vec 20, bound queue 20 to cpu 20 ixg1: for TX/RX, interrupting at msix1 vec 21, bound queue 21 to cpu 21 ixg1: for TX/RX, interrupting at msix1 vec 22, bound queue 22 to cpu 22 ixg1: for TX/RX, interrupting at msix1 vec 23, bound queue 23 to cpu 23 ixg1: for TX/RX, interrupting at msix1 vec 24, bound queue 24 to cpu 24 ixg1: for TX/RX, interrupting at msix1 vec 25, bound queue 25 to cpu 25 ixg1: for TX/RX, interrupting at msix1 vec 26, bound queue 26 to cpu 26 ixg1: for TX/RX, interrupting at msix1 vec 27, bound queue 27 to cpu 27 ixg1: for TX/RX, interrupting at msix1 vec 28, bound queue 28 to cpu 28 ixg1: for TX/RX, interrupting at msix1 vec 29, bound queue 29 to cpu 29 ixg1: for TX/RX, interrupting at msix1 vec 30, bound queue 30 to cpu 30 ixg1: for TX/RX, interrupting at msix1 vec 31, bound queue 31 to cpu 31 ixg1: for link, interrupting at msix1 vec 32, affinity to cpu 0 ixg1: Using MSI-X interrupts with 33 vectors ixg1: Ethernet address 0c:c4:7a:1f:82:dd ixg1: PCI Express Bus: Speed 5.0GT/s Width x8 ixg1: feature cap 0x1780<LEGACY_TX,FDIR,MSI,MSIX,LEGACY_IRQ> ixg1: feature ena 0x400<MSIX> ppb1 at pci0 dev 1 function 1: Intel E5 PCIe x8 or x4 (rev. 0x07) ppb1: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci2 at ppb1 bus 19 pci2: i/o space, memory space enabled, rd/line, wr/inv ok ppb2 at pci0 dev 2 function 0: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb2: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s ppb2: link is x4 @ 5.0GT/s pci3 at ppb2 bus 3 pci3: i/o space, memory space enabled, rd/line, wr/inv ok bge0 at pci3 dev 0 function 0: Broadcom BCM5719 Gigabit Ethernet bge0: APE firmware NCSI 1.0.88.0 bge0: interrupting at msix2 vec 0 bge0: HW config 002b11d4, 00006014, 0002aa08, 00000000 00000000 bge0: ASIC unknown BCM5719 (0x5719001), Ethernet address ac:16:2d:79:1c:d8 bge0: setting short Tx thresholds brgphy0 at bge0 phy 1: BCM5719C 1000BASE-T media interface, rev. 0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bge1 at pci3 dev 0 function 1: Broadcom BCM5719 Gigabit Ethernet bge1: APE firmware NCSI 1.0.88.0 bge1: interrupting at msix3 vec 0 bge1: HW config 002b11d4, 00006014, 0002aa08, 00000000 00000000 bge1: ASIC unknown BCM5719 (0x5719001), Ethernet address ac:16:2d:79:1c:d9 bge1: setting short Tx thresholds brgphy1 at bge1 phy 2: BCM5719C 1000BASE-T media interface, rev. 0 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bge2 at pci3 dev 0 function 2: Broadcom BCM5719 Gigabit Ethernet bge2: APE firmware NCSI 1.0.88.0 bge2: interrupting at msix4 vec 0 bge2: HW config 002b11d4, 00006014, 0002aa08, 00000000 00000000 bge2: ASIC unknown BCM5719 (0x5719001), Ethernet address ac:16:2d:79:1c:da bge2: setting short Tx thresholds brgphy2 at bge2 phy 3: BCM5719C 1000BASE-T media interface, rev. 0 brgphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bge3 at pci3 dev 0 function 3: Broadcom BCM5719 Gigabit Ethernet bge3: APE firmware NCSI 1.0.88.0 bge3: interrupting at msix5 vec 0 bge3: HW config 002b11d4, 00006014, 0002aa08, 00000000 00000000 bge3: ASIC unknown BCM5719 (0x5719001), Ethernet address ac:16:2d:79:1c:db bge3: setting short Tx thresholds brgphy3 at bge3 phy 4: BCM5719C 1000BASE-T media interface, rev. 0 brgphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto ppb3 at pci0 dev 2 function 1: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb3: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci4 at ppb3 bus 20 pci4: i/o space, memory space enabled, rd/line, wr/inv ok ppb4 at pci0 dev 2 function 2: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb4: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s pci5 at ppb4 bus 2 pci5: i/o space, memory space enabled, rd/line, wr/inv ok ciss0 at pci5 dev 0 function 0: HP Smart Array 12 ciss0: interrupting at msix6 vec 0 ciss0: 2 LDs, HW rev 1, FW 7.02/7.02, 64bit fifo rro, method perf 0x20000005 scsibus0 at ciss0: 2 targets, 1 lun per target ppb5 at pci0 dev 2 function 3: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb5: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci6 at ppb5 bus 21 pci6: i/o space, memory space enabled, rd/line, wr/inv ok ppb6 at pci0 dev 3 function 0: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb6: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x16 @ 8.0GT/s pci7 at ppb6 bus 4 pci7: i/o space, memory space enabled, rd/line, wr/inv ok ppb7 at pci0 dev 3 function 1: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb7: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci8 at ppb7 bus 22 pci8: i/o space, memory space enabled, rd/line, wr/inv ok ppb8 at pci0 dev 3 function 2: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb8: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci9 at ppb8 bus 23 pci9: i/o space, memory space enabled, rd/line, wr/inv ok ppb9 at pci0 dev 3 function 3: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb9: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci10 at ppb9 bus 24 pci10: i/o space, memory space enabled, rd/line, wr/inv ok Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 0 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 1 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 2 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 3 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 4 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 5 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 6 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci0 dev 4 function 7 not configured Intel E5 Address Map (miscellaneous system, revision 0x07) at pci0 dev 5 function 0 not configured Intel E5 Error Reporting (miscellaneous system, revision 0x07) at pci0 dev 5 function 2 not configured Intel E5 I/O APIC (interrupt system, IO(x) APIC, revision 0x07) at pci0 dev 5 function 4 not configured ppb10 at pci0 dev 17 function 0: Intel C600 Virtual PCIe (rev. 0x05) ppb10: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x1 @ 2.5GT/s pci11 at ppb10 bus 26 pci11: i/o space, memory space enabled, rd/line, wr/inv ok ehci0 at pci0 dev 26 function 0: Intel C600 USB (rev. 0x05) ehci0: interrupting at ioapic0 pin 21 ehci0: BIOS has given up ownership ehci0: EHCI version 1.0 usb0 at ehci0: USB revision 2.0 ppb11 at pci0 dev 28 function 0: Intel C600/X79 PCIe (rev. 0xb5) ppb11: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 5.0GT/s pci12 at ppb11 bus 10 pci12: i/o space, memory space enabled, rd/line, wr/inv ok ppb12 at pci0 dev 28 function 7: Intel C600/X79 PCIe (rev. 0xb5) ppb12: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x1 @ 5.0GT/s ppb12: link is x1 @ 2.5GT/s pci13 at ppb12 bus 1 pci13: i/o space, memory space enabled, rd/line, wr/inv ok Hewlett-Packard iLO3 Slave (miscellaneous system, revision 0x05) at pci13 dev 0 function 0 not configured vga0 at pci13 dev 0 function 1: Matrox MGA G200eH (rev. 0x00) wsdisplay0 at vga0 kbdmux 1 wsmux1: connecting to wsdisplay0 pckbd_enable: command error drm at vga0 not configured Hewlett-Packard iLO3 Management (miscellaneous system, revision 0x05) at pci13 dev 0 function 2 not configured uhci0 at pci13 dev 0 function 4: Hewlett-Packard iLO3 Virtual USB (rev. 0x02) allocated pic msi7 type edge pin 0 level 6 to cpu1 slot 2 idt entry 98 uhci0: interrupting at msi7 vec 0 usb1 at uhci0: USB revision 1.0 ehci1 at pci0 dev 29 function 0: Intel C600 USB (rev. 0x05) ehci1: interrupting at ioapic0 pin 20 ehci1: BIOS has given up ownership ehci1: EHCI version 1.0 usb2 at ehci1: USB revision 2.0 ppb13 at pci0 dev 30 function 0: Intel 82801BA Hub-PCI Bridge (rev. 0xa5) pci14 at ppb13 bus 25 pci14: i/o space, memory space enabled ichlpcib0 at pci0 dev 31 function 0: Intel C600 LPC (rev. 0x05) timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000 ichlpcib0: 24-bit timer tco0 at ichlpcib0: TCO (watchdog) timer configured. tco0: autoconfiguration error: TCO timer reboot disabled by hardware; hope SMBIOS properly handles it. tco0: Min/Max interval 1/367 seconds pciide0 at pci0 dev 31 function 2: Intel C600/X79 SATA (rev. 0x05) pciide0: bus-master DMA support present, but unused (no driver support) pciide0: primary channel configured to native-PCI mode pciide0: using ioapic0 pin 17 for native-PCI interrupt atabus0 at pciide0 channel 0 pciide0: secondary channel configured to native-PCI mode atabus1 at pciide0 channel 1 isa0 at ichlpcib0 com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, 1-byte FIFO com0: console com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, 1-byte FIFO pci15 at mainbus0 bus 32 pci15: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok ppb14 at pci15 dev 0 function 0: Intel E5 PCIe x4 (DMI2 Mode) (rev. 0x07) ppb14: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 2.5GT/s pci16 at ppb14 bus 49 pci16: i/o space, memory space enabled ppb15 at pci15 dev 1 function 0: Intel E5 PCIe x8 or x4 (rev. 0x07) ppb15: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci17 at ppb15 bus 42 pci17: i/o space, memory space enabled, rd/line, wr/inv ok ppb16 at pci15 dev 1 function 1: Intel E5 PCIe x8 or x4 (rev. 0x07) ppb16: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci18 at ppb16 bus 43 pci18: i/o space, memory space enabled, rd/line, wr/inv ok ppb17 at pci15 dev 2 function 0: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb17: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s pci19 at ppb17 bus 39 pci19: i/o space, memory space enabled, rd/line, wr/inv ok ppb18 at pci15 dev 2 function 1: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb18: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci20 at ppb18 bus 44 pci20: i/o space, memory space enabled, rd/line, wr/inv ok ppb19 at pci15 dev 2 function 2: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb19: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s pci21 at ppb19 bus 36 pci21: i/o space, memory space enabled, rd/line, wr/inv ok ppb20 at pci15 dev 2 function 3: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb20: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci22 at ppb20 bus 45 pci22: i/o space, memory space enabled, rd/line, wr/inv ok ppb21 at pci15 dev 3 function 0: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb21: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x16 @ 8.0GT/s pci23 at ppb21 bus 33 pci23: i/o space, memory space enabled, rd/line, wr/inv ok ppb22 at pci15 dev 3 function 1: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb22: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci24 at ppb22 bus 46 pci24: i/o space, memory space enabled, rd/line, wr/inv ok ppb23 at pci15 dev 3 function 2: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb23: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci25 at ppb23 bus 47 pci25: i/o space, memory space enabled, rd/line, wr/inv ok ppb24 at pci15 dev 3 function 3: Intel E5 PCIe x16, x8 or x4 (rev. 0x07) ppb24: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 8.0GT/s pci26 at ppb24 bus 48 pci26: i/o space, memory space enabled, rd/line, wr/inv ok Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 0 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 1 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 2 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 3 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 4 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 5 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 6 not configured Intel E5 DMA (miscellaneous system, revision 0x07) at pci15 dev 4 function 7 not configured Intel E5 Address Map (miscellaneous system, revision 0x07) at pci15 dev 5 function 0 not configured Intel E5 Error Reporting (miscellaneous system, revision 0x07) at pci15 dev 5 function 2 not configured Intel E5 I/O APIC (interrupt system, IO(x) APIC, revision 0x07) at pci15 dev 5 function 4 not configured acpicpu0 at cpu0: ACPI CPU acpicpu0: C1: FFH, lat 1 us, pow 1000 mW coretemp0 at cpu0: thermal sensor, 1 C resolution, Tjmax=90 acpicpu1 at cpu1: ACPI CPU coretemp1 at cpu1: thermal sensor, 1 C resolution, Tjmax=90 acpicpu2 at cpu2: ACPI CPU coretemp2 at cpu2: thermal sensor, 1 C resolution, Tjmax=90 acpicpu3 at cpu3: ACPI CPU coretemp3 at cpu3: thermal sensor, 1 C resolution, Tjmax=90 acpicpu4 at cpu4: ACPI CPU coretemp4 at cpu4: thermal sensor, 1 C resolution, Tjmax=90 acpicpu5 at cpu5: ACPI CPU coretemp5 at cpu5: thermal sensor, 1 C resolution, Tjmax=90 acpicpu6 at cpu6: ACPI CPU coretemp6 at cpu6: thermal sensor, 1 C resolution, Tjmax=90 acpicpu7 at cpu7: ACPI CPU coretemp7 at cpu7: thermal sensor, 1 C resolution, Tjmax=90 acpicpu8 at cpu8: ACPI CPU coretemp8 at cpu8: thermal sensor, 1 C resolution, Tjmax=90 acpicpu9 at cpu9: ACPI CPU coretemp9 at cpu9: thermal sensor, 1 C resolution, Tjmax=90 acpicpu10 at cpu10: ACPI CPU coretemp10 at cpu10: thermal sensor, 1 C resolution, Tjmax=90 acpicpu11 at cpu11: ACPI CPU coretemp11 at cpu11: thermal sensor, 1 C resolution, Tjmax=90 acpicpu12 at cpu12: ACPI CPU coretemp12 at cpu12: thermal sensor, 1 C resolution, Tjmax=90 acpicpu13 at cpu13: ACPI CPU coretemp13 at cpu13: thermal sensor, 1 C resolution, Tjmax=90 acpicpu14 at cpu14: ACPI CPU coretemp14 at cpu14: thermal sensor, 1 C resolution, Tjmax=90 acpicpu15 at cpu15: ACPI CPU coretemp15 at cpu15: thermal sensor, 1 C resolution, Tjmax=90 acpicpu16 at cpu16: ACPI CPU acpicpu17 at cpu17: ACPI CPU acpicpu18 at cpu18: ACPI CPU acpicpu19 at cpu19: ACPI CPU acpicpu20 at cpu20: ACPI CPU acpicpu21 at cpu21: ACPI CPU acpicpu22 at cpu22: ACPI CPU acpicpu23 at cpu23: ACPI CPU acpicpu24 at cpu24: ACPI CPU acpicpu25 at cpu25: ACPI CPU acpicpu26 at cpu26: ACPI CPU acpicpu27 at cpu27: ACPI CPU acpicpu28 at cpu28: ACPI CPU acpicpu29 at cpu29: ACPI CPU acpicpu30 at cpu30: ACPI CPU acpicpu31 at cpu31: ACPI CPU timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0 timecounter: Timecounter "TSC" frequency 1995000000 Hz quality 3000 scsibus0: waiting 2 seconds for devices to settle... uhub0 at usb1: NetBSD (0x0000) UHCI root hub (0x0000), class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhub1 at usb2: NetBSD (0x0000) EHCI root hub (0x0000), class 9/0, rev 2.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhub2 at usb0: NetBSD (0x0000) EHCI root hub (0x0000), class 9/0, rev 2.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered IPsec: Initialized Security Association Processing. aes: Intel AES-NI chacha: x86 SSE2 ChaCha adiantum: self-test passed aes_ccm: self-test passed blake2s: self-test passed sd0 at scsibus0 target 0 lun 0: <HP, LOGICAL VOLUME, 7.02> disk fixed sd0: 931 GB, 65535 cyl, 255 head, 116 sec, 512 bytes/sect x 1953459632 sectors sd0: async, 8-bit transfers, tagged queueing sd1 at scsibus0 target 1 lun 0: <HP, LOGICAL VOLUME, 7.02> disk fixed sd1: 1862 GB, 65535 cyl, 255 head, 233 sec, 512 bytes/sect x 3906917808 sectors sd1: async, 8-bit transfers, tagged queueing uhub3 at uhub1 port 1: vendor 8087 (0x8087) product 0024 (0x0024), class 9/0, rev 2.00/0.00, addr 2 uhub3: single transaction translator uhub3: 8 ports with 8 removable, self powered uhub4 at uhub2 port 1: vendor 8087 (0x8087) product 0024 (0x0024), class 9/0, rev 2.00/0.00, addr 2 uhub4: single transaction translator uhub4: 6 ports with 6 removable, self powered uhub5 at uhub3 port 3: vendor 0424 (0x0424) product 2660 (0x2660), class 9/0, rev 2.00/8.01, addr 3 uhub5: single transaction translator uhub5: 2 ports with 1 removable, self powered uhidev0 at uhub4 port 3 configuration 1 interface 0 uhidev0: HEWLETT-PACKARD (0x03f0) Hewlett-Packard TFT7600 RKM (0x1f07), rev 1.10/1.04, addr 3, iclass 3/1 ukbd0 at uhidev0 wskbd1 at ukbd0 mux 1 wskbd1: connecting to wsdisplay0 uhidev1 at uhub4 port 3 configuration 1 interface 1 uhidev1: HEWLETT-PACKARD (0x03f0) Hewlett-Packard TFT7600 RKM (0x1f07), rev 1.10/1.04, addr 3, iclass 3/1 ums0 at uhidev1: 3 buttons and Z dir wsmouse1 at ums0 mux 0 uhub5: detached uhub5: at uhub3 port 3 (addr 3) disconnected uhub5 at uhub3 port 3: vendor 0424 (0x0424) product 2660 (0x2660), class 9/0, rev 2.00/8.01, addr 3 uhub5: single transaction translator uhub5: 2 ports with 1 removable, self powered atapibus0 at atabus1: 2 targets cd0 at atapibus0 drive 0: <hp DVD A DS8A8SH, 627225049827, KHE4> cdrom removable cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100) cgd: self-test aes-xts-256 cgd: self-test aes-xts-512 cgd: self-test aes-cbc-128 cgd: self-test aes-cbc-256 cgd: self-test 3des-cbc-192 cgd: self-test blowfish-cbc-448 cgd: self-test aes-cbc-128 (encblkno8) cgd: self-tests passed WARNING: 1 error while detecting hardware; check system log. boot device: sd0 root on sd0a dumps on sd0b root file system type: ffs kern.module.path=/stand/amd64/9.99.81/modules ipmi0: version 32.0 interface KCS iobase 0xca2/0x2 spacing 1 ipmi0: ID 19.2 IPMI 2.0 Available ipmi0: Additional Chassis FRU SEL SDR Sensor ipmi0: Manufacturer 0000b Product 200b ipmi0: Firmware 2.0 ciss0: normal state on 'ciss0:0' (online) ciss0: normal state on 'ciss0:1' (online) wsdisplay0: screen 1 added (80x25, vt100 emulation) wsdisplay0: screen 2 added (80x25, vt100 emulation) wsdisplay0: screen 3 added (80x25, vt100 emulation) wsdisplay0: screen 4 added (80x25, vt100 emulation)