Hi @bugs,
I've a pair of boxes peering bgp with isp infrastructure and on premises
infrastructure
One of the routers was upgraded to 7.2 last night without any issues.
This is a 'border router' announcing private prefixes via bgp to isp
equipment and customer on a vpn that is pushing ~5tb a day. (upload and
download aggregated)
It has a few rules on pf.conf setup with sloppy state. (only one router was
upgraded, the traffic flow is assymetric)
After upgrading, TSO was enabled on this NICs using ifconfig ix0 tso;
ifconfig ix1 tso.
It was not possible to detect any issues on the maintenance window, yet
today with more users using the network we had reports of issues.
Some traffic would be very *slow*, some traffic would flow normally.
After disabling TSO, the packet forwarding resumed its normal state.
Unfortunately I do not have pcaps to support this issue.
The router is running 7.2 with latest patches available
Please let me know what further information would be useful in this
scenario.
Thank your your support,
Pedro
Dmesg below:
OpenBSD 7.2 (GENERIC.MP) #758: Tue Sep 27 11:57:54 MDT 2022
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 8437354496 (8046MB)
avail mem = 8164241408 (7786MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x788cb000 (262 entries)
bios0: vendor HP version "P89" date 06/02/2016
bios0: HP ProLiant DL380 Gen9
acpi0 at bios0: ACPI 5.0
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP UEFI MCEJ SSDT HEST BERT ERST EINJ BGRT HPET PMCT
WDDT APIC MCFG SLIT SRAT SPMI RASF SPCR MSCT BDAT PCCT DMAR SSDT SSDT SSDT
acpi0: wakeup devices PEX4(S4) BR05(S4) BR03(S4) BR07(S4) BR09(S4) BR11(S4)
BR13(S4) BR17(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 99MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.2, IBE
cpu1 at mainbus0: apid 4 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu1: smt 0, core 2, package 0
cpu2 at mainbus0: apid 8 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu2: smt 0, core 4, package 0
cpu3 at mainbus0: apid 16 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.18 MHz, 06-3f-02
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu3: smt 0, core 0, package 1
cpu4 at mainbus0: apid 20 (application processor)
cpu4: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu4: smt 0, core 2, package 1
cpu5 at mainbus0: apid 24 (application processor)
cpu5: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu5: smt 0, core 4, package 1
cpu6 at mainbus0: apid 2 (application processor)
cpu6: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu6: smt 0, core 1, package 0
cpu7 at mainbus0: apid 6 (application processor)
cpu7: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu7: smt 0, core 3, package 0
cpu8 at mainbus0: apid 10 (application processor)
cpu8: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu8:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu8: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu8: smt 0, core 5, package 0
cpu9 at mainbus0: apid 18 (application processor)
cpu9: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.16 MHz, 06-3f-02
cpu9:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu9: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu9: smt 0, core 1, package 1
cpu10 at mainbus0: apid 22 (application processor)
cpu10: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.16 MHz, 06-3f-02
cpu10:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu10: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu10: smt 0, core 3, package 1
cpu11 at mainbus0: apid 26 (application processor)
cpu11: Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz, 1598.17 MHz, 06-3f-02
cpu11:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,PERF,ITSC,FSGSBASE,TSC_ADJUST,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,PQM,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu11: 32KB 64b/line 8-way D-cache, 32KB 64b/line 8-way I-cache, 256KB
64b/line 8-way L2 cache, 15MB 64b/line 20-way L3 cache
cpu11: smt 0, core 5, package 1
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec01000, version 20, 24 pins
ioapic2 at mainbus0: apid 10 pa 0xfec40000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0x80000000, bus 0-255
acpiprt0 at acpi0: bus 127 (UNC0)
acpiprt1 at acpi0: bus 255 (UNC1)
acpiprt2 at acpi0: bus 0 (PCI0)
acpiprt3 at acpi0: bus 1 (PEX2)
acpiprt4 at acpi0: bus 2 (PEX4)
acpiprt5 at acpi0: bus 3 (BR01)
acpiprt6 at acpi0: bus 4 (BR05)
acpiprt7 at acpi0: bus 5 (BR03)
acpiprt8 at acpi0: bus 8 (BR07)
acpiprt9 at acpi0: bus 11 (BR09)
acpiprt10 at acpi0: bus 128 (PCI1)
acpiprt11 at acpi0: bus 129 (BR11)
acpiprt12 at acpi0: bus 132 (BR13)
acpiprt13 at acpi0: bus 136 (BR17)
"PNP0C33" at acpi0 not configured
"PNP0C14" at acpi0 not configured
acpipci0 at acpi0 UNC0
acpipci1 at acpi0 UNC1
"ACPI0004" at acpi0 not configured
acpicpu0 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu1 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu2 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu3 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu4 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu5 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
"ACPI0004" at acpi0 not configured
acpicpu6 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu7 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu8 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu9 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu10 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpicpu11 at acpi0: C2(350@41 io@0x415), C1(1000@1 halt)
acpipci2 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
"PNP0003" at acpi0 not configured
acpicmos0 at acpi0
"IPI0001" at acpi0 not configured
com0 at acpi0 UAR1 addr 0x3f8/0x8 irq 4: ns16550a, 16 byte fifo
com1 at acpi0 UAR2 addr 0x2f8/0x8 irq 3: ns16550a, 16 byte fifo
com1: probed fifo depth: 0 bytes
"ACPI000E" at acpi0 not configured
acpipci3 at acpi0 PCI1: 0x00000010 0x00000011 0x00000000
"ACPI000D" at acpi0 not configured
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
pci0 at mainbus0 bus 127
127:30:3: mem address conflict 0x10/0x10
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 8 function 3 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci0 dev 9 function 3 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 0 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 1 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci0 dev 11 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 0 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 1 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 3 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 4 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci0 dev 12 function 5 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 0 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci0 dev 15 function 1 not configured
"Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 4 not configured
"Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 5 not configured
"Intel E5 v3 SAD" rev 0x02 at pci0 dev 15 function 6 not configured
"Intel E5 v3 PCIE Ring" rev 0x02 at pci0 dev 16 function 0 not configured
"Intel E5 v3 PCIE Monitor" rev 0x02 at pci0 dev 16 function 1 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 5 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 6 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci0 dev 16 function 7 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 0 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci0 dev 18 function 1 not configured
"Intel E5 v3 Home Agent Debug" rev 0x02 at pci0 dev 18 function 2 not
configured
"Intel E5 v3 Memory" rev 0x02 at pci0 dev 19 function 0 not configured
"Intel E5 v3 RAS" rev 0x02 at pci0 dev 19 function 1 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 2 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 3 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 4 not configured
"Intel E5 v3 TAD" rev 0x02 at pci0 dev 19 function 5 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 6 not
configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 19 function 7 not
configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 20 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 20 function 3 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 20 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 21 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci0 dev 21 function 3 not configured
"Intel E5 v3 TA" rev 0x02 at pci0 dev 22 function 0 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 6 not
configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci0 dev 22 function 7 not
configured
"Intel E5 v3 Thermal" rev 0x02 at pci0 dev 23 function 0 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci0 dev 23 function 7 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 0 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 1 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 2 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 3 not configured
"Intel E5 v3 PCU" rev 0x02 at pci0 dev 30 function 4 not configured
"Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 0 not configured
"Intel E5 v3 VCU" rev 0x02 at pci0 dev 31 function 2 not configured
pci1 at mainbus0 bus 255
255:30:3: mem address conflict 0x10/0x10
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 8 function 3 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 0 not configured
"Intel E5 v3 QPI" rev 0x02 at pci1 dev 9 function 3 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 0 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 1 not configured
"Intel E5 v3 QPI Monitor" rev 0x02 at pci1 dev 11 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 0 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 1 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 2 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 3 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 4 not configured
"Intel E5 v3 Unicast" rev 0x02 at pci1 dev 12 function 5 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 0 not configured
"Intel E5 v3 Ring Agent" rev 0x02 at pci1 dev 15 function 1 not configured
"Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 4 not configured
"Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 5 not configured
"Intel E5 v3 SAD" rev 0x02 at pci1 dev 15 function 6 not configured
"Intel E5 v3 PCIE Ring" rev 0x02 at pci1 dev 16 function 0 not configured
"Intel E5 v3 PCIE Monitor" rev 0x02 at pci1 dev 16 function 1 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 5 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 6 not configured
"Intel E5 v3 Scratch" rev 0x02 at pci1 dev 16 function 7 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 0 not configured
"Intel E5 v3 Home Agent" rev 0x02 at pci1 dev 18 function 1 not configured
"Intel E5 v3 Home Agent Debug" rev 0x02 at pci1 dev 18 function 2 not
configured
"Intel E5 v3 Memory" rev 0x02 at pci1 dev 19 function 0 not configured
"Intel E5 v3 RAS" rev 0x02 at pci1 dev 19 function 1 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 2 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 3 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 4 not configured
"Intel E5 v3 TAD" rev 0x02 at pci1 dev 19 function 5 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 6 not
configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 19 function 7 not
configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 20 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 20 function 3 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 20 function 7 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 0 not configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 21 function 1 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 2 not configured
"Intel E5 v3 Error" rev 0x02 at pci1 dev 21 function 3 not configured
"Intel E5 v3 TA" rev 0x02 at pci1 dev 22 function 0 not configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 6 not
configured
"Intel E5 v3 DDR Broadcast" rev 0x02 at pci1 dev 22 function 7 not
configured
"Intel E5 v3 Thermal" rev 0x02 at pci1 dev 23 function 0 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 4 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 5 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 6 not configured
"Intel E5 v3 DDRIO" rev 0x02 at pci1 dev 23 function 7 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 0 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 1 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 2 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 3 not configured
"Intel E5 v3 PCU" rev 0x02 at pci1 dev 30 function 4 not configured
"Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 0 not configured
"Intel E5 v3 VCU" rev 0x02 at pci1 dev 31 function 2 not configured
pci2 at mainbus0 bus 0
pchb0 at pci2 dev 0 function 0 "Intel E5 v3 Host" rev 0x02
ppb0 at pci2 dev 1 function 0 "Intel E5 v3 PCIE" rev 0x02
pci3 at ppb0 bus 3
ciss0 at pci3 dev 0 function 0 "Hewlett-Packard Smart Array" rev 0x01: apic
8 int 16
ciss0: 1 LD, HW rev 1, FW 3.56/3.56, 64bit fifo rro
scsibus1 at ciss0: 1 targets
sd0 at scsibus1 targ 0 lun 0: <HP, LOGICAL VOLUME, 3.56>
sd0: 572140MB, 512 bytes/sector, 1171743324 sectors
ppb1 at pci2 dev 1 function 1 "Intel E5 v3 PCIE" rev 0x02
pci4 at ppb1 bus 14
ppb2 at pci2 dev 2 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci5 at ppb2 bus 5
ppb3 at pci2 dev 2 function 1 "Intel E5 v3 PCIE" rev 0x02
pci6 at ppb3 bus 15
ppb4 at pci2 dev 2 function 2 "Intel E5 v3 PCIE" rev 0x02
pci7 at ppb4 bus 4
ix0 at pci7 dev 0 function 0 "Intel 82599" rev 0x01, msix, 12 queues,
address 14:02:ec:xx:xx:xx
ix1 at pci7 dev 0 function 1 "Intel 82599" rev 0x01, msix, 12 queues,
address 14:02:ec:xx:xx:xx
ppb5 at pci2 dev 2 function 3 "Intel E5 v3 PCIE" rev 0x02
pci8 at ppb5 bus 16
ppb6 at pci2 dev 3 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci9 at ppb6 bus 8
ppb7 at pci2 dev 3 function 1 "Intel E5 v3 PCIE" rev 0x02
pci10 at ppb7 bus 17
ppb8 at pci2 dev 3 function 2 "Intel E5 v3 PCIE" rev 0x02: msi
pci11 at ppb8 bus 11
ppb9 at pci2 dev 3 function 3 "Intel E5 v3 PCIE" rev 0x02
pci12 at ppb9 bus 18
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 0 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 1 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 2 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 3 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 4 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 5 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 6 not configured
"Intel E5 v3 DMA" rev 0x02 at pci2 dev 4 function 7 not configured
"Intel E5 v3 Address Map" rev 0x02 at pci2 dev 5 function 0 not configured
"Intel E5 v3 Hot Plug" rev 0x02 at pci2 dev 5 function 1 not configured
"Intel E5 v3 Error Reporting" rev 0x02 at pci2 dev 5 function 2 not
configured
"Intel E5 v3 I/O APIC" rev 0x02 at pci2 dev 5 function 4 not configured
"Intel C610 MS SPSR" rev 0x05 at pci2 dev 17 function 0 not configured
xhci0 at pci2 dev 20 function 0 "Intel C610 xHCI" rev 0x05: apic 8 int 19,
xHCI 1.0
usb0 at xhci0: USB revision 3.0
uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev
3.00/1.00 addr 1
ehci0 at pci2 dev 26 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18
usb1 at ehci0: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb10 at pci2 dev 28 function 0 "Intel C610 PCIE" rev 0xd5
pci13 at ppb10 bus 19
ppb11 at pci2 dev 28 function 2 "Intel C610 PCIE" rev 0xd5
pci14 at ppb11 bus 1
"Hewlett-Packard iLO3 Slave" rev 0x06 at pci14 dev 0 function 0 not
configured
"Matrox MGA G200eH" rev 0x01 at pci14 dev 0 function 1 not configured
"Hewlett-Packard iLO3 Management" rev 0x06 at pci14 dev 0 function 2 not
configured
uhci0 at pci14 dev 0 function 4 "Hewlett-Packard USB" rev 0x03: apic 8 int
19
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Hewlett-Packard UHCI root hub"
rev 1.00/1.00 addr 1
ppb12 at pci2 dev 28 function 4 "Intel C610 PCIE" rev 0xd5
pci15 at ppb12 bus 2
bge0 at pci15 dev 0 function 0 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.3.12.0: msi, address 94:57:a5:xx:xx:xx
brgphy0 at bge0 phy 1: BCM5719C 10/100/1000baseT PHY, rev. 0
bge1 at pci15 dev 0 function 1 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.3.12.0: msi, address 94:57:a5:xx:xx:xx
brgphy1 at bge1 phy 2: BCM5719C 10/100/1000baseT PHY, rev. 0
bge2 at pci15 dev 0 function 2 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.3.12.0: msi, address 94:57:a5:xx:xx:xx
brgphy2 at bge2 phy 3: BCM5719C 10/100/1000baseT PHY, rev. 0
bge3 at pci15 dev 0 function 3 "Broadcom BCM5719" rev 0x01, BCM5719 A1
(0x5719001), APE firmware NCSI 1.3.12.0: msi, address 94:57:a5:xx:xx:xx
brgphy3 at bge3 phy 4: BCM5719C 10/100/1000baseT PHY, rev. 0
ppb13 at pci2 dev 28 function 6 "Intel C610 PCIE" rev 0xd5
pci16 at ppb13 bus 20
ppb14 at pci2 dev 28 function 7 "Intel C610 PCIE" rev 0xd5
pci17 at ppb14 bus 21
ehci1 at pci2 dev 29 function 0 "Intel C610 USB" rev 0x05: apic 8 int 18
usb3 at ehci1: USB revision 2.0
uhub3 at usb3 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
pcib0 at pci2 dev 31 function 0 "Intel C610 LPC" rev 0x05
ahci0 at pci2 dev 31 function 2 "Intel C610 AHCI" rev 0x05: msi, AHCI 1.3
ahci0: port 5: 1.5Gb/s
scsibus2 at ahci0: 32 targets
cd0 at scsibus2 targ 5 lun 0: <hp, DVD-ROM DUB0N, UKD0> removable
ichiic0 at pci2 dev 31 function 3 "Intel C610 SMBus" rev 0x05: apic 8 int 18
iic0 at ichiic0
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
pci18 at mainbus0 bus 128
ppb15 at pci18 dev 0 function 0 "Intel E5 v3 PCIE" rev 0x02
pci19 at ppb15 bus 145
ppb16 at pci18 dev 1 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci20 at ppb16 bus 129
ppb17 at pci18 dev 1 function 1 "Intel E5 v3 PCIE" rev 0x02
pci21 at ppb17 bus 142
ppb18 at pci18 dev 2 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci22 at ppb18 bus 132
ppb19 at pci18 dev 2 function 1 "Intel E5 v3 PCIE" rev 0x02
pci23 at ppb19 bus 143
ppb20 at pci18 dev 2 function 2 "Intel E5 v3 PCIE" rev 0x02
pci24 at ppb20 bus 135
ppb21 at pci18 dev 2 function 3 "Intel E5 v3 PCIE" rev 0x02
pci25 at ppb21 bus 144
ppb22 at pci18 dev 3 function 0 "Intel E5 v3 PCIE" rev 0x02: msi
pci26 at ppb22 bus 136
ppb23 at pci18 dev 3 function 1 "Intel E5 v3 PCIE" rev 0x02
pci27 at ppb23 bus 139
ppb24 at pci18 dev 3 function 2 "Intel E5 v3 PCIE" rev 0x02
pci28 at ppb24 bus 140
ppb25 at pci18 dev 3 function 3 "Intel E5 v3 PCIE" rev 0x02
pci29 at ppb25 bus 141
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 0 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 1 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 2 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 3 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 4 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 5 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 6 not configured
"Intel E5 v3 DMA" rev 0x02 at pci18 dev 4 function 7 not configured
"Intel E5 v3 Address Map" rev 0x02 at pci18 dev 5 function 0 not configured
"Intel E5 v3 Hot Plug" rev 0x02 at pci18 dev 5 function 1 not configured
"Intel E5 v3 Error Reporting" rev 0x02 at pci18 dev 5 function 2 not
configured
"Intel E5 v3 I/O APIC" rev 0x02 at pci18 dev 5 function 4 not configured
vmm0 at mainbus0: VMX/EPT
efifb0 at mainbus0: 1280x1024, 32bpp
wsdisplay0 at efifb0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
uhub4 at uhub0 port 3 configuration 1 interface 0 "Standard Microsystems
product 0x2660" rev 2.00/8.01 addr 2
uhub5 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching Hub"
rev 2.00/0.05 addr 2
uhub6 at uhub3 port 1 configuration 1 interface 0 "Intel Rate Matching Hub"
rev 2.00/0.05 addr 2
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on sd0a (cbaaabc6770eba72.a) swap on sd0b dump on sd0b
carp: pfsync0 demoted group carp by 32 to 160 (pfsync init)
carp: pfsync0 demoted group pfsync by 32 to 32 (pfsync init)
carp: pfsync0 demoted group carp by 1 to 161 (pfsync bulk start)
carp: pfsync0 demoted group pfsync by 1 to 33 (pfsync bulk start)
