Re: Support for Intel X520-T2 10GbaseT cards
On 2011-06-16 14:43, Peter Hallin wrote: On 2011-06-15 22:40, Jonathan Gray wrote: Yes this seems low indeed. You could try use rdomains and route exec with a cable between the two ports to make packets go over the interfaces if you don't have another host with 10G interfaces. I didn't get that far. When connecting the two ports to each other (tried with a couple of TP cables) I only get 1000baseT full-duplex on ix0 and ix1. If you've had ppb problems with em I'd imagine they would affect ix as well if it is sitting behind the same ppb. I disabled the ppb hotplug interrupt in ppb.c as Claudio mentioned in Performance degradation after upgrade and ran the same tests again. This time it got up to 932 Mbit/s (close to theoretical maximum), but the CPU usage was 100% intrs. However, the interfaces only generated around 2000 intrs/s each (compared to 13000 in my last test). I will not have more time to do additional testing in a while as i'm off for vacation, but I hope my tests so far can give you some insight. Thanks, Peter Hello, I finally got some time to test this 10G stuff again and now I'm using two machines with the same cards running 5.0 RELEASE (amd64/sp). Problem is as before, when connected and in UP state, the media goes down to 1000BaseT. If I take them both down, it goes back up to 10GbaseT. Weird. Tested with different (brand new cables) both cat 5E and cat 6. Good news is that the interrupt rate seems to be better, only about 15% CPU when running at 1Gbit/s and around 1500 intrs/s. These are two identical machines with the same hardware. //Peter dmesg: OpenBSD 5.0 (GENERIC) #53: Wed Aug 17 10:07:52 MDT 2011 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC RTC BIOS diagnostic error 80clock_battery real mem = 3208368128 (3059MB) avail mem = 3108941824 (2964MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xe4380 (23 entries) bios0: vendor Intel Corp. version BPX5810J.86B.0034.2010.0414.1511 date 04/14/2010 bios0: Intel Corporation WX58BP acpi0 at bios0: rev 2 acpi0: sleep states S0 S1 S3 S4 S5 acpi0: tables DSDT FACP APIC WDDT MCFG ASF! HPET ASPT WDTx SSDT DMAR acpi0: wakeup devices SLPB(S4) P32_(S4) ECIR(S4) UAR1(S4) ILAN(S4) PEG1(S4) PEG3(S4) PEG7(S4) PEX0(S5) PEX1(S5) PEX2(S5) PEX3(S5) PEX4(S5) PEX5(S5) UHC1(S3) UHC2(S3) UHC3(S3) UHC4(S3) EHCI(S3) EHC2(S3) UH42(S3) UHC5(S3) UHC6(S3) AZAL(S3) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU W3690 @ 3.47GHz, 3467.31 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,PCLMUL,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG cpu0: 256KB 64b/line 8-way L2 cache cpu0: apic clock running at 133MHz ioapic0 at mainbus0: apid 8 pa 0xfec0, version 20, 24 pins acpimadt0: unknown apic structure type 7f acpimcfg0 at acpi0 addr 0xf800, bus 0-63 acpihpet0 at acpi0: 14318179 Hz acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 10 (P32_) acpiprt2 at acpi0: bus 1 (PEG1) acpiprt3 at acpi0: bus 5 (PEG3) acpiprt4 at acpi0: bus 6 (PEG7) acpiprt5 at acpi0: bus 7 (PEX0) acpiprt6 at acpi0: bus 8 (PEX1) acpiprt7 at acpi0: bus -1 (PEX3) acpiprt8 at acpi0: bus 9 (PEX4) acpicpu0 at acpi0: C1, PSS acpibtn0 at acpi0: SLPB cpu0: Enhanced SpeedStep 3467 MHz: speeds: 3459, 3458, 3325, 3192, 3059, 2926, 2793, 2660, 2527, 2394, 2261, 2128, 1995, 1862, 1729, 1596 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 Intel X58 Host rev 0x13 ppb0 at pci0 dev 1 function 0 Intel X58 PCIE rev 0x13: msi pci1 at ppb0 bus 1 ppb1 at pci1 dev 0 function 0 IDT 89HPES12N3A rev 0x0c pci2 at ppb1 bus 2 ppb2 at pci2 dev 2 function 0 IDT 89HPES12N3A rev 0x0c pci3 at ppb2 bus 3 em0 at pci3 dev 0 function 0 Intel PRO/1000 QP (82576) rev 0x01: msi, address 00:1b:21:c8:8f:ac em1 at pci3 dev 0 function 1 Intel PRO/1000 QP (82576) rev 0x01: msi, address 00:1b:21:c8:8f:ad ppb3 at pci2 dev 4 function 0 IDT 89HPES12N3A rev 0x0c pci4 at ppb3 bus 4 em2 at pci4 dev 0 function 0 Intel PRO/1000 QP (82576) rev 0x01: msi, address 00:1b:21:c8:8f:ae em3 at pci4 dev 0 function 1 Intel PRO/1000 QP (82576) rev 0x01: msi, address 00:1b:21:c8:8f:af ppb4 at pci0 dev 3 function 0 Intel X58 PCIE rev 0x13: msi pci5 at ppb4 bus 5 vga1 at pci5 dev 0 function 0 NVIDIA GeForce 210 rev 0xa2 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) azalia0 at pci5 dev 0 function 1 vendor NVIDIA, unknown product 0x0be3 rev 0xa1: msi azalia0: no supported codecs ppb5 at pci0 dev 7 function 0 Intel X58 PCIE rev 0x13: msi pci6 at ppb5 bus 6 ix0 at pci6 dev 0 function 0 Intel 82599 T3 rev 0x01: msi, address 00:1b:21:93:a6:40 ix1 at pci6 dev 0 function 1 Intel 82599 T3 rev 0x01: msi, address 00:1b:21:93:a6:41 Intel X58 QuickPath rev 0x13 at pci0
Re: Support for Intel X520-T2 10GbaseT cards
On 2011-06-15 13:58, FRLinux wrote: Just out of curiosity, which iperf settings did you use? Just standard TCP, iperf -c hostname I know this is on a Linux box, but just out of interest, I get full speed there: Yeah, sure it works on Linux, but that's not what I'm running. Otherwise it's almost the same card as yours, but with TP connectors. //peter iperf -c xxx.xxx.xxx.xxx -i 5 Client connecting to xxx.xxx.xxx.xxx, TCP port 5001 TCP window size: 16.0 KByte (default) [ 3] local xxx.xxx.xxx.xxx port 47035 connected with xxx.xxx.xxx.xxx port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0- 5.0 sec 5.47 GBytes 9.39 Gbits/sec [ 3] 0.0-10.0 sec 10.9 GBytes 9.40 Gbits/sec Cards are: Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network Connection (rev 01) driver: ixgbe version: 2.0.44-k2 firmware-version: 0.9-3 bus-info: :05:00.0 Cheers, Steph
Re: Support for Intel X520-T2 10GbaseT cards
On 2011-06-15 22:40, Jonathan Gray wrote: Yes this seems low indeed. You could try use rdomains and route exec with a cable between the two ports to make packets go over the interfaces if you don't have another host with 10G interfaces. I didn't get that far. When connecting the two ports to each other (tried with a couple of TP cables) I only get 1000baseT full-duplex on ix0 and ix1. If you've had ppb problems with em I'd imagine they would affect ix as well if it is sitting behind the same ppb. I disabled the ppb hotplug interrupt in ppb.c as Claudio mentioned in Performance degradation after upgrade and ran the same tests again. This time it got up to 932 Mbit/s (close to theoretical maximum), but the CPU usage was 100% intrs. However, the interfaces only generated around 2000 intrs/s each (compared to 13000 in my last test). I will not have more time to do additional testing in a while as i'm off for vacation, but I hope my tests so far can give you some insight. Thanks, Peter
Re: Support for Intel X520-T2 10GbaseT cards
On 2011-06-16 14:43, Peter Hallin wrote: I didn't get that far. When connecting the two ports to each other (tried with a couple of TP cables) I only get 1000baseT full-duplex on ix0 and ix1. Nevermind that. After a reboot with the cables connected the interfaces show up as 10GbaseT full-duplex. Will see if I have the time to do some tests. //Peter
Re: Support for Intel X520-T2 10GbaseT cards
On 2011-06-15 04:26, Jonathan Gray wrote: Claudio has recently synced ix to a newer version of the Intel code, if you can try again with -current this should work. Great, thanks. I tried it out today, but the performance wasn't exactly what I had expected. This is a dual port card, so I bridged ix0 with ix1 and ran iperf between two hosts through the card. The hosts were connected with 1Gbase as I have no other 10Gbase cards. It only got up to about 450 Mbit/s (standard TCP iperf test) and there was an unbalance between ix0 and ix1 when it came to interrupts. ix1 only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when monitoring live with systat vmstat). The CPU intr usage was around 50-60%. Could this possibly be related to the ppb problems we've seen with em(4) cards? //Peter vmstat -iz: interrupt total rate irq0/clock 345997 100 irq144/acpi000 irq96/ppb2 00 irq97/ix0 1046011 302 irq96/ix1 327045 94 irq97/ppb3 00 irq112/em0 52826 15 irq113/em1 00 irq96/ppb7 00 irq98/uhci0 4440 irq99/uhci1 00 irq98/uhci2 00 irq99/uhci3 00 irq98/ehci0 20 irq100/pciide0 14620 irq101/ahci010 irq101/ichiic0 00 irq145/com0 00 irq146/com1 00 irq147/pckbc0 00 Total 1773788 513 dmesg: OpenBSD 4.9-current (GENERIC) #0: Wed Jun 15 10:51:41 CEST 2011 root@lab:/usr/src/sys/arch/amd64/compile/GENERIC RTC BIOS diagnostic error 3 real mem = 1065857024 (1016MB) avail mem = 1023438848 (976MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x3fa32000 (58 entries) bios0: vendor Intel Corporation version S5000.86B.11.00.0096.011320091422 date 01/13/2009 bios0: Intel S5000VSA acpi0 at bios0: rev 2 acpi0: sleep states S0 S1 S4 S5 acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST EINJ acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5) UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5) PCIQ(S5) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.10 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG cpu0: 6MB 64b/line 16-way L2 cache cpu0: apic clock running at 332MHz cpu at mainbus0: not configured cpu at mainbus0: not configured cpu at mainbus0: not configured ioapic0 at mainbus0: apid 8 pa 0xfec0, version 20, 24 pins ioapic1 at mainbus0: apid 9 pa 0xfec8, version 20, 24 pins acpihpet0 at acpi0: 14318179 Hz acpimcfg0 at acpi0 addr 0xa000, bus 0-255 acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus 9 (P32_) acpiprt2 at acpi0: bus 8 (PEX0) acpiprt3 at acpi0: bus -1 (PEX1) acpiprt4 at acpi0: bus -1 (PEX2) acpiprt5 at acpi0: bus -1 (PEX3) acpiprt6 at acpi0: bus 1 (PCIE) acpiprt7 at acpi0: bus 6 (PCIE) acpiprt8 at acpi0: bus 2 (PCIW) acpiprt9 at acpi0: bus 3 (PCIO) acpiprt10 at acpi0: bus 4 (PCIP) acpiprt11 at acpi0: bus 5 (PCIQ) acpicpu0 at acpi0: C2, C1, PSS acpibtn0 at acpi0: SLPB ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 2494 MHz: speeds: 2497, 1998 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 Intel 5000V Host rev 0xb1 ppb0 at pci0 dev 2 function 0 Intel 5000 PCIE x8 rev 0xb1 pci1 at ppb0 bus 1 ppb1 at pci1 dev 0 function 0 Intel 6321ESB PCIE rev 0x01 pci2 at ppb1 bus 2 ppb2 at pci2 dev 0 function 0 Intel 6321ESB PCIE rev 0x01: apic 8 int 16 pci3 at ppb2 bus 3 ix0 at pci3 dev 0 function 0 Intel 82599 T3 rev 0x01: apic 8 int 17, address 00:1b:21:93:a6:3c ix1 at pci3 dev 0 function 1 Intel 82599 T3 rev 0x01: apic 8 int 16, address 00:1b:21:93:a6:3d ppb3 at pci2 dev 1 function 0 Intel 6321ESB PCIE rev 0x01: apic 8 int 17 pci4 at ppb3 bus 4 ppb4 at pci2 dev 2 function 0 Intel 6321ESB PCIE rev 0x01 pci5 at ppb4 bus 5 em0 at pci5 dev 0 function 0 Intel PRO/1000 PT (80003ES2) rev 0x01: apic 8 int 18, address 00:15:17:60:97:fc em1 at pci5 dev 0 function 1 Intel PRO/1000 PT (80003ES2) rev 0x01: apic 8 int 19, address 00:15:17:60:97:fd ppb5 at pci1 dev 0 function 3 Intel 6321ESB PCIE-PCIX rev 0x01 pci6 at ppb5 bus 6 ppb6 at pci0 dev 3 function 0 Intel 5000 PCIE rev 0xb1 pci7 at ppb6 bus 7 pchb1 at pci0 dev 16 function 0 Intel 5000 Error Reporting rev 0xb1 pchb2 at pci0 dev
Re: Support for Intel X520-T2 10GbaseT cards
On Wed, Jun 15, 2011 at 12:40:32PM +0200, Peter Hallin wrote: On 2011-06-15 04:26, Jonathan Gray wrote: Claudio has recently synced ix to a newer version of the Intel code, if you can try again with -current this should work. Great, thanks. I tried it out today, but the performance wasn't exactly what I had expected. This is a dual port card, so I bridged ix0 with ix1 and ran iperf between two hosts through the card. The hosts were connected with 1Gbase as I have no other 10Gbase cards. It only got up to about 450 Mbit/s (standard TCP iperf test) and there was an unbalance between ix0 and ix1 when it came to interrupts. ix1 only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when monitoring live with systat vmstat). The CPU intr usage was around 50-60%. Could this possibly be related to the ppb problems we've seen with em(4) cards? Yes this seems low indeed. You could try use rdomains and route exec with a cable between the two ports to make packets go over the interfaces if you don't have another host with 10G interfaces. If you've had ppb problems with em I'd imagine they would affect ix as well if it is sitting behind the same ppb.
Re: Support for Intel X520-T2 10GbaseT cards
On Wed, Jun 15, 2011 at 11:40 AM, Peter Hallin peter.hal...@ldc.lu.se wrote: It only got up to about 450 Mbit/s (standard TCP iperf test) and there was an unbalance between ix0 and ix1 when it came to interrupts. ix1 only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when monitoring live with systat vmstat). The CPU intr usage was around 50-60%. Just out of curiosity, which iperf settings did you use? I know this is on a Linux box, but just out of interest, I get full speed there: iperf -c xxx.xxx.xxx.xxx -i 5 Client connecting to xxx.xxx.xxx.xxx, TCP port 5001 TCP window size: 16.0 KByte (default) [ 3] local xxx.xxx.xxx.xxx port 47035 connected with xxx.xxx.xxx.xxx port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0- 5.0 sec 5.47 GBytes 9.39 Gbits/sec [ 3] 0.0-10.0 sec 10.9 GBytes 9.40 Gbits/sec Cards are: Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network Connection (rev 01) driver: ixgbe version: 2.0.44-k2 firmware-version: 0.9-3 bus-info: :05:00.0 Cheers, Steph
Re: Support for Intel X520-T2 10GbaseT cards
Claudio has recently synced ix to a newer version of the Intel code, if you can try again with -current this should work.
Re: Support for Intel X520-T2 10GbaseT cards
Hello again and thanks for the patch.
I started out with a fresh install of 4.8 GENERIC (amd64, MP), applied the
patch and recompiled the kernel. The line numbers were not correct, but
otherwise it looked the same.
After reboot dmesg showed that the cards now have been found and I have the ix
interfaces in ifconfig.
Unfortunately the cards aren't too keen on talking to the network.
I can't ping other hosts on the same subnet, and if I try to ping from another
machine directly connected to the nic, all tcpdump shows me is this:
# tcpdump -i ix0
tcpdump: listening on ix0, link-type EN10MB
16:01:05.254579 Broadcast af:de:21:93:a6:3c 60:
4001 b955 c0a8 0002
c0a8 0001 0800 00cb 0b04 0003 99cf 804d
053e 0e00 1011
16:01:06.254355 Broadcast af:de:1d:b5:94:e1 60:
ff01 6cc0 c0a8 0001
c0a8 0002 2ccb 0b04 0002 98cf 804d
e23e 0e00 1011
No echo requests or replies, nothing else. Seems arp is not resolving as it
should, arp -a just hangs at the console.
And if I try to show the routing table, with route show it also just hangs
there and won't show anything but if I take the interface down, the table
shows as it should.
I guess the driver may need some more work to get this card running and I
would be happy to see support for this in an upcoming release.
Best regards, Peter
ifconfig ix0:
ix0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST mtu 1500
lladdr 00:1b:21:93:a6:3c
priority: 0
media: Ethernet autoselect (1000baseT full-duplex)
status: active
inet6 fe80::21b:21ff:fe93:a63c%ix0 prefixlen 64 scopeid 0x1
inet 192.168.0.1 netmask 0xff00 broadcast 255.255.255.0
dmesg:
OpenBSD 4.8 (GENERIC.MP) #0: Wed Mar 16 12:43:47 CET 2011
r...@f001b1.net.lu.se:/usr/src/sys/arch/amd64/compile/GENERIC.MP
RTC BIOS diagnostic error 2
real mem = 2139598848 (2040MB)
avail mem = 2068819968 (1972MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fa32000 (60 entries)
bios0: vendor Intel Corporation version S5000.86B.11.00.0096.011320091422
date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST
EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5)
UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5)
PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.08 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu1: 6MB 64b/line 16-way L2 cache
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu2: 6MB 64b/line 16-way L2 cache
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu3: 6MB 64b/line 16-way L2 cache
ioapic0 at mainbus0: apid 8 pa 0xfec0, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec8, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 9 (P32_)
acpiprt2 at acpi0: bus 8 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 6 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 5 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpicpu1 at acpi0: C2, C1, PSS
acpicpu2 at acpi0: C2, C1, PSS
acpicpu3 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2493 MHz: speeds: 2497, 1998 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 Intel 5000V Host rev 0xb1
ppb0 at pci0 dev 2 function 0 Intel 5000 PCIE x8
Re: Support for Intel X520-T2 10GbaseT cards
sounds like rDNS delay.
retry with arp -an and netstat -rn
/Pete
On 16. mars 2011, at 16.33, Peter Hallin wrote:
Hello again and thanks for the patch.
I started out with a fresh install of 4.8 GENERIC (amd64, MP), applied the
patch and recompiled the kernel. The line numbers were not correct, but
otherwise it looked the same.
After reboot dmesg showed that the cards now have been found and I have the
ix
interfaces in ifconfig.
Unfortunately the cards aren't too keen on talking to the network.
I can't ping other hosts on the same subnet, and if I try to ping from
another
machine directly connected to the nic, all tcpdump shows me is this:
# tcpdump -i ix0
tcpdump: listening on ix0, link-type EN10MB
16:01:05.254579 Broadcast af:de:21:93:a6:3c 60:
4001 b955 c0a8 0002
c0a8 0001 0800 00cb 0b04 0003 99cf 804d
053e 0e00 1011
16:01:06.254355 Broadcast af:de:1d:b5:94:e1 60:
ff01 6cc0 c0a8 0001
c0a8 0002 2ccb 0b04 0002 98cf 804d
e23e 0e00 1011
No echo requests or replies, nothing else. Seems arp is not resolving as it
should, arp -a just hangs at the console.
And if I try to show the routing table, with route show it also just
hangs
there and won't show anything but if I take the interface down, the table
shows as it should.
I guess the driver may need some more work to get this card running and I
would be happy to see support for this in an upcoming release.
Best regards, Peter
ifconfig ix0:
ix0: flags=8843UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST mtu 1500
lladdr 00:1b:21:93:a6:3c
priority: 0
media: Ethernet autoselect (1000baseT full-duplex)
status: active
inet6 fe80::21b:21ff:fe93:a63c%ix0 prefixlen 64 scopeid 0x1
inet 192.168.0.1 netmask 0xff00 broadcast 255.255.255.0
dmesg:
OpenBSD 4.8 (GENERIC.MP) #0: Wed Mar 16 12:43:47 CET 2011
r...@f001b1.net.lu.se:/usr/src/sys/arch/amd64/compile/GENERIC.MP
RTC BIOS diagnostic error 2
real mem = 2139598848 (2040MB)
avail mem = 2068819968 (1972MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fa32000 (60 entries)
bios0: vendor Intel Corporation version S5000.86B.11.00.0096.011320091422
date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST
EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5)
UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5)
PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee0: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.08 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu1: 6MB 64b/line 16-way L2 cache
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu2: 6MB 64b/line 16-way L2 cache
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu3: 6MB 64b/line 16-way L2 cache
ioapic0 at mainbus0: apid 8 pa 0xfec0, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec8, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 9 (P32_)
acpiprt2 at acpi0: bus 8 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 6 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 5 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpicpu1 at acpi0: C2, C1, PSS
acpicpu2 at acpi0: C2, C1, PSS
acpicpu3 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at
Re: Support for Intel X520-T2 10GbaseT cards
Thanks, I tried that and got the routing table, however still no packets coming through. //Peter sounds like rDNS delay. retry with arp -an and netstat -rn /Pete
Re: Support for Intel X520-T2 10GbaseT cards
On Tue, Mar 15, 2011 at 05:02:38PM +0100, Peter Hallin wrote:
Hi all,
After reading the manpages for ix(4) Intel 82598/82599 PCI Express 10Gb
Ethernet device,
I drew the conclusion that the X520-T2
(http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-
t2-overview.htm)
would also be supported by the driver, so we took a shot and bought a pair for
our firewalls.
It is based on the 82599 chipset, so why wouldn't it? My mistake, is seems..
I get an unknown product 0x151c error in dmesg (see below).
So now we have a pair of these cards and the obvious question is of course,
will they be supported?
I realize that I should have checked this before I bought it,
but as Intel claims in the specs
(http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
it is supported by FreeBSD and I believe that's from where the driver was
ported.
I'm very grateful for any input.
This is a diff against -current not 4.8 but perhaps it applies there as well:
you'll have to apply this from /usr/src/sys/dev/pci and then
run 'make' in the directory to regenerate the pcidevs headers
Index: pcidevs
===
RCS file: /cvs/src/sys/dev/pci/pcidevs,v
retrieving revision 1.1590
diff -u -p -r1.1590 pcidevs
--- pcidevs 26 Jan 2011 07:09:09 - 1.1590
+++ pcidevs 15 Mar 2011 17:31:38 -
@@ -2492,6 +2492,7 @@ product INTEL 82580_SGMII 0x1511 82580 S
product INTEL 82580_COPPER_DUAL0x1516 I340-T2 (82580)
product INTEL 82599_KX4_MEZZ 0x1514 10GbE KX4 (82599)
product INTEL 82576_NS_SERDES 0x1518 82576NS SerDes
+product INTEL 82599_T3_LOM 0x151c 82599 T3
product INTEL 82576_QUAD_CU_ET20x1526 PRO/1000 QP (82576)
product INTEL 80960RP_ATU 0x1960 80960RP ATU
product INTEL 82840_HB 0x1a21 82840 Host
Index: if_ix.c
===
RCS file: /cvs/src/sys/dev/pci/if_ix.c,v
retrieving revision 1.46
diff -u -p -r1.46 if_ix.c
--- if_ix.c 10 Nov 2010 15:23:25 - 1.46
+++ if_ix.c 15 Mar 2011 17:31:39 -
@@ -68,7 +68,8 @@ const struct pci_matchid ixgbe_devices[]
{ PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_COMBO_BACKPLANE },
{ PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_CX4 },
{ PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP },
- { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM }
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM },
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_T3_LOM }
};
/*
@@ -1251,6 +1252,10 @@ ixgbe_identify_hardware(struct ix_softc
case PCI_PRODUCT_INTEL_82598EB_XF_LR:
sc-hw.mac.type = ixgbe_mac_82598EB;
sc-optics = IFM_10G_LR;
+ break;
+ case PCI_PRODUCT_INTEL_82599_T3_LOM:
+ sc-hw.mac.type = ixgbe_mac_82599EB;
+ sc-optics = IFM_10G_T;
break;
case PCI_PRODUCT_INTEL_82598AT_DUAL:
case PCI_PRODUCT_INTEL_82598AT:
Re: Support for Intel X520-T2 10GbaseT cards
On Wed, 16 Mar 2011 04:39:21 +1100
Jonathan Gray j...@goblin.cx wrote:
On Tue, Mar 15, 2011 at 05:02:38PM +0100, Peter Hallin wrote:
Hi all,
After reading the manpages for ix(4) Intel 82598/82599 PCI Express
10Gb Ethernet device,
I drew the conclusion that the X520-T2
(http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-
t2-overview.htm)
would also be supported by the driver, so we took a shot and bought
a pair for our firewalls.
It is based on the 82599 chipset, so why wouldn't it? My mistake,
is seems..
I get an unknown product 0x151c error in dmesg (see below).
So now we have a pair of these cards and the obvious question is of
course, will they be supported?
I realize that I should have checked this before I bought it,
but as Intel claims in the specs
(http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
it is supported by FreeBSD and I believe that's from where the
driver was ported.
I'm very grateful for any input.
This is a diff against -current not 4.8 but perhaps it applies there
as well:
you'll have to apply this from /usr/src/sys/dev/pci and then
run 'make' in the directory to regenerate the pcidevs headers
Index: pcidevs
===
RCS file: /cvs/src/sys/dev/pci/pcidevs,v
retrieving revision 1.1590
diff -u -p -r1.1590 pcidevs
--- pcidevs 26 Jan 2011 07:09:09 - 1.1590
+++ pcidevs 15 Mar 2011 17:31:38 -
@@ -2492,6 +2492,7 @@ product INTEL 82580_SGMII 0x1511
82580 S product INTEL 82580_COPPER_DUAL 0x1516 I340-T2
(82580) product INTEL 82599_KX4_MEZZ 0x1514 10GbE KX4
(82599) product INTEL 82576_NS_SERDES 0x1518 82576NS
SerDes +product INTEL 82599_T3_LOM0x151c 82599 T3
product INTEL 82576_QUAD_CU_ET2 0x1526 PRO/1000 QP
(82576) product INTEL 80960RP_ATU 0x1960 80960RP ATU
product INTEL 82840_HB 0x1a21 82840 Host
Index: if_ix.c
===
RCS file: /cvs/src/sys/dev/pci/if_ix.c,v
retrieving revision 1.46
diff -u -p -r1.46 if_ix.c
--- if_ix.c 10 Nov 2010 15:23:25 - 1.46
+++ if_ix.c 15 Mar 2011 17:31:39 -
@@ -68,7 +68,8 @@ const struct pci_matchid ixgbe_devices[]
{ PCI_VENDOR_INTEL,
PCI_PRODUCT_INTEL_82599_COMBO_BACKPLANE }, { PCI_VENDOR_INTEL,
PCI_PRODUCT_INTEL_82599_CX4 }, { PCI_VENDOR_INTEL,
PCI_PRODUCT_INTEL_82599_SFP },
- { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM }
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM },
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_T3_LOM }
};
/*
@@ -1251,6 +1252,10 @@ ixgbe_identify_hardware(struct ix_softc
case PCI_PRODUCT_INTEL_82598EB_XF_LR:
sc-hw.mac.type = ixgbe_mac_82598EB;
sc-optics = IFM_10G_LR;
+ break;
+ case PCI_PRODUCT_INTEL_82599_T3_LOM:
+ sc-hw.mac.type = ixgbe_mac_82599EB;
+ sc-optics = IFM_10G_T;
break;
case PCI_PRODUCT_INTEL_82598AT_DUAL:
case PCI_PRODUCT_INTEL_82598AT:
And this one here?
Index: ixgbe_82599.c
===
RCS file: /cvs/src/sys/dev/pci/ixgbe_82599.c,v
retrieving revision 1.2
diff -u -p -r1.2 ixgbe_82599.c
--- ixgbe_82599.c 25 Feb 2010 10:56:07 - 1.2
+++ ixgbe_82599.c 15 Mar 2011 17:27:55 -
@@ -416,6 +416,9 @@ enum ixgbe_media_type ixgbe_get_media_ty
case IXGBE_DEV_ID_82599_CX4:
media_type = ixgbe_media_type_cx4;
break;
+ case IXGBE_DEV_ID_82599_T3_LOM:
+ media_type = ixgbe_media_type_copper;
+ break;
default:
media_type = ixgbe_media_type_unknown;
break;
Re: Support for Intel X520-T2 10GbaseT cards
On Tue, Mar 15, 2011 at 06:56:24PM +0100, roberth wrote: And this one here? This should be handled by the default case as the start of the function, already. Index: ixgbe_82599.c === RCS file: /cvs/src/sys/dev/pci/ixgbe_82599.c,v retrieving revision 1.2 diff -u -p -r1.2 ixgbe_82599.c --- ixgbe_82599.c 25 Feb 2010 10:56:07 - 1.2 +++ ixgbe_82599.c 15 Mar 2011 17:27:55 - @@ -416,6 +416,9 @@ enum ixgbe_media_type ixgbe_get_media_ty case IXGBE_DEV_ID_82599_CX4: media_type = ixgbe_media_type_cx4; break; + case IXGBE_DEV_ID_82599_T3_LOM: + media_type = ixgbe_media_type_copper; + break; default: media_type = ixgbe_media_type_unknown; break;
Re: Support for Intel X520-T2 10GbaseT cards
On Wed, 16 Mar 2011 06:26:20 +1100 Jonathan Gray j...@goblin.cx wrote: On Tue, Mar 15, 2011 at 06:56:24PM +0100, roberth wrote: And this one here? This should be handled by the default case as the start of the function, already. Sure, it is, the freebsd driver is checking this twice, my bad. Index: ixgbe_82599.c === RCS file: /cvs/src/sys/dev/pci/ixgbe_82599.c,v retrieving revision 1.2 diff -u -p -r1.2 ixgbe_82599.c --- ixgbe_82599.c 25 Feb 2010 10:56:07 - 1.2 +++ ixgbe_82599.c 15 Mar 2011 17:27:55 - @@ -416,6 +416,9 @@ enum ixgbe_media_type ixgbe_get_media_ty case IXGBE_DEV_ID_82599_CX4: media_type = ixgbe_media_type_cx4; break; + case IXGBE_DEV_ID_82599_T3_LOM: + media_type = ixgbe_media_type_copper; + break; default: media_type = ixgbe_media_type_unknown; break;
