Re: [E1000-devel] Question about ixgbevf driver
-Original Message- From: Kirsher, Jeffrey T Sent: Wednesday, January 04, 2012 7:58 PM To: david.ye...@oracle.com; Rose, Gregory V Cc: Brandeburg, Jesse; Allan, Bruce W; Steve Sarvate; e1000-devel Subject: Re: Question about ixgbevf driver Adding e1000-devel mailing list as well as Greg Rose (ixgbevf maintainer)... I've never noticed this before but then I can't say as how I was looking for it either. Let me check it out and I'll get back to you. - Greg On Wed, 2012-01-04 at 17:26 -0800, David Yeung wrote: Hi Bruce/Jeffrey/Jesse/, How do you do? We are using the ixgbevf driver ( version: 2.4.0-NAPI ) to test the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine, it looks like the bi-directional network traffic ran properly on the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine for hours, but the ifconfig command reports strange amount ( it is 0 all the time ) of RX packets and RX bytes of VLAN interfaces of Twinville: [root@Twinville_VM_156 ~]# ifconfig . eth6.10 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.10.156 Bcast:192.6.10.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111332155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2565278846027 (2.3 TiB) eth6.11 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.11.156 Bcast:192.6.11.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111289098 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2562582125939 (2.3 TiB) eth6.12 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.12.156 Bcast:192.6.12.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111287930 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2564949229588 (2.3 TiB) eth6.13 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.93.156 Bcast:192.6.93.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111070858 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566358628283 (2.3 TiB) eth6.14 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.14.156 Bcast:192.6.14.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111362848 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566349976603 (2.3 TiB) . [root@Twinville_VM_156 ~]# ethtool -i eth6 driver: ixgbevf version: 2.4.0-NAPI firmware-version: N/A bus-info: :00:09.0 [root@Powerville_VM_156 ~]# [root@Twinville_VM_156 ~]# cat /etc/*release Enterprise Linux Enterprise Linux Server release 5.5 (Carthage) Red Hat Enterprise Linux Server release 5.5 (Tikanga) [root@Twinville_VM_156 ~]# Do you have any idea about this problem? Any workaround/fix for this problem? Thanks, David -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel#174; Ethernet, visit http://communities.intel.com/community/wired
Re: [E1000-devel] Detected Hardware Unit Hang on Intel Wired Ethernet
On Thu, Jan 05, 2012 at 10:00:39AM +0530, Pratyush Anand wrote: On 1/5/2012 12:52 AM, Greg KH wrote: On Wed, Jan 04, 2012 at 04:31:36PM +0530, Pratyush Anand wrote: Adding PCI mailing list too, as problem is coming only when MSI is enabled. If I connect an PCIe analyzer, I see that at the time of issue MRd(64) for 32 words has been issued with a wrong 64 bit address from ethernet card to my RC. In the normal course it always issues MRd(32) only. Bug in your pcie firmware controller? . when you say Bug in your pcie firmware controller?, is it RC's software or EP's software? I don't know, but I would place the bet on your motherboard controller, not the device. greg k-h -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ E1000-devel mailing list E1000-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/e1000-devel To learn more about Intel#174; Ethernet, visit http://communities.intel.com/community/wired
Re: [E1000-devel] Detected Hardware Unit Hang on Intel Wired Ethernet
Anand, Sorry to hear that you have this issue with card. And yeah, thanks for doing the debugging and providing the bus trace. I think we should run the debug driver that prints the HW ring details when hang occurs. I can provide you a debug driver. You can then install debug driver and also let the bus tracer running. Once the issue occurs, provide me the full dmesg output (that has HW ring details) and bus trace. Tell me which card you have, 1gig or 10gig? Which driver are you running e1000e or igb or ixgbe? Can you also provide ethtool -i ethx output. Once I know which driver, I send you debug driver. Thanks. -Tushar -Original Message- From: netdev-ow...@vger.kernel.org [mailto:netdev-ow...@vger.kernel.org] On Behalf Of Pratyush Anand Sent: Wednesday, January 04, 2012 8:31 PM To: Greg KH Cc: Pratyush Anand; e1000-devel@lists.sourceforge.net; net...@vger.kernel.org; Shiraz HASHIM; Deepak SIKRI; Bhavna YADAV; linux-...@vger.kernel.org; Linux NICS Subject: Re: Detected Hardware Unit Hang on Intel Wired Ethernet On 1/5/2012 12:52 AM, Greg KH wrote: On Wed, Jan 04, 2012 at 04:31:36PM +0530, Pratyush Anand wrote: Adding PCI mailing list too, as problem is coming only when MSI is enabled. If I connect an PCIe analyzer, I see that at the time of issue MRd(64) for 32 words has been issued with a wrong 64 bit address from ethernet card to my RC. In the normal course it always issues MRd(32) only. Bug in your pcie firmware controller? . when you say Bug in your pcie firmware controller?, is it RC's software or EP's software? Here I am pasting a part of analyzer log converted into text. Packet(177940), is an upstream request for MSI. Whenever any device writes at address 0x58A8F8, my PCIe RC considers it as MSI and generates an interrupt. So I receive MSI interrupt correctly in my software. Also MSI controller is correctly able to point me that the interrupt is from ethernet card. Now in Packet(178010), ethernet controller sends another upstream request for MRd(64) of 32 dwords with Address(AFECEB87:A9D88B00).Since, this address does not exist in my RC's world so, an UR is returned and hence the problem occurs. Now, question is, why ethernet card is generating inbound request with such a wrong address. I have taken log of all the tx_desc-buffer_addr programmed by software in function e1000_tx_queue. None of them is 64 bit or any invalid address. ___|___ Packet(177916) Upstream 2.5(x1) TLP(1475) Mem MWr(32)(10:0) Length(4) ___| RequesterID(003:00:0) Tag(2) Address(0EB00200) 1st BE() ___| Last BE() Data(4 dwords) LCRC(0x44E0407C) ___| Time Stamp(0013 . 460 549 544 s) ___|___ Packet(177918) Downstream 2.5(x1) DLLP ACK AckNak_Seq_Num(1475) ___| CRC 16(0x0EB7) Time Stamp(0013 . 460 551 144 s) ___|___ Packet(177940) Upstream 2.5(x1) TLP(1476) Mem MWr(32)(10:0) Length(1) ___| RequesterID(003:00:0) Tag(30) Address(0058A8F8) 1st BE(0011) ___| Last BE() Data(1 dword) LCRC(0xC21F32B6) ___| Time Stamp(0013 . 460 588 544 s) ___|___ Packet(177942) Downstream 2.5(x1) DLLP ACK AckNak_Seq_Num(1476) ___| CRC 16(0x69F5) Time Stamp(0013 . 460 590 088 s) ___|___ Packet(177946) Downstream 2.5(x1) TLP(309) Mem MRd(32)(00:0) Length(1) ___| RequesterID(002:00:0) Tag(19) Address(C01000C0) 1st BE() ___| Last BE() LCRC(0x91BDA1F5) Time Stamp(0013 . 460 595 936 s) ___|___ Packet(177947) Upstream 2.5(x1) DLLP ACK AckNak_Seq_Num(309) ___| CRC 16(0x25C6) Time Stamp(0013 . 460 596 368 s) ___|___ Packet(177950) Upstream 2.5(x1) TLP(1477) Cpl CplD(10:01010) Length(1) ___| RequesterID(002:00:0) Tag(19) CompleterID(003:00:0) Status(SC) BCM(0) ___| Byte Cnt(4) Lwr Addr(0x40) Data(1 dword) LCRC(0x8FE0D922) ___| Time Stamp(0013 . 460 597 304 s) ___|___ Packet(177952) Downstream 2.5(x1) DLLP ACK AckNak_Seq_Num(1477) ___| CRC 16(0xC8EE) Time Stamp(0013 . 460 598 840 s) ___|___ Packet(177999) Downstream 2.5(x1) TLP(310) Mem MWr(32)(10:0) Length(1) ___| RequesterID(002:00:0) Tag(0) Address(C0103818) 1st BE() ___| Last BE() Data(1 dword) LCRC(0xA898D9A1) ___| Time Stamp(0013 . 460 687 936 s) ___|___ Packet(178001) Upstream 2.5(x1) DLLP ACK AckNak_Seq_Num(310) ___| CRC 16(0xC6EA)
Re: [E1000-devel] Question about ixgbevf driver
David, Just to clarify something. You're running Oracle Enterprise Linux 5 and the guest OS is Red Hat Enterprise Linux 5.5? We're having trouble reproducing this so I want to make sure we're using the right setup. Thanks, - Greg -Original Message- From: Rose, Gregory V [mailto:gregory.v.r...@intel.com] Sent: Thursday, January 05, 2012 8:06 AM To: Kirsher, Jeffrey T; david.ye...@oracle.com Cc: e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: [E1000-devel] Question about ixgbevf driver -Original Message- From: Kirsher, Jeffrey T Sent: Wednesday, January 04, 2012 7:58 PM To: david.ye...@oracle.com; Rose, Gregory V Cc: Brandeburg, Jesse; Allan, Bruce W; Steve Sarvate; e1000-devel Subject: Re: Question about ixgbevf driver Adding e1000-devel mailing list as well as Greg Rose (ixgbevf maintainer)... I've never noticed this before but then I can't say as how I was looking for it either. Let me check it out and I'll get back to you. - Greg On Wed, 2012-01-04 at 17:26 -0800, David Yeung wrote: Hi Bruce/Jeffrey/Jesse/, How do you do? We are using the ixgbevf driver ( version: 2.4.0-NAPI ) to test the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine, it looks like the bi-directional network traffic ran properly on the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine for hours, but the ifconfig command reports strange amount ( it is 0 all the time ) of RX packets and RX bytes of VLAN interfaces of Twinville: [root@Twinville_VM_156 ~]# ifconfig . eth6.10 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.10.156 Bcast:192.6.10.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111332155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2565278846027 (2.3 TiB) eth6.11 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.11.156 Bcast:192.6.11.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111289098 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2562582125939 (2.3 TiB) eth6.12 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.12.156 Bcast:192.6.12.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111287930 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2564949229588 (2.3 TiB) eth6.13 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.93.156 Bcast:192.6.93.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111070858 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566358628283 (2.3 TiB) eth6.14 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.14.156 Bcast:192.6.14.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111362848 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566349976603 (2.3 TiB) . [root@Twinville_VM_156 ~]# ethtool -i eth6 driver: ixgbevf version: 2.4.0-NAPI firmware-version: N/A bus-info: :00:09.0 [root@Powerville_VM_156 ~]# [root@Twinville_VM_156 ~]# cat /etc/*release Enterprise Linux Enterprise Linux Server release 5.5 (Carthage) Red Hat Enterprise Linux Server release 5.5 (Tikanga) [root@Twinville_VM_156 ~]# Do you have any idea about this problem? Any workaround/fix for this problem? Thanks, David -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ E1000-devel mailing list
Re: [E1000-devel] Question about ixgbevf driver
Greg, Thank you for your help! We are running Oracle VM server release 3.0.3 and the guest OS is ( Oracle ) Enterprise Linux Enterprise Linux Server release 5.5 (Carthage). Thanks, David On 01/05/12 16:15, Rose, Gregory V wrote: David, Just to clarify something. You're running Oracle Enterprise Linux 5 and the guest OS is Red Hat Enterprise Linux 5.5? We're having trouble reproducing this so I want to make sure we're using the right setup. Thanks, - Greg -Original Message- From: Rose, Gregory V [mailto:gregory.v.r...@intel.com] Sent: Thursday, January 05, 2012 8:06 AM To: Kirsher, Jeffrey T; david.ye...@oracle.com Cc: e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: [E1000-devel] Question about ixgbevf driver -Original Message- From: Kirsher, Jeffrey T Sent: Wednesday, January 04, 2012 7:58 PM To: david.ye...@oracle.com; Rose, Gregory V Cc: Brandeburg, Jesse; Allan, Bruce W; Steve Sarvate; e1000-devel Subject: Re: Question about ixgbevf driver Adding e1000-devel mailing list as well as Greg Rose (ixgbevf maintainer)... I've never noticed this before but then I can't say as how I was looking for it either. Let me check it out and I'll get back to you. - Greg On Wed, 2012-01-04 at 17:26 -0800, David Yeung wrote: Hi Bruce/Jeffrey/Jesse/, How do you do? We are using the ixgbevf driver ( version: 2.4.0-NAPI ) to test the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine, it looks like the bi-directional network traffic ran properly on the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine for hours, but the ifconfig command reports strange amount ( it is 0 all the time ) of RX packets and RX bytes of VLAN interfaces of Twinville: [root@Twinville_VM_156 ~]# ifconfig . eth6.10 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.10.156 Bcast:192.6.10.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111332155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2565278846027 (2.3 TiB) eth6.11 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.11.156 Bcast:192.6.11.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111289098 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2562582125939 (2.3 TiB) eth6.12 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.12.156 Bcast:192.6.12.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111287930 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2564949229588 (2.3 TiB) eth6.13 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.93.156 Bcast:192.6.93.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111070858 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566358628283 (2.3 TiB) eth6.14 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.14.156 Bcast:192.6.14.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111362848 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566349976603 (2.3 TiB) . [root@Twinville_VM_156 ~]# ethtool -i eth6 driver: ixgbevf version: 2.4.0-NAPI firmware-version: N/A bus-info: :00:09.0 [root@Powerville_VM_156 ~]# [root@Twinville_VM_156 ~]# cat /etc/*release Enterprise Linux Enterprise Linux Server release 5.5 (Carthage) Red Hat Enterprise Linux Server release 5.5 (Tikanga) [root@Twinville_VM_156 ~]# Do you have any idea about this problem? Any workaround/fix for this problem? Thanks, David -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free!
Re: [E1000-devel] Question about ixgbevf driver
OK, thanks for the clarification. We'll see if we can pick those up on our internal server, but just in case is there an external site where we can get them? - Greg -Original Message- From: David Yeung [mailto:david.ye...@oracle.com] Sent: Thursday, January 05, 2012 4:27 PM To: Rose, Gregory V Cc: Kirsher, Jeffrey T; e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: Question about ixgbevf driver Greg, Thank you for your help! We are running Oracle VM server release 3.0.3 and the guest OS is ( Oracle ) Enterprise Linux Enterprise Linux Server release 5.5 (Carthage). Thanks, David On 01/05/12 16:15, Rose, Gregory V wrote: David, Just to clarify something. You're running Oracle Enterprise Linux 5 and the guest OS is Red Hat Enterprise Linux 5.5? We're having trouble reproducing this so I want to make sure we're using the right setup. Thanks, - Greg -Original Message- From: Rose, Gregory V [mailto:gregory.v.r...@intel.com] Sent: Thursday, January 05, 2012 8:06 AM To: Kirsher, Jeffrey T; david.ye...@oracle.com Cc: e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: [E1000-devel] Question about ixgbevf driver -Original Message- From: Kirsher, Jeffrey T Sent: Wednesday, January 04, 2012 7:58 PM To: david.ye...@oracle.com; Rose, Gregory V Cc: Brandeburg, Jesse; Allan, Bruce W; Steve Sarvate; e1000-devel Subject: Re: Question about ixgbevf driver Adding e1000-devel mailing list as well as Greg Rose (ixgbevf maintainer)... I've never noticed this before but then I can't say as how I was looking for it either. Let me check it out and I'll get back to you. - Greg On Wed, 2012-01-04 at 17:26 -0800, David Yeung wrote: Hi Bruce/Jeffrey/Jesse/, How do you do? We are using the ixgbevf driver ( version: 2.4.0-NAPI ) to test the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine, it looks like the bi-directional network traffic ran properly on the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine for hours, but the ifconfig command reports strange amount ( it is 0 all the time ) of RX packets and RX bytes of VLAN interfaces of Twinville: [root@Twinville_VM_156 ~]# ifconfig . eth6.10 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.10.156 Bcast:192.6.10.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111332155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2565278846027 (2.3 TiB) eth6.11 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.11.156 Bcast:192.6.11.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111289098 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2562582125939 (2.3 TiB) eth6.12 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.12.156 Bcast:192.6.12.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111287930 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2564949229588 (2.3 TiB) eth6.13 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.93.156 Bcast:192.6.93.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111070858 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566358628283 (2.3 TiB) eth6.14 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.14.156 Bcast:192.6.14.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111362848 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566349976603 (2.3 TiB) . [root@Twinville_VM_156 ~]# ethtool -i eth6 driver: ixgbevf version: 2.4.0-NAPI firmware-version: N/A bus-info: :00:09.0 [root@Powerville_VM_156 ~]# [root@Twinville_VM_156 ~]# cat /etc/*release Enterprise Linux Enterprise Linux Server release 5.5 (Carthage) Red Hat Enterprise Linux
Re: [E1000-devel] Question about ixgbevf driver
Greg, The external site is: http://edelivery.oracle.com/linux Thanks, David On 01/05/12 16:30, Rose, Gregory V wrote: OK, thanks for the clarification. We'll see if we can pick those up on our internal server, but just in case is there an external site where we can get them? - Greg -Original Message- From: David Yeung [mailto:david.ye...@oracle.com] Sent: Thursday, January 05, 2012 4:27 PM To: Rose, Gregory V Cc: Kirsher, Jeffrey T; e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: Question about ixgbevf driver Greg, Thank you for your help! We are running Oracle VM server release 3.0.3 and the guest OS is ( Oracle ) Enterprise Linux Enterprise Linux Server release 5.5 (Carthage). Thanks, David On 01/05/12 16:15, Rose, Gregory V wrote: David, Just to clarify something. You're running Oracle Enterprise Linux 5 and the guest OS is Red Hat Enterprise Linux 5.5? We're having trouble reproducing this so I want to make sure we're using the right setup. Thanks, - Greg -Original Message- From: Rose, Gregory V [mailto:gregory.v.r...@intel.com] Sent: Thursday, January 05, 2012 8:06 AM To: Kirsher, Jeffrey T; david.ye...@oracle.com Cc: e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: [E1000-devel] Question about ixgbevf driver -Original Message- From: Kirsher, Jeffrey T Sent: Wednesday, January 04, 2012 7:58 PM To: david.ye...@oracle.com; Rose, Gregory V Cc: Brandeburg, Jesse; Allan, Bruce W; Steve Sarvate; e1000-devel Subject: Re: Question about ixgbevf driver Adding e1000-devel mailing list as well as Greg Rose (ixgbevf maintainer)... I've never noticed this before but then I can't say as how I was looking for it either. Let me check it out and I'll get back to you. - Greg On Wed, 2012-01-04 at 17:26 -0800, David Yeung wrote: Hi Bruce/Jeffrey/Jesse/, How do you do? We are using the ixgbevf driver ( version: 2.4.0-NAPI ) to test the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine, it looks like the bi-directional network traffic ran properly on the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine for hours, but the ifconfig command reports strange amount ( it is 0 all the time ) of RX packets and RX bytes of VLAN interfaces of Twinville: [root@Twinville_VM_156 ~]# ifconfig . eth6.10 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.10.156 Bcast:192.6.10.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111332155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2565278846027 (2.3 TiB) eth6.11 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.11.156 Bcast:192.6.11.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111289098 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2562582125939 (2.3 TiB) eth6.12 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.12.156 Bcast:192.6.12.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111287930 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2564949229588 (2.3 TiB) eth6.13 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.93.156 Bcast:192.6.93.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111070858 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566358628283 (2.3 TiB) eth6.14 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.14.156 Bcast:192.6.14.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111362848 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566349976603 (2.3 TiB) . [root@Twinville_VM_156 ~]# ethtool -i eth6 driver: ixgbevf version: 2.4.0-NAPI firmware-version: N/A bus-info: :00:09.0 [root@Powerville_VM_156 ~]# [root@Twinville_VM_156 ~]# cat /etc/*release Enterprise Linux Enterprise Linux Server release 5.5
Re: [E1000-devel] Question about ixgbevf driver
Thank you! -Original Message- From: David Yeung [mailto:david.ye...@oracle.com] Sent: Thursday, January 05, 2012 4:38 PM To: Rose, Gregory V Cc: Kirsher, Jeffrey T; e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: Question about ixgbevf driver Greg, The external site is: http://edelivery.oracle.com/linux Thanks, David On 01/05/12 16:30, Rose, Gregory V wrote: OK, thanks for the clarification. We'll see if we can pick those up on our internal server, but just in case is there an external site where we can get them? - Greg -Original Message- From: David Yeung [mailto:david.ye...@oracle.com] Sent: Thursday, January 05, 2012 4:27 PM To: Rose, Gregory V Cc: Kirsher, Jeffrey T; e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: Question about ixgbevf driver Greg, Thank you for your help! We are running Oracle VM server release 3.0.3 and the guest OS is ( Oracle ) Enterprise Linux Enterprise Linux Server release 5.5 (Carthage). Thanks, David On 01/05/12 16:15, Rose, Gregory V wrote: David, Just to clarify something. You're running Oracle Enterprise Linux 5 and the guest OS is Red Hat Enterprise Linux 5.5? We're having trouble reproducing this so I want to make sure we're using the right setup. Thanks, - Greg -Original Message- From: Rose, Gregory V [mailto:gregory.v.r...@intel.com] Sent: Thursday, January 05, 2012 8:06 AM To: Kirsher, Jeffrey T; david.ye...@oracle.com Cc: e1000-devel; Allan, Bruce W; Brandeburg, Jesse; Steve Sarvate Subject: Re: [E1000-devel] Question about ixgbevf driver -Original Message- From: Kirsher, Jeffrey T Sent: Wednesday, January 04, 2012 7:58 PM To: david.ye...@oracle.com; Rose, Gregory V Cc: Brandeburg, Jesse; Allan, Bruce W; Steve Sarvate; e1000-devel Subject: Re: Question about ixgbevf driver Adding e1000-devel mailing list as well as Greg Rose (ixgbevf maintainer)... I've never noticed this before but then I can't say as how I was looking for it either. Let me check it out and I'll get back to you. - Greg On Wed, 2012-01-04 at 17:26 -0800, David Yeung wrote: Hi Bruce/Jeffrey/Jesse/, How do you do? We are using the ixgbevf driver ( version: 2.4.0-NAPI ) to test the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine, it looks like the bi-directional network traffic ran properly on the VLAN interfaces of Twinville NICs inside the OEL 5 virtual machine for hours, but the ifconfig command reports strange amount ( it is 0 all the time ) of RX packets and RX bytes of VLAN interfaces of Twinville: [root@Twinville_VM_156 ~]# ifconfig . eth6.10 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.10.156 Bcast:192.6.10.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111332155 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2565278846027 (2.3 TiB) eth6.11 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.11.156 Bcast:192.6.11.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111289098 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2562582125939 (2.3 TiB) eth6.12 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.12.156 Bcast:192.6.12.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111287930 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2564949229588 (2.3 TiB) eth6.13 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.93.156 Bcast:192.6.93.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111070858 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:2566358628283 (2.3 TiB) eth6.14 Link encap:Ethernet HWaddr F2:54:11:05:72:7C inet addr:192.6.14.156 Bcast:192.6.14.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:9210 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:111362848 errors:0 dropped:0
Re: [E1000-devel] Detected Hardware Unit Hang on Intel Wired Ethernet
Thanks Tushar, On 1/6/2012 5:24 AM, Dave, Tushar N wrote: Anand, Sorry to hear that you have this issue with card. And yeah, thanks for doing the debugging and providing the bus trace. I think we should run the debug driver that prints the HW ring details when hang occurs. I can provide you a debug driver. You can then install debug driver and also let the bus tracer running. Once the issue occurs, provide me the full dmesg output (that has HW ring details) and bus trace. Tell me which card you have, 1gig or 10gig? Which driver are you running e1000e or igb or ixgbe? Can you also provide ethtool -i ethx output. Once I know which driver, I send you debug driver. I am using Intel PRO/1000 PT Server Adapter. http://www.intel.com/content/www/us/en/network-adapters/gigabit-network-adapters/pro-1000-pt.html I am using e1000e driver. I see the problem when I try to mount rootfilesystem using NFS and use MSI interrupt. I see this issue even before I can have cell prompt. Please see first mail in this thread. http://www.mail-archive.com/e1000-devel@lists.sourceforge.net/msg04894.html Here, you can also see tx ring details when issue occur. Please let me know, if you need any more info. Regards Pratyush Thanks. -Tushar -Original Message- From: netdev-ow...@vger.kernel.org [mailto:netdev-ow...@vger.kernel.org] On Behalf Of Pratyush Anand Sent: Wednesday, January 04, 2012 8:31 PM To: Greg KH Cc: Pratyush Anand; e1000-devel@lists.sourceforge.net; net...@vger.kernel.org; Shiraz HASHIM; Deepak SIKRI; Bhavna YADAV; linux-...@vger.kernel.org; Linux NICS Subject: Re: Detected Hardware Unit Hang on Intel Wired Ethernet On 1/5/2012 12:52 AM, Greg KH wrote: On Wed, Jan 04, 2012 at 04:31:36PM +0530, Pratyush Anand wrote: Adding PCI mailing list too, as problem is coming only when MSI is enabled. If I connect an PCIe analyzer, I see that at the time of issue MRd(64) for 32 words has been issued with a wrong 64 bit address from ethernet card to my RC. In the normal course it always issues MRd(32) only. Bug in your pcie firmware controller? . when you say Bug in your pcie firmware controller?, is it RC's software or EP's software? Here I am pasting a part of analyzer log converted into text. Packet(177940), is an upstream request for MSI. Whenever any device writes at address 0x58A8F8, my PCIe RC considers it as MSI and generates an interrupt. So I receive MSI interrupt correctly in my software. Also MSI controller is correctly able to point me that the interrupt is from ethernet card. Now in Packet(178010), ethernet controller sends another upstream request for MRd(64) of 32 dwords with Address(AFECEB87:A9D88B00).Since, this address does not exist in my RC's world so, an UR is returned and hence the problem occurs. Now, question is, why ethernet card is generating inbound request with such a wrong address. I have taken log of all the tx_desc-buffer_addr programmed by software in function e1000_tx_queue. None of them is 64 bit or any invalid address. ___|___ Packet(177916) Upstream 2.5(x1) TLP(1475) Mem MWr(32)(10:0) Length(4) ___| RequesterID(003:00:0) Tag(2) Address(0EB00200) 1st BE() ___| Last BE() Data(4 dwords) LCRC(0x44E0407C) ___| Time Stamp(0013 . 460 549 544 s) ___|___ Packet(177918) Downstream 2.5(x1) DLLP ACK AckNak_Seq_Num(1475) ___| CRC 16(0x0EB7) Time Stamp(0013 . 460 551 144 s) ___|___ Packet(177940) Upstream 2.5(x1) TLP(1476) Mem MWr(32)(10:0) Length(1) ___| RequesterID(003:00:0) Tag(30) Address(0058A8F8) 1st BE(0011) ___| Last BE() Data(1 dword) LCRC(0xC21F32B6) ___| Time Stamp(0013 . 460 588 544 s) ___|___ Packet(177942) Downstream 2.5(x1) DLLP ACK AckNak_Seq_Num(1476) ___| CRC 16(0x69F5) Time Stamp(0013 . 460 590 088 s) ___|___ Packet(177946) Downstream 2.5(x1) TLP(309) Mem MRd(32)(00:0) Length(1) ___| RequesterID(002:00:0) Tag(19) Address(C01000C0) 1st BE() ___| Last BE() LCRC(0x91BDA1F5) Time Stamp(0013 . 460 595 936 s) ___|___ Packet(177947) Upstream 2.5(x1) DLLP ACK AckNak_Seq_Num(309) ___| CRC 16(0x25C6) Time Stamp(0013 . 460 596 368 s) ___|___ Packet(177950) Upstream 2.5(x1) TLP(1477) Cpl CplD(10:01010) Length(1) ___| RequesterID(002:00:0) Tag(19) CompleterID(003:00:0) Status(SC) BCM(0) ___| Byte Cnt(4) Lwr Addr(0x40) Data(1 dword) LCRC(0x8FE0D922) ___| Time Stamp(0013 . 460 597 304 s)
