Hey everyone,

We are seeing some strange behavior with our X710 NIC.

SRIOV is enabled, VF are created. We are able to pass the VF to the guest
VM.

But inside the guest VM, it complains as being unable to talk to the PF. In
this example, I gave it two VF on two separate cards. On each X710, its the
second 10G interface and in both cases, it's unable to talk to the PF.

We have this behavior across 15 different computes all using X710 with a
few different firmwares.

[Fri Jul 30 18:40:42 2021] iavf 0000:00:04.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:42 2021] iavf 0000:00:04.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:42 2021] iavf 0000:00:05.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:42 2021] iavf 0000:00:05.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:47 2021] iavf 0000:00:04.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:47 2021] iavf 0000:00:04.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:47 2021] iavf 0000:00:05.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:47 2021] iavf 0000:00:05.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:52 2021] iavf 0000:00:04.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:52 2021] iavf 0000:00:04.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:52 2021] iavf 0000:00:05.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:52 2021] iavf 0000:00:05.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:57 2021] iavf 0000:00:04.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:57 2021] iavf 0000:00:04.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:40:57 2021] iavf 0000:00:05.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:40:57 2021] iavf 0000:00:05.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:41:02 2021] iavf 0000:00:04.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:41:02 2021] iavf 0000:00:04.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:41:02 2021] iavf 0000:00:05.0: Device is still in reset
(-16), retrying
[Fri Jul 30 18:41:02 2021] iavf 0000:00:05.0: Failed to communicate with
PF; waiting before retry
[Fri Jul 30 18:41:07 2021] iavf 0000:00:04.0: Device is still in reset
(-16), retrying

VM is using IAVF
[root@instack ~]# modinfo iavf
filename:
/lib/modules/3.10.0-1062.1.2.el7.x86_64/kernel/drivers/net/ethernet/intel/iavf/iavf.ko.xz
version:        3.2.3-k
license:        GPL v2
description:    Intel(R) Ethernet Adaptive Virtual Function Network Driver
author:         Intel Corporation, <linux.n...@intel.com>
alias:          i40evf
retpoline:      Y
rhelversion:    7.7
srcversion:     DE7E32B4F921863EF986A7A
alias:          pci:v00008086d00001889sv*sd*bc*sc*i*
alias:          pci:v00008086d000037CDsv*sd*bc*sc*i*
alias:          pci:v00008086d00001571sv*sd*bc*sc*i*
alias:          pci:v00008086d0000154Csv*sd*bc*sc*i*
depends:
intree:         Y
vermagic:       3.10.0-1062.1.2.el7.x86_64 SMP mod_unload modversions
signer:         Red Hat Enterprise Linux kernel signing key
sig_key:        FA:14:0C:90:52:2D:A4:98:79:F1:2D:34:A9:C8:16:AE:1A:C4:0A:96
sig_hashalgo:   sha256

Compute is using i40e

sudo ethtool -i sriov-0-2
driver: i40e
version: 2.8.20-k
firmware-version: 10.54.7
expansion-rom-version:
bus-info: 0000:37:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

Note that if I give the VM the first 10G port of the same card, it works
correctly. Both are using the same exact driver and firmware
sudo ethtool -i sriov-0-1
driver: i40e
version: 2.8.20-k
firmware-version: 10.54.7
expansion-rom-version:
bus-info: 0000:37:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes


We have a case ongoing with RedHat and HP but doesnt make any sense so far.

Thanks!

_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel Ethernet, visit 
https://forums.intel.com/s/topic/0TO0P00000018NbWAI/intel-ethernet

Reply via email to