Hi Frode,
Thanks for your email and for taking the time to look at this.
Kernel version
root@usc01a-032-16a:/home/gmckee# uname -r
5.15.0-53-generic
Output from the devlink port does not show a hw_addr on the physical port .
root@usc01a-032-16a:/home/gmckee# devlink port
pci/0000:07:00.0/65535: type eth netdev enp7s0f0 flavour physical port 0
splittable false
pci/0000:07:00.0/1: type eth netdev enp7s0f0_0 flavour pcivf controller 0
pfnum 0 vfnum 0 external false splittable false
function:
hw_addr 10:70:fd:ab:cd:01
pci/0000:07:00.0/2: type eth netdev enp7s0f0_1 flavour pcivf controller 0
pfnum 0 vfnum 1 external false splittable false
function:
hw_addr 10:70:fd:ab:cd:02
pci/0000:07:00.0/3: type eth netdev enp7s0f0_2 flavour pcivf controller 0
pfnum 0 vfnum 2 external false splittable false
function:
hw_addr 10:70:fd:ab:cd:03
pci/0000:07:00.0/4: type eth netdev enp7s0f0_3 flavour pcivf controller 0
pfnum 0 vfnum 3 external false splittable false
function:
hw_addr 10:70:fd:ab:cd:04
pci/0000:07:00.0/5: type eth netdev enp7s0f0_4 flavour pcivf controller 0
pfnum 0 vfnum 4 external false splittable false
function:
hw_addr 10:70:fd:e2:44:44
pci/0000:07:00.0/6: type eth netdev enp7s0f0_5 flavour pcivf controller 0
pfnum 0 vfnum 5 external false splittable false
function:
hw_addr 10:70:fd:e2:a3:02
pci/0000:07:00.1/131071: type eth netdev enp7s0f1 flavour physical port 1
splittable false
pci/0000:07:00.3/196608: type eth netdev enp7s0f0v1 flavour virtual
splittable false
pci/0000:07:00.4/262144: type eth netdev enp7s0f0v2 flavour virtual
splittable false
Log messages below
root@usc01a-032-16a:/home/gmckee# ovn-controller
2022-12-20T21:42:02Z|00001|vif_plug_representor|WARN|attempt to add
function before having knowledge about PF
2022-12-20T21:42:02Z|00002|vif_plug_representor|WARN|attempt to add
function before having knowledge about PF
2022-12-20T21:42:02Z|00003|vif_plug_representor|WARN|attempt to add
function before having knowledge about PF
2022-12-20T21:42:02Z|00004|vif_plug_representor|WARN|attempt to add
function before having knowledge about PF
2022-12-20T21:42:02Z|00005|vif_plug_representor|WARN|attempt to add
function before having knowledge about PF
2022-12-20T21:42:02Z|00006|vif_plug_representor|WARN|attempt to add
function before having knowledge about PF
2022-12-20T21:42:02Z|00007|vif_plug_representor|WARN|Unsupported flavour
for port 'enp7s0f0v1': VIRTUAL
2022-12-20T21:42:02Z|00008|vif_plug_representor|WARN|Unsupported flavour
for port 'enp7s0f0v2': VIRTUAL
2022-12-20T21:42:02Z|00009|reconnect|INFO|unix:/var/run/openvswitch/db.sock:
connecting...
2022-12-20T21:42:02Z|00010|reconnect|INFO|unix:/var/run/openvswitch/db.sock:
connected
2022-12-20T21:42:02Z|00011|main|INFO|OVN internal version is :
[22.03.0-20.21.0-58.3]
2022-12-20T21:42:02Z|00012|main|INFO|OVS IDL reconnected, force recompute.
2022-12-20T21:42:02Z|00013|reconnect|INFO|tcp:172.16.50.87:6642:
connecting...
2022-12-20T21:42:02Z|00014|main|INFO|OVNSB IDL reconnected, force recompute.
2022-12-20T21:42:02Z|00015|reconnect|INFO|tcp:172.16.50.87:6642: connected
2022-12-20T21:42:02Z|00016|features|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connecting to switch
2022-12-20T21:42:02Z|00017|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connecting...
2022-12-20T21:42:02Z|00018|features|INFO|OVS Feature: ct_zero_snat, state:
supported
2022-12-20T21:42:02Z|00019|main|INFO|OVS feature set changed, force
recompute.
2022-12-20T21:42:02Z|00020|ofctrl|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connecting to switch
2022-12-20T21:42:02Z|00021|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connecting...
2022-12-20T21:42:02Z|00022|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connected
2022-12-20T21:42:02Z|00001|pinctrl(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connecting to switch
2022-12-20T21:42:02Z|00002|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connecting...
2022-12-20T21:42:02Z|00023|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connected
2022-12-20T21:42:02Z|00024|main|INFO|OVS feature set changed, force
recompute.
2022-12-20T21:42:02Z|00003|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt:
connected
2022-12-20T21:42:02Z|00025|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00026|vif_plug|INFO|Not plugging lport c1-sw0-p1 on
direction from VIF plug provider.
2022-12-20T21:42:02Z|00027|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00028|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00029|lflow|WARN|error parsing actions "reg0[3] =
put_dhcp_opts(offerip = 10.200.2.12, classless_static_route = {
10.200.0.0/24,10.200.2.1, 10.200.1.0/24,10.200.2.1, 100.64.0.0/10,10.200.2.1},
hostname = usc01a-032-16a-vm1, lease_time = 3600, netmask = 255.255.255.0,
router = 10.200.2.1, server_id = 10.200.2.1); next;": Syntax error at
`usc01a' expecting constant.
2022-12-20T21:42:02Z|00030|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00031|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00032|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00033|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00034|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:02Z|00035|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:07Z|00036|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:12Z|00037|memory|INFO|10200 kB peak resident set size
after 10.2 seconds
2022-12-20T21:42:12Z|00038|memory|INFO|idl-cells:6577
lflow-cache-entries-cache-expr:202 lflow-cache-entries-cache-matches:178
lflow-cache-size-KB:620 local_datapath_usage-KB:1
ofctrl_desired_flow_usage-KB:250 ofctrl_installed_flow_usage-KB:181
ofctrl_sb_flow_ref_usage-KB:105
2022-12-20T21:42:12Z|00039|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:17Z|00040|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:17Z|00041|vif_plug|INFO|Dropped 10 log messages in last 16
seconds (most recently, 5 seconds ago) due to excessive rate
2022-12-20T21:42:17Z|00042|vif_plug|INFO|Not plugging lport c1-sw0-p1 on
direction from VIF plug provider.
2022-12-20T21:42:22Z|00043|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:27Z|00044|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:32Z|00045|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:32Z|00046|vif_plug|INFO|Dropped 2 log messages in last 10
seconds (most recently, 5 seconds ago) due to excessive rate
2022-12-20T21:42:32Z|00047|vif_plug|INFO|Not plugging lport c1-sw0-p1 on
direction from VIF plug provider.
2022-12-20T21:42:32Z|00048|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:32Z|00049|lflow_cache|INFO|Detected cache inactivity (last
active 30001 ms ago): trimming cache
2022-12-20T21:42:37Z|00050|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:42Z|00051|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:47Z|00052|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:47Z|00053|vif_plug|INFO|Dropped 3 log messages in last 15
seconds (most recently, 5 seconds ago) due to excessive rate
2022-12-20T21:42:47Z|00054|vif_plug|INFO|Not plugging lport c1-sw0-p1 on
direction from VIF plug provider.
2022-12-20T21:42:52Z|00055|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:42:57Z|00056|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:43:02Z|00057|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:43:02Z|00058|vif_plug|INFO|Dropped 2 log messages in last 10
seconds (most recently, 5 seconds ago) due to excessive rate
2022-12-20T21:43:02Z|00059|vif_plug|INFO|Not plugging lport c1-sw0-p1 on
direction from VIF plug provider.
2022-12-20T21:43:02Z|00060|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
2022-12-20T21:43:07Z|00061|vif_plug_representor|INFO|No representor port
found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
On Wed, 21 Dec 2022 at 02:50, Frode Nordahl <frode.nord...@canonical.com>
wrote:
> Hello, Gavin,
>
> Thank you for your interest in the vif plug infrastructure and the
> representor port plugin. See replies inline below.
>
> tir. 20. des. 2022, 19:29 skrev Gavin McKee via discuss <
> ovs-discuss@openvswitch.org>:
>
>> Hi,
>>
>> We are hoping someone can help with the following error message.
>>
>> Here we add the required options to the logical switch port in OVN North
>> ovn-nbctl lsp-set-options c1-sw0-p1 requested-chassis=usc01a-032-16a
>> vif-plug-type=representor vif-plug:representor:pf-mac=10:70:fd:df:9c:3a
>> vif-plug:representor:vf-num=4
>>
>> When I check the ovn-controller log on the hypervisor I see the following
>> error message:
>> 2022-12-20T18:24:42.815Z|00108|vif_plug|INFO|Not plugging lport c1-sw0-p1
>> on direction from VIF plug provider.
>> 2022-12-20T18:24:47.816Z|00109|vif_plug_representor|INFO|No representor
>> port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4'
>>
>> Here is the information for the Mellanox Connect X6 card we are using ,
>> you can see the mac on the physical interface is defined in the entry
>> vif-plug:representor:pf-mac=*10:70:fd:df:9c:3a*
>> ```
>> root@usc01a-032-16a:/home/gmckee# ip link show enp7s0f0
>> 14: enp7s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9214 qdisc mq master
>> ovs-system state UP mode DEFAULT group default qlen 1000
>> link/ether *10:70:fd:df:9c:3a* brd ff:ff:ff:ff:ff:ff
>> vf 0 link/ether 10:70:fd:ab:cd:01 brd ff:ff:ff:ff:ff:ff, spoof
>> checking off, link-state disable, trust off, query_rss off
>> vf 1 link/ether 10:70:fd:ab:cd:02 brd ff:ff:ff:ff:ff:ff, spoof
>> checking off, link-state disable, trust off, query_rss off
>> vf 2 link/ether 10:70:fd:ab:cd:03 brd ff:ff:ff:ff:ff:ff, spoof
>> checking off, link-state disable, trust off, query_rss off
>> vf 3 link/ether 10:70:fd:ab:cd:04 brd ff:ff:ff:ff:ff:ff, spoof
>> checking off, link-state disable, trust off, query_rss off
>> vf 4 link/ether 10:70:fd:e2:44:44 brd ff:ff:ff:ff:ff:ff, spoof
>> checking off, link-state disable, trust off, query_rss off
>> vf 5 link/ether 10:70:fd:e2:a3:02 brd ff:ff:ff:ff:ff:ff, spoof
>> checking off, link-state disable, trust off, query_rss off
>> altname enp7s0f0np0
>> ```
>>
>> The representor information is as follows
>>
>> root@usc01a-032-16a:/home/gmckee# ip link show enp7s0f0_4
>> 32: enp7s0f0_4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state
>> UP mode DEFAULT group default qlen 1000
>> link/ether ae:4e:85:a3:83:22 brd ff:ff:ff:ff:ff:ff
>> altname enp7s0f0npf0vf4
>>
>
>> the virtual function has already been assigned to a KVM VM.
>>
>> Any help is greatly appreciated .
>>
>
> The representor plugin was developed for and tested with a SmartNIC DPU,
> which behaves slightly different than a system where the embedded switch is
> exposed to the host system.
>
> Having said that, it was developed using generic interfaces, such as
> devlink-port [0], so we should be able to make it work.
>
> The representor plugin looks up the representor by combining information
> about PF MAC (`hw_addr`) and VF number from devlink [2], a recent kernel
> version is required to expose the `hw_addr` attribute.
>
> A few questions:
> Do you see any other messages logged from the vif_plug_representor module?
>
> What kernel version is in use?
>
> Does the `hw_addr` show up for the PCI_PF flavoured port in `devlink port
> show`?
>
> 0:
> https://www.kernel.org/doc/html/latest/networking/devlink/devlink-port.html
> 1:
> https://github.com/ovn-org/ovn-vif/blob/ce1a36f300a74b4eae55a7fec7d18da8b9218e29/lib/vif-plug-providers/representor/vif-plug-representor.c#L407-L469
>
> --
> Frode Nordahl
>
>
>> Gav
>>
>> _______________________________________________
>> discuss mailing list
>> disc...@openvswitch.org
>> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
>>
>
_______________________________________________
discuss mailing list
disc...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
