Hi Frode, Thanks for your email and for taking the time to look at this.
Kernel version root@usc01a-032-16a:/home/gmckee# uname -r 5.15.0-53-generic Output from the devlink port does not show a hw_addr on the physical port . root@usc01a-032-16a:/home/gmckee# devlink port pci/0000:07:00.0/65535: type eth netdev enp7s0f0 flavour physical port 0 splittable false pci/0000:07:00.0/1: type eth netdev enp7s0f0_0 flavour pcivf controller 0 pfnum 0 vfnum 0 external false splittable false function: hw_addr 10:70:fd:ab:cd:01 pci/0000:07:00.0/2: type eth netdev enp7s0f0_1 flavour pcivf controller 0 pfnum 0 vfnum 1 external false splittable false function: hw_addr 10:70:fd:ab:cd:02 pci/0000:07:00.0/3: type eth netdev enp7s0f0_2 flavour pcivf controller 0 pfnum 0 vfnum 2 external false splittable false function: hw_addr 10:70:fd:ab:cd:03 pci/0000:07:00.0/4: type eth netdev enp7s0f0_3 flavour pcivf controller 0 pfnum 0 vfnum 3 external false splittable false function: hw_addr 10:70:fd:ab:cd:04 pci/0000:07:00.0/5: type eth netdev enp7s0f0_4 flavour pcivf controller 0 pfnum 0 vfnum 4 external false splittable false function: hw_addr 10:70:fd:e2:44:44 pci/0000:07:00.0/6: type eth netdev enp7s0f0_5 flavour pcivf controller 0 pfnum 0 vfnum 5 external false splittable false function: hw_addr 10:70:fd:e2:a3:02 pci/0000:07:00.1/131071: type eth netdev enp7s0f1 flavour physical port 1 splittable false pci/0000:07:00.3/196608: type eth netdev enp7s0f0v1 flavour virtual splittable false pci/0000:07:00.4/262144: type eth netdev enp7s0f0v2 flavour virtual splittable false Log messages below root@usc01a-032-16a:/home/gmckee# ovn-controller 2022-12-20T21:42:02Z|00001|vif_plug_representor|WARN|attempt to add function before having knowledge about PF 2022-12-20T21:42:02Z|00002|vif_plug_representor|WARN|attempt to add function before having knowledge about PF 2022-12-20T21:42:02Z|00003|vif_plug_representor|WARN|attempt to add function before having knowledge about PF 2022-12-20T21:42:02Z|00004|vif_plug_representor|WARN|attempt to add function before having knowledge about PF 2022-12-20T21:42:02Z|00005|vif_plug_representor|WARN|attempt to add function before having knowledge about PF 2022-12-20T21:42:02Z|00006|vif_plug_representor|WARN|attempt to add function before having knowledge about PF 2022-12-20T21:42:02Z|00007|vif_plug_representor|WARN|Unsupported flavour for port 'enp7s0f0v1': VIRTUAL 2022-12-20T21:42:02Z|00008|vif_plug_representor|WARN|Unsupported flavour for port 'enp7s0f0v2': VIRTUAL 2022-12-20T21:42:02Z|00009|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting... 2022-12-20T21:42:02Z|00010|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected 2022-12-20T21:42:02Z|00011|main|INFO|OVN internal version is : [22.03.0-20.21.0-58.3] 2022-12-20T21:42:02Z|00012|main|INFO|OVS IDL reconnected, force recompute. 2022-12-20T21:42:02Z|00013|reconnect|INFO|tcp:172.16.50.87:6642: connecting... 2022-12-20T21:42:02Z|00014|main|INFO|OVNSB IDL reconnected, force recompute. 2022-12-20T21:42:02Z|00015|reconnect|INFO|tcp:172.16.50.87:6642: connected 2022-12-20T21:42:02Z|00016|features|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch 2022-12-20T21:42:02Z|00017|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting... 2022-12-20T21:42:02Z|00018|features|INFO|OVS Feature: ct_zero_snat, state: supported 2022-12-20T21:42:02Z|00019|main|INFO|OVS feature set changed, force recompute. 2022-12-20T21:42:02Z|00020|ofctrl|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch 2022-12-20T21:42:02Z|00021|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting... 2022-12-20T21:42:02Z|00022|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected 2022-12-20T21:42:02Z|00001|pinctrl(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting to switch 2022-12-20T21:42:02Z|00002|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connecting... 2022-12-20T21:42:02Z|00023|rconn|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected 2022-12-20T21:42:02Z|00024|main|INFO|OVS feature set changed, force recompute. 2022-12-20T21:42:02Z|00003|rconn(ovn_pinctrl0)|INFO|unix:/var/run/openvswitch/br-int.mgmt: connected 2022-12-20T21:42:02Z|00025|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00026|vif_plug|INFO|Not plugging lport c1-sw0-p1 on direction from VIF plug provider. 2022-12-20T21:42:02Z|00027|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00028|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00029|lflow|WARN|error parsing actions "reg0[3] = put_dhcp_opts(offerip = 10.200.2.12, classless_static_route = { 10.200.0.0/24,10.200.2.1, 10.200.1.0/24,10.200.2.1, 100.64.0.0/10,10.200.2.1}, hostname = usc01a-032-16a-vm1, lease_time = 3600, netmask = 255.255.255.0, router = 10.200.2.1, server_id = 10.200.2.1); next;": Syntax error at `usc01a' expecting constant. 2022-12-20T21:42:02Z|00030|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00031|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00032|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00033|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00034|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:02Z|00035|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:07Z|00036|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:12Z|00037|memory|INFO|10200 kB peak resident set size after 10.2 seconds 2022-12-20T21:42:12Z|00038|memory|INFO|idl-cells:6577 lflow-cache-entries-cache-expr:202 lflow-cache-entries-cache-matches:178 lflow-cache-size-KB:620 local_datapath_usage-KB:1 ofctrl_desired_flow_usage-KB:250 ofctrl_installed_flow_usage-KB:181 ofctrl_sb_flow_ref_usage-KB:105 2022-12-20T21:42:12Z|00039|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:17Z|00040|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:17Z|00041|vif_plug|INFO|Dropped 10 log messages in last 16 seconds (most recently, 5 seconds ago) due to excessive rate 2022-12-20T21:42:17Z|00042|vif_plug|INFO|Not plugging lport c1-sw0-p1 on direction from VIF plug provider. 2022-12-20T21:42:22Z|00043|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:27Z|00044|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:32Z|00045|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:32Z|00046|vif_plug|INFO|Dropped 2 log messages in last 10 seconds (most recently, 5 seconds ago) due to excessive rate 2022-12-20T21:42:32Z|00047|vif_plug|INFO|Not plugging lport c1-sw0-p1 on direction from VIF plug provider. 2022-12-20T21:42:32Z|00048|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:32Z|00049|lflow_cache|INFO|Detected cache inactivity (last active 30001 ms ago): trimming cache 2022-12-20T21:42:37Z|00050|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:42Z|00051|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:47Z|00052|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:47Z|00053|vif_plug|INFO|Dropped 3 log messages in last 15 seconds (most recently, 5 seconds ago) due to excessive rate 2022-12-20T21:42:47Z|00054|vif_plug|INFO|Not plugging lport c1-sw0-p1 on direction from VIF plug provider. 2022-12-20T21:42:52Z|00055|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:42:57Z|00056|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:43:02Z|00057|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:43:02Z|00058|vif_plug|INFO|Dropped 2 log messages in last 10 seconds (most recently, 5 seconds ago) due to excessive rate 2022-12-20T21:43:02Z|00059|vif_plug|INFO|Not plugging lport c1-sw0-p1 on direction from VIF plug provider. 2022-12-20T21:43:02Z|00060|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' 2022-12-20T21:43:07Z|00061|vif_plug_representor|INFO|No representor port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' On Wed, 21 Dec 2022 at 02:50, Frode Nordahl <frode.nord...@canonical.com> wrote: > Hello, Gavin, > > Thank you for your interest in the vif plug infrastructure and the > representor port plugin. See replies inline below. > > tir. 20. des. 2022, 19:29 skrev Gavin McKee via discuss < > ovs-discuss@openvswitch.org>: > >> Hi, >> >> We are hoping someone can help with the following error message. >> >> Here we add the required options to the logical switch port in OVN North >> ovn-nbctl lsp-set-options c1-sw0-p1 requested-chassis=usc01a-032-16a >> vif-plug-type=representor vif-plug:representor:pf-mac=10:70:fd:df:9c:3a >> vif-plug:representor:vf-num=4 >> >> When I check the ovn-controller log on the hypervisor I see the following >> error message: >> 2022-12-20T18:24:42.815Z|00108|vif_plug|INFO|Not plugging lport c1-sw0-p1 >> on direction from VIF plug provider. >> 2022-12-20T18:24:47.816Z|00109|vif_plug_representor|INFO|No representor >> port found for lport: c1-sw0-p1 pf-mac: '10:70:fd:df:9c:3a' vf-num: '4' >> >> Here is the information for the Mellanox Connect X6 card we are using , >> you can see the mac on the physical interface is defined in the entry >> vif-plug:representor:pf-mac=*10:70:fd:df:9c:3a* >> ``` >> root@usc01a-032-16a:/home/gmckee# ip link show enp7s0f0 >> 14: enp7s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9214 qdisc mq master >> ovs-system state UP mode DEFAULT group default qlen 1000 >> link/ether *10:70:fd:df:9c:3a* brd ff:ff:ff:ff:ff:ff >> vf 0 link/ether 10:70:fd:ab:cd:01 brd ff:ff:ff:ff:ff:ff, spoof >> checking off, link-state disable, trust off, query_rss off >> vf 1 link/ether 10:70:fd:ab:cd:02 brd ff:ff:ff:ff:ff:ff, spoof >> checking off, link-state disable, trust off, query_rss off >> vf 2 link/ether 10:70:fd:ab:cd:03 brd ff:ff:ff:ff:ff:ff, spoof >> checking off, link-state disable, trust off, query_rss off >> vf 3 link/ether 10:70:fd:ab:cd:04 brd ff:ff:ff:ff:ff:ff, spoof >> checking off, link-state disable, trust off, query_rss off >> vf 4 link/ether 10:70:fd:e2:44:44 brd ff:ff:ff:ff:ff:ff, spoof >> checking off, link-state disable, trust off, query_rss off >> vf 5 link/ether 10:70:fd:e2:a3:02 brd ff:ff:ff:ff:ff:ff, spoof >> checking off, link-state disable, trust off, query_rss off >> altname enp7s0f0np0 >> ``` >> >> The representor information is as follows >> >> root@usc01a-032-16a:/home/gmckee# ip link show enp7s0f0_4 >> 32: enp7s0f0_4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state >> UP mode DEFAULT group default qlen 1000 >> link/ether ae:4e:85:a3:83:22 brd ff:ff:ff:ff:ff:ff >> altname enp7s0f0npf0vf4 >> > >> the virtual function has already been assigned to a KVM VM. >> >> Any help is greatly appreciated . >> > > The representor plugin was developed for and tested with a SmartNIC DPU, > which behaves slightly different than a system where the embedded switch is > exposed to the host system. > > Having said that, it was developed using generic interfaces, such as > devlink-port [0], so we should be able to make it work. > > The representor plugin looks up the representor by combining information > about PF MAC (`hw_addr`) and VF number from devlink [2], a recent kernel > version is required to expose the `hw_addr` attribute. > > A few questions: > Do you see any other messages logged from the vif_plug_representor module? > > What kernel version is in use? > > Does the `hw_addr` show up for the PCI_PF flavoured port in `devlink port > show`? > > 0: > https://www.kernel.org/doc/html/latest/networking/devlink/devlink-port.html > 1: > https://github.com/ovn-org/ovn-vif/blob/ce1a36f300a74b4eae55a7fec7d18da8b9218e29/lib/vif-plug-providers/representor/vif-plug-representor.c#L407-L469 > > -- > Frode Nordahl > > >> Gav >> >> _______________________________________________ >> discuss mailing list >> disc...@openvswitch.org >> https://mail.openvswitch.org/mailman/listinfo/ovs-discuss >> >
_______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss