Any chance you can capture backtrace? just "gdb —args vpp unix interactive”
Thanks, Damjan > On 24 May 2017, at 13:10, Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES > at Cisco) <mcmar...@cisco.com> wrote: > > Hi, > > I tried your patch, I built rpms from it and then reinstalled vpp with those > rpms. I ensured that the interface was not bound to kernel or dpdk. But I got > Segmentation fault. See output: > > [root@overcloud-novacompute-1 ~]# dpdk-devbind --status > > Network devices using DPDK-compatible driver > ============================================ > <none> > > Network devices using kernel driver > =================================== > 0000:06:00.0 'VIC Ethernet NIC' if=enp6s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:09:00.0 'VIC Ethernet NIC' if=enp9s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:0a:00.0 'VIC Ethernet NIC' if=enp10s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:0f:00.0 'VIC Ethernet NIC' if=enp15s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:10:00.0 'VIC Ethernet NIC' if=enp16s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:11:00.0 'VIC Ethernet NIC' if=enp17s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:12:00.0 'VIC Ethernet NIC' if=enp18s0 drv=enic > unused=vfio-pci,uio_pci_generic > > Other network devices > ===================== > 0000:07:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic > 0000:08:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic > > Crypto devices using DPDK-compatible driver > =========================================== > <none> > > Crypto devices using kernel driver > ================================== > <none> > > Other crypto devices > ==================== > <none> > > > [root@overcloud-novacompute-1 ~]# vpp unix interactive > vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins > load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control Lists) > load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane Development > Kit (DPDK)) > load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per Packet) > load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) > load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator > addressing for IPv6) > load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) > load_one_plugin:114: Plugin disabled (default): ixge_plugin.so > load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) > load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid Deployment > on IPv4 Infrastructure (RFC5969)) > load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory Interface > (experimetal)) > load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address > Translation) > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/acl_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/lb_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/snat_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so > vlib_pci_bind_to_uio: Skipping PCI device 0000:06:00.0 as host interface > enp6s0 is up > Segmentation fault > > Michal > > -----Original Message----- > From: Damjan Marion (damarion) > Sent: Tuesday, May 23, 2017 6:39 PM > To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) > <mcmar...@cisco.com> > Cc: Dave Barach (dbarach) <dbar...@cisco.com>; Marco Varlese > <marco.varl...@suse.com>; Kinsella, Ray <ray.kinse...@intel.com>; > vpp-dev@lists.fd.io > Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to 1707 > master > > > Can you try following patch without manual bind: > > https://gerrit.fd.io/r/#/c/6846 > > Thanks, > > Damjan > > >> On 23 May 2017, at 15:53, Michal Cmarada -X (mcmarada - PANTHEON >> TECHNOLOGIES at Cisco) <mcmar...@cisco.com> wrote: >> >> Hi Dave, >> >> The manual binding helped. I used uio_pci_generic and now VPP finally sees >> them. Thanks. >> >> Michal >> >> -----Original Message----- >> From: Dave Barach (dbarach) >> Sent: Tuesday, May 23, 2017 3:39 PM >> To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) >> <mcmar...@cisco.com>; Marco Varlese <marco.varl...@suse.com>; >> Kinsella, Ray <ray.kinse...@intel.com>; vpp-dev@lists.fd.io >> Subject: RE: [vpp-dev] VPP has no interfaces after update from 1704 to >> 1707 master >> >> Please attempt to bind the VIC device(s) manually - to uio_pci_generic - >> using dpdk-devbind. >> >> Until / unless that works, there isn't a chance that vpp will drive the >> devices. You may have better luck with the igb_uio kernel module, or not... >> >> Thanks… Dave >> >> -----Original Message----- >> From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] >> On Behalf Of Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at >> Cisco) >> Sent: Tuesday, May 23, 2017 9:13 AM >> To: Marco Varlese <marco.varl...@suse.com>; Kinsella, Ray >> <ray.kinse...@intel.com>; vpp-dev@lists.fd.io >> Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to >> 1707 master >> >> Hi, >> >> I meant that they are in DOWN state in "ip link list": >> [root@overcloud-novacompute-1 ~]# ip link list >> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode >> DEFAULT qlen 1 >> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 >> 2: enp6s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode >> DEFAULT qlen 1000 >> link/ether 00:25:b5:00:01:50 brd ff:ff:ff:ff:ff:ff >> 3: enp7s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT >> qlen 1000 >> link/ether 00:25:b5:00:01:4f brd ff:ff:ff:ff:ff:ff >> 4: enp8s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT >> qlen 1000 >> link/ether 00:25:b5:00:01:4e brd ff:ff:ff:ff:ff:ff >> >> I also tried to unbind them like you suggested. then the status of >> dpdk-nicbind is: >> [root@overcloud-novacompute-1 tools]# dpdk_nic_bind --status >> >> Network devices using DPDK-compatible driver >> ============================================ >> <none> >> >> Network devices using kernel driver >> =================================== >> 0000:06:00.0 'VIC Ethernet NIC' if=enp6s0 drv=enic >> unused=vfio-pci,uio_pci_generic *Active* >> 0000:09:00.0 'VIC Ethernet NIC' if=enp9s0 drv=enic >> unused=vfio-pci,uio_pci_generic *Active* >> 0000:0a:00.0 'VIC Ethernet NIC' if=enp10s0 drv=enic >> unused=vfio-pci,uio_pci_generic *Active* >> 0000:0f:00.0 'VIC Ethernet NIC' if=enp15s0 drv=enic >> unused=vfio-pci,uio_pci_generic >> 0000:10:00.0 'VIC Ethernet NIC' if=enp16s0 drv=enic >> unused=vfio-pci,uio_pci_generic >> 0000:11:00.0 'VIC Ethernet NIC' if=enp17s0 drv=enic >> unused=vfio-pci,uio_pci_generic >> 0000:12:00.0 'VIC Ethernet NIC' if=enp18s0 drv=enic >> unused=vfio-pci,uio_pci_generic >> >> Other network devices >> ===================== >> 0000:07:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic >> 0000:08:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic >> >> [root@overcloud-novacompute-1 tools]# vpp unix interactive >> vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins >> load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control >> Lists) >> load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane >> Development Kit (DPDK)) >> load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per >> Packet) >> load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) >> load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator >> addressing for IPv6) >> load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) >> load_one_plugin:114: Plugin disabled (default): ixge_plugin.so >> load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) >> load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid >> Deployment on IPv4 Infrastructure (RFC5969)) >> load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory >> Interface (experimetal)) >> load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address >> Translation) >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/acl_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/lb_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/snat_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so >> EAL: No free hugepages reported in hugepages-1048576kB >> EAL: VFIO support initialized >> DPDK physical memory layout: >> Segment 0: phys:0x18400000, len:247463936, virt:0x7faebc000000, >> socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 1: >> phys:0x31c00000, len:20971520, virt:0x7fae95600000, socket_id:0, >> hugepage_sz:2097152, nchannel:0, nrank:0 Segment 2: phys:0x2d44800000, >> len:2097152, virt:0x7fac56400000, socket_id:1, hugepage_sz:2097152, >> nchannel:0, nrank:0 Segment 3: phys:0x2d44c00000, len:266338304, >> virt:0x7faa26a00000, socket_id:1, hugepage_sz:2097152, nchannel:0, >> nrank:0 >> 0: dpdk_ipsec_process:239: not enough Cryptodevs, default to OpenSSL >> IPsec >> 0: dpdk_lib_init:182: DPDK drivers found no ports... >> 0: svm_client_scan_this_region_nolock:1140: /vpe-api: cleanup ghost >> pid 6623 >> 0: svm_client_scan_this_region_nolock:1140: /global_vm: cleanup ghost pid >> 6623 >> _______ _ _ _____ ___ >> __/ __/ _ \ (_)__ | | / / _ \/ _ \ >> _/ _// // / / / _ \ | |/ / ___/ ___/ >> /_/ /____(_)_/\___/ |___/_/ /_/ >> >> vpp# sh int >> Name Idx State Counter >> Count >> local0 0 down >> >> But I still cannot bind those interfaces. I tried all drivers that you >> mentioned and still nothing. >> >> >> Michal >> >> >> -----Original Message----- >> From: Marco Varlese [mailto:marco.varl...@suse.com] >> Sent: Tuesday, May 23, 2017 2:38 PM >> To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) >> <mcmar...@cisco.com>; Kinsella, Ray <ray.kinse...@intel.com>; >> vpp-dev@lists.fd.io >> Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to >> 1707 master >> >> You say the ports are "down"... not sure how to interpret that but it might >> mean that are still being binded to the kernel drivers. >> >> Did you try and see if those ports are still binded with the Linux kernel >> drivers? What is "dpdk-devbind.py --status" reporting? >> >> What driver are you using in startup.conf to be used with DPDK? (vfio-pci? >> uio- pci-generic? igb_uio?). Can you make sure the respective driver is >> loaded on the system? >> >> You can unbind the ports from the kernel drivers via dpdk-devbind.py >> --unbind 0000:82:00.0 (where 0000:82:00.0 is the PCI address >> representing your port on your system) >> >> >> - Marco >> >> On Tue, 2017-05-23 at 12:19 +0000, Michal Cmarada -X (mcmarada - PANTHEON >> TECHNOLOGIES at Cisco) wrote: >>> Yes it shoud be enabled because I see "DPDK drivers found no ports..." >>> in output from "vpp unix interactive" command: >>> >>> [root@overcloud-novacompute-1 ~]# vpp unix interactive >>> vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins >>> load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control >>> Lists) >>> load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane >>> Development Kit >>> (DPDK)) >>> load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per >>> Packet) >>> load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) >>> load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator >>> addressing for IPv6) >>> load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) >>> load_one_plugin:114: Plugin disabled (default): ixge_plugin.so >>> load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) >>> load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid >>> Deployment on IPv4 Infrastructure (RFC5969)) >>> load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory >>> Interface >>> (experimetal)) >>> load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address >>> Translation) >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/acl_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/lb_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/snat_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so >>> load_one_plugin:63: Loaded plugin: >>> /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so >>> EAL: No free hugepages reported in hugepages-1048576kB >>> EAL: VFIO support initialized >>> DPDK physical memory layout: >>> Segment 0: phys:0x18400000, len:247463936, virt:0x7f9d81a00000, >>> socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 1: >>> phys:0x31c00000, len:20971520, virt:0x7f9d5b000000, socket_id:0, >>> hugepage_sz:2097152, nchannel:0, nrank:0 Segment 2: >>> phys:0x2d44800000, len:2097152, virt:0x7f9b1be00000, socket_id:1, >>> hugepage_sz:2097152, nchannel:0, nrank:0 Segment 3: >>> phys:0x2d44c00000, len:266338304, virt:0x7f98ec400000, socket_id:1, >>> hugepage_sz:2097152, nchannel:0, >>> nrank:0 >>> 0: dpdk_ipsec_process:239: not enough Cryptodevs, default to OpenSSL >>> IPsec >>> 0: dpdk_lib_init:182: DPDK drivers found no ports... >>> 0: svm_client_scan_this_region_nolock:1140: /vpe-api: cleanup ghost >>> pid 5540 >>> 0: svm_client_scan_this_region_nolock:1140: /global_vm: cleanup ghost >>> pid 5540 >>> _______ _ _ _____ ___ >>> __/ __/ _ \ (_)__ | | / / _ \/ _ \ >>> _/ _// // / / / _ \ | |/ / ___/ ___/ >>> /_/ /____(_)_/\___/ |___/_/ /_/ >>> >>> vpp# sh int >>> Name Idx State Counter Cou >>> nt >>> local0 0 down >>> >>> -----Original Message----- >>> From: vpp-dev-boun...@lists.fd.io >>> [mailto:vpp-dev-boun...@lists.fd.io] >>> On Behalf Of Kinsella, Ray >>> Sent: Tuesday, May 23, 2017 2:16 PM >>> To: vpp-dev@lists.fd.io >>> Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 >>> to >>> 1707 master >>> >>> Is the dpdk plugin enabled? >>> >>> Ray K >>> >>> On 23/05/2017 13:01, Michal Cmarada -X (mcmarada - PANTHEON >>> TECHNOLOGIES at >>> Cisco) wrote: >>>> >>>> Hi VPP devs, >>>> >>>> >>>> >>>> I tried to update VPP to master version from stable 1704 on Centos. >>>> In >>>> 1704 everything was working. Now in 1707 master VPP does not pick >>>> the physical interfaces. I tried to change the drivers and I >>>> whitelisted the interfaces in startup.conf for vpp. All the >>>> interfaces are down so VPP should pick them. But nothing works. I >>>> tried to update dpdk to the version that was provided on vpp repo >>>> but it didn`t help. Can you help me with this issue? >>>> >>>> >>>> >>>> Here are some details that may help: >>>> >>>> OS: centos-release-7-3.1611.el7.centos.x86_64 >>>> >>>> >>>> >>>> Installed Packages >>>> >>>> Name : vpp >>>> >>>> Arch : x86_64 >>>> >>>> Version : 17.07 >>>> >>>> Release : rc0~274_gbb292f4~b2376 >>>> >>>> Size : 1.7 M >>>> >>>> Repo : installed >>>> >>>> From repo : fdio-master >>>> >>>> Summary : Vector Packet Processing >>>> >>>> License : MIT >>>> >>>> Description : This package provides VPP executables: vpp, >>>> vpp_api_test, vpp_json_test >>>> >>>> : vpp - the vector packet engine >>>> >>>> : vpp_api_test - vector packet engine API test tool >>>> >>>> : vpp_json_test - vector packet engine JSON test tool >>>> >>>> >>>> >>>> Installed Packages >>>> >>>> Name : dpdk >>>> >>>> Arch : x86_64 >>>> >>>> Version : 16.11 >>>> >>>> Release : 5.el7.centos >>>> >>>> Size : 3.5 M >>>> >>>> Repo : installed >>>> >>>> From repo : fdio-master >>>> >>>> Summary : Set of libraries and drivers for fast packet >>>> processing >>>> >>>> URL : http://dpdk.org >>>> >>>> License : BSD and LGPLv2 and GPLv2 >>>> >>>> Description : The Data Plane Development Kit is a set of libraries >>>> and drivers for >>>> >>>> : fast packet processing in the user space. >>>> >>>> >>>> >>>> vpp# sh pci >>>> >>>> Address Sock VID:PID Link Speed Driver Product >>>> Name Vital Product Data >>>> >>>> 0000:06:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:07:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:08:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:09:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:10:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:11:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:12:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:0a:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> 0000:0f:00.0 0 1137:0043 8.0 GT/s x16 enic >>>> >>>> >>>> >>>> Thanks >>>> >>>> Michal >>>> >>>> >>>> >>>> _______________________________________________ >>>> vpp-dev mailing list >>>> vpp-dev@lists.fd.io >>>> https://lists.fd.io/mailman/listinfo/vpp-dev >>>> >>> _______________________________________________ >>> vpp-dev mailing list >>> vpp-dev@lists.fd.io >>> https://lists.fd.io/mailman/listinfo/vpp-dev >>> _______________________________________________ >>> vpp-dev mailing list >>> vpp-dev@lists.fd.io >>> https://lists.fd.io/mailman/listinfo/vpp-dev >>> >> _______________________________________________ >> vpp-dev mailing list >> vpp-dev@lists.fd.io >> https://lists.fd.io/mailman/listinfo/vpp-dev >> _______________________________________________ >> vpp-dev mailing list >> vpp-dev@lists.fd.io >> https://lists.fd.io/mailman/listinfo/vpp-dev > > _______________________________________________ > vpp-dev mailing list > vpp-dev@lists.fd.io > https://lists.fd.io/mailman/listinfo/vpp-dev _______________________________________________ vpp-dev mailing list vpp-dev@lists.fd.io https://lists.fd.io/mailman/listinfo/vpp-dev
