Olga - well done - configuration is ok now , now I'll start to do some benchmarks .. Thank you and Best Regards Avi
> -----Original Message----- > From: Olga Shern [mailto:ol...@mellanox.com] > Sent: Wednesday, 21 February, 2018 4:49 PM > To: Avi Cohen (A); ovs-discuss@openvswitch.org > Cc: Erez Ferber > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined Mellanox > references > > Good, we are progressing > > dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually > > dpdk|ERR|contiguous > The problem is that your virtual memory is too fragmented, please reboot your > server > > -----Original Message----- > From: Avi Cohen (A) [mailto:avi.co...@huawei.com] > Sent: Wednesday, February 21, 2018 4:39 PM > To: Olga Shern <ol...@mellanox.com>; ovs-discuss@openvswitch.org > Cc: Erez Ferber <er...@mellanox.com> > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined Mellanox > references > > Olga > You've just read my thoughts > I just was following this guide https://community.mellanox.com/docs/DOC- > 3041 > It fits exactly my env. dpdk17.08 , ovs2.8.1 ofed 4.2.x > > But again failed to add dpdk port > > ovs-vsctl add-port br0 dpdk0 -- set Interface dpdk0 type=dpdk options:dpdk- > devargs=0000:04:00.0,n_rxq_desc=1024,n_txq_desc=1024,n_rxq=1,pmd-rxq- > affinity="0:1" ofport_request=1 > > ovs-vsctl: Error detected while setting up 'dpdk0': could not add network > device > dpdk0 to ofproto (No such device). See ovs-vswitchd log for details. > ovs-vsctl: The default log directory is "/usr/local/var/log/openvswitch". > > -----------------------------------LOG------------------------------------------ > Feb 21 16:32:52 ofer-9 kernel: [867743.839809] device br0 entered > promiscuous mode Feb 21 16:33:00 ofer-9 ovs-vsctl: > ovs|00001|vsctl|INFO|Called as ovs-vsctl add-port br0 dpdk0 -- set Interface > dpdk0 type=dpdk options:dpdk- > devargs=0000:04:00.0,n_rxq_desc=1024,n_txq_desc=1024,n_rxq=1,pmd-rxq- > affinity=0:1 ofport_request=1 Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00194|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually > contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00195|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually > contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00196|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually > contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00197|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually > contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00198|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually > contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00199|dpdk|ERR|PMD: net_mlx5: 0xf15d00: MR creation failure: Invalid > argument Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00201|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:4) configure error: > Invalid argument Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]: > ovs|00202|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration > > > > > > -----Original Message----- > > From: Olga Shern [mailto:ol...@mellanox.com] > > Sent: Wednesday, 21 February, 2018 4:10 PM > > To: Avi Cohen (A); ovs-discuss@openvswitch.org > > Cc: Erez Ferber > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > Mellanox references > > > > Avi, > > > > Can you please follow the following post: > > https://community.mellanox.com/docs/DOC-3041 > > > > it is for DPDK 17.08, but should work the same with 17.05 , therefore > > ignore prerequisites for 17.08. > > > > -----Original Message----- > > From: Avi Cohen (A) [mailto:avi.co...@huawei.com] > > Sent: Wednesday, February 21, 2018 3:52 PM > > To: Olga Shern <ol...@mellanox.com>; ovs-discuss@openvswitch.org > > Cc: Erez Ferber <er...@mellanox.com> > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > Mellanox references > > > > Olga > > > > Please discard the pktgen issue - pktgen is working perfect w mellanox > > card Only ovs is killing me.. > > Best Regards > > Avi > > > > > -----Original Message----- > > > From: Avi Cohen (A) > > > Sent: Wednesday, 21 February, 2018 3:32 PM > > > To: 'Olga Shern'; ovs-discuss@openvswitch.org > > > Cc: Erez Ferber > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > > Mellanox references > > > > > > Thank you Olga > > > This [make -j LDFLAGS=-libverbs] solved the build issue - good > > > > > > Now - back to the old issue - cannot add mellanox port to ovs : both > > > with dpdk > > > options:dpdk-devargs=mlx5_0 and options:dpdk-devargs=0000:04:00.0 > > > - see log below. > > > > > > Also I cannot run pktgen on mlx port - see the error msgs here maybe > > > can give a hint > > > > > > --------------------------------PKTGEN------------------------------ > > > -- > > > --- ./pktgen -l 0-2 -n 3 -w 0000:04:00.0 -w 0000:04:00.1 -- -P -m > > > "1.0, 2.1" > > > ./pktgen: /usr/lib/libmlx5.so.1: no version information available > > > (required by > > > ./pktgen) > > > ./pktgen: /usr/lib/libmlx5.so.1: no version information available > > > (required by > > > ./pktgen) > > > ./pktgen: /usr/lib/libmlx5.so.1: no version information available > > > (required by > > > ./pktgen) > > > > > > Copyright (c) <2010-2017>, Intel Corporation. All rights reserved. > > > Powered by DPDK > > > EAL: Detected 24 lcore(s) > > > EAL: No free hugepages reported in hugepages-1048576kB > > > EAL: Probing VFIO support... > > > EAL: PCI device 0000:04:00.0 on NUMA socket 0 > > > EAL: probe driver: 15b3:1015 net_mlx5 > > > PMD: net_mlx5: PCI information matches, using device "mlx5_0" (SR-IOV: > > > false) > > > PMD: net_mlx5: 1 port(s) detected > > > PMD: net_mlx5: MPS is disabled > > > PMD: net_mlx5: port 1 MAC address is ec:0d:9a:c5:b0:10 > > > ./pktgen: relocation error: ./pktgen: symbol > > > mlx5dv_set_context_attr, version > > > MLX5_1.2 not defined in file libmlx5.so.1 with link time reference > > > > > > > > > --------------------------------ibv_devinfo------------------------- > > > -- > > > -------- > > > > > > hca_id: mlx5_1 > > > transport: InfiniBand (0) > > > fw_ver: 14.21.2010 > > > node_guid: ec0d:9a03:00c5:b011 > > > sys_image_guid: ec0d:9a03:00c5:b010 > > > vendor_id: 0x02c9 > > > vendor_part_id: 4117 > > > hw_ver: 0x0 > > > board_id: MT_2420110034 > > > phys_port_cnt: 1 > > > Device ports: > > > port: 1 > > > state: PORT_ACTIVE (4) > > > max_mtu: 4096 (5) > > > active_mtu: 1024 (3) > > > sm_lid: 0 > > > port_lid: 0 > > > port_lmc: 0x00 > > > link_layer: Ethernet > > > > > > hca_id: mlx5_0 > > > transport: InfiniBand (0) > > > fw_ver: 14.21.2010 > > > node_guid: ec0d:9a03:00c5:b010 > > > sys_image_guid: ec0d:9a03:00c5:b010 > > > vendor_id: 0x02c9 > > > vendor_part_id: 4117 > > > hw_ver: 0x0 > > > board_id: MT_2420110034 > > > phys_port_cnt: 1 > > > Device ports: > > > port: 1 > > > state: PORT_ACTIVE (4) > > > max_mtu: 4096 (5) > > > active_mtu: 1024 (3) > > > sm_lid: 0 > > > port_lid: 0 > > > port_lmc: 0x00 > > > link_layer: Ethernet > > > > > > > > > > > > --------------------------------OVS--------------------------------- > > > -- > > > > > > ovs-vsctl --timeout 10 add-port br-phy dpdk0 -- set Interface dpdk0 > > type=dpdk > > > options:dpdk-devargs=mlx5_0 > > > ovs-vsctl: Error detected while setting up 'dpdk0': Error attaching > > > device 'mlx5_0' to DPDK. See ovs-vswitchd log for details. > > > > > > > > > > > > Feb 21 15:20:25 ofer-9 ovs-vsctl: ovs|00001|vsctl|INFO|Called as > > > ovs-vsctl -- timeout 10 add-port br-phy dpdk0 -- set Interface dpdk0 > > > type=dpdk > > > options:dpdk-devargs=mlx5_0 Feb 21 15:20:25 ofer-9 ovs-vswitchd[19971]: > > > ovs|00057|dpdk|ERR|EAL: Unable to find a bus for the device 'mlx5_0' > > > Feb 21 15:20:25 ofer-9 ovs-vswitchd[19971]: > > > ovs|00058|netdev_dpdk|WARN|Error attaching device 'mlx5_0' to DPDK > > > ovs|00058|Feb > > > 21 15:20:25 ofer-9 ovs-vswitchd[19971]: ovs|00059|netdev|WARN|dpdk0: > > > could not set configuration (Invalid argument) > > > > > > > > > ovs-vsctl --timeout 10 add-port br-phy dpdk0 -- set Interface dpdk0 > > type=dpdk > > > options:dpdk-devargs=0000:04:00.0 > > > > > > > > > Feb 21 15:22:37 ofer-9 ovs-vsctl: ovs|00001|vsctl|INFO|Called as > > > ovs-vsctl -- timeout 10 add-port br-phy dpdk0 -- set Interface dpdk0 > > > type=dpdk > > > options:dpdk-devargs=0000:04:00.0 Feb 21 15:22:37 ofer-9 ovs- > > > vswitchd[19971]: ovs|00060|dpif_netdev|INFO|PMD thread on numa_id: > > > 0, core id: 7 created. > > > Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00061|dpif_netdev|INFO|There are 1 pmd threads on numa node 0 > > > ovs|00061|Feb > > > ovs|00061|21 > > > 15:22:37 ofer-9 ovs-vswitchd[19971]: ovs|00062|dpdk|INFO|PMD: > net_mlx5: > > > 0xf15d00: TX queues number update: 0 -> 2 Feb 21 15:22:37 ofer-9 > > > ovs- > > > vswitchd[19971]: ovs|00063|dpdk|INFO|PMD: net_mlx5: 0xf15d00: RX > > > queues number update: 0 -> 1 Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00064|dpdk|ERR|PMD: net_mlx5: mempool 0x7f65f167dec0: not > > > ovs|00064|dpdk|ERR|virtually > > > contiguous Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00065|dpdk|ERR|PMD: net_mlx5: mempool 0x7f65f167dec0: not > > > ovs|00065|dpdk|ERR|virtually > > > contiguous Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00066|dpdk|ERR|PMD: net_mlx5: mempool 0x7f65f167dec0: not > > > ovs|00066|dpdk|ERR|virtually > > > contiguous Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00067|dpdk|ERR|PMD: net_mlx5: 0xf15d00: MR creation failure: > > > ovs|00067|dpdk|ERR|Invalid > > > argument Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00068|netdev_dpdk|INFO|Interface dpdk0 rxq(0) setup error: > > > ovs|00068|Invalid > > > argument Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00069|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:2) configure error: > > > Invalid argument Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00070|dpif_netdev|ERR|Failed to set interface dpdk0 new > > > ovs|00070|configuration > > > Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]: > > > ovs|00071|bridge|WARN|could not add network device dpdk0 to ofproto > > > (No such device) > > > > > > > > > > > > > -----Original Message----- > > > > From: Olga Shern [mailto:ol...@mellanox.com] > > > > Sent: Wednesday, 21 February, 2018 12:13 PM > > > > To: Avi Cohen (A); ovs-discuss@openvswitch.org > > > > Cc: Erez Ferber > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > > > Mellanox references > > > > > > > > Please use the following: > > > > > > > > # ./boot.sh > > > > # ./configure --with-dpdk=$DPDK_BUILD # make -j LDFLAGS=-libverbs > > > > # make install > > > > > > > > > > > > -----Original Message----- > > > > From: Avi Cohen (A) [mailto:avi.co...@huawei.com] > > > > Sent: Wednesday, February 21, 2018 11:57 AM > > > > To: Olga Shern <ol...@mellanox.com>; ovs-discuss@openvswitch.org > > > > Cc: Erez Ferber <er...@mellanox.com> > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > > > Mellanox references > > > > > > > > Olga > > > > > > > > ./boot.sh > > > > ./configure --with-dpdk=$DPDK_BUILD Make install > > > > > > > > Best Regards > > > > Avi > > > > > > > > > -----Original Message----- > > > > > From: Olga Shern [mailto:ol...@mellanox.com] > > > > > Sent: Tuesday, 20 February, 2018 7:20 PM > > > > > To: Avi Cohen (A); ovs-discuss@openvswitch.org > > > > > Cc: Erez Ferber > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > > > > Mellanox references > > > > > > > > > > How do you compile OVS? > > > > > > > > > > -----Original Message----- > > > > > From: Avi Cohen (A) [mailto:avi.co...@huawei.com] > > > > > Sent: Tuesday, February 20, 2018 1:39 PM > > > > > To: Olga Shern <ol...@mellanox.com>; ovs-discuss@openvswitch.org > > > > > Cc: Erez Ferber <er...@mellanox.com> > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined > > > > > Mellanox references > > > > > > > > > > Thank you Olga > > > > > > > > > > Now dpdk build is ok but ovs build fail because of ibv* > > > > > undefined reference > > > > > > > > > > > > > > > > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `mlx5_dev_close': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:195: > > > > > undefined reference to `ibv_dealloc_pd' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:196: > > > > > undefined reference to `ibv_close_device' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `mlx5_pci_probe': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:453: > > > > > undefined reference to `ibv_get_device_list' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:513: > > > > > undefined reference to `ibv_open_device' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:533: > > > > > undefined reference to `ibv_query_device' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:829: > > > > > undefined reference to `ibv_close_device' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:831: > > > > > undefined reference to `ibv_free_device_list' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:518: > > > > > undefined reference to `ibv_free_device_list' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:568: > > > > > undefined reference to `ibv_open_device' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `___ibv_query_port': > > > > > /usr/include/infiniband/verbs.h:1227: undefined reference to > > > > `ibv_query_port' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `mlx5_pci_probe': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:591: > > > > > undefined reference to `ibv_alloc_pd' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:808: > > > > > undefined reference to `ibv_dealloc_pd' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:810: > > > > > undefined reference to `ibv_close_device' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:749: > > > > > undefined reference to `ibv_get_device_name' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:518: > > > > > undefined reference to `ibv_free_device_list' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `rte_mlx5_pmd_init': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:897: > > > > > undefined reference to `ibv_fork_init' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function > > > `priv_create_hash_rxqs': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:499: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function > > > `priv_destroy_hash_rxqs': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:549: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function `rxq_cleanup': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:754: > > > > > undefined reference to `ibv_destroy_cq' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:756: > > > > > undefined reference to `ibv_destroy_comp_channel' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:758: > > > > > undefined reference to `ibv_dereg_mr' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function `rxq_ctrl_setup': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:979: > > > > > undefined reference to `ibv_create_comp_channel' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function > > `mlx5_rx_intr_disable': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:1456: > > > > > undefined reference to `ibv_get_cq_event' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:1464: > > > > > undefined reference to `ibv_ack_cq_events' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_txq.o): In function `txq_cleanup': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_txq.c:148: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_txq.c:150: > > > > > undefined reference to `ibv_destroy_cq' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_txq.c:155: > > > > > undefined reference to `ibv_dereg_mr' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_txq.o): In function > `ibv_exp_create_qp': > > > > > /usr/include/infiniband/verbs_exp.h:3009: undefined reference to > > > > > `ibv_create_qp' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_ethdev.o): In function > > > > > `priv_dev_link_status_handler': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1240: > > > > > undefined reference to `ibv_ack_async_event' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1233: > > > > > undefined reference to `ibv_get_async_event' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1240: > > > > > undefined reference to `ibv_ack_async_event' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1233: > > > > > undefined reference to `ibv_get_async_event' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_fdir.o): In function > > > `priv_fdir_queue_create': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_fdir.c:540: > > > > > undefined reference to `ibv_destroy_cq' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_fdir.o): In function > > > > `priv_fdir_queue_destroy': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_fdir.c:431: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_fdir.c:437: > > > > > undefined reference to `ibv_destroy_cq' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_mr.o): In function `mlx5_mp2mr': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_mr.c:162: > > > > > undefined reference to `ibv_reg_mr' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_mr.o): In function `txq_mp2mr_reg': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_mr.c:204: > > > > > undefined reference to `ibv_dereg_mr' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_mr.c:204: > > > > > undefined reference to `ibv_dereg_mr' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function > > > > > `priv_flow_create_drop_queue': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1440: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1448: > > > > > undefined reference to `ibv_destroy_cq' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function > `priv_flow_destroy': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1258: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1264: > > > > > undefined reference to `ibv_destroy_cq' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function > > > > > `priv_flow_create_action_queue': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1130: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp- > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function > > > > > `priv_flow_delete_drop_queue': > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1470: > > > > > undefined reference to `ibv_destroy_qp' > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1478: > > > > > undefined reference to `ibv_destroy_cq' > > > > > > > > > > Best Regards > > > > > Avi > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > From: Olga Shern [mailto:ol...@mellanox.com] > > > > > > Sent: Tuesday, 20 February, 2018 1:17 PM > > > > > > To: Avi Cohen (A); ovs-discuss@openvswitch.org > > > > > > Cc: Erez Ferber > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - > > > > > > Undefined Mellanox references > > > > > > > > > > > > Avi, > > > > > > > > > > > > Every DPDK version has specific MLNX_OFED that is supports: > > > > > > If you will follow the instruction that I sent to you will see that: > > > > > > Mellanox OFED version should be 4.0-2.0.0.0 and installation > > > > > > should be ./mlnxofedinstall > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http%3A%2 > > > > > > F% > > > > > > 2F > > > > > > dp > > > > > > dk > > > > > > .org%2Fdoc%2Fguides- > > > > > 17.05%2Fnics%2Fmlx5.html&data=02%7C01%7Colgas%40me > > > > > > > > > > > > > > > > > > > > > llanox.com%7Caf7aca2bf64f4dc1752508d578567bef%7Ca652971c7d2e4d9ba6 > > > > > a4d1 > > > > > > > > > > > > > > > > > > > > > 49256f461b%7C0%7C0%7C636547235204887682&sdata=X6L6dwwsOaQXEY4yS > > > > > 1BwgHAM > > > > > > Dpumfcuni4pB6dxP6eU%3D&reserved=0 > > > > > > > > > > > > Now, you can stay with MLNX_OFED 4.2, but you will need to > > > > > > reinstall it without --upstream-libs flags. > > > > > > > > > > > > Starting DPDK 17.11 Mellanox PMDs supports upstream rdma-core > > > > > > libs, therefore the installation is different for DPDK > > > > > > versions starting > > > > > > 17.11 Since user shouldn't be aware about this info, user > > > > > > should follow the exact instructions! > > > > > > > > > > > > Best Regards, > > > > > > Olga > > > > > > > > > > > > -----Original Message----- > > > > > > From: Avi Cohen (A) [mailto:avi.co...@huawei.com] > > > > > > Sent: Tuesday, February 20, 2018 1:03 PM > > > > > > To: Olga Shern <ol...@mellanox.com>; > > > > > > ovs-discuss@openvswitch.org > > > > > > Cc: Erez Ferber <er...@mellanox.com> > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - > > > > > > Undefined Mellanox references > > > > > > > > > > > > Olga > > > > > > > > > > > > I have OFED - MLNX_OFED_LINUX-4.2-1.2.0.0-ubuntu16.04-x86_64 > > > > > > I install it like this : ./mlnxofedinstall --force --dpdk > > > > > > --upstream-libs NOTE that I don't have this problem with > > > > > > dpdk.17.11/ > > > > > > dpdk.18.02 > > > > > > > > > > > > Best Regards > > > > > > Avi > > > > > > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > From: Olga Shern [mailto:ol...@mellanox.com] > > > > > > > Sent: Tuesday, 20 February, 2018 12:19 PM > > > > > > > To: Avi Cohen (A); ovs-discuss@openvswitch.org > > > > > > > Cc: Erez Ferber > > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - > > > > > > > Undefined Mellanox references > > > > > > > > > > > > > > Looks like you didn't install MLNX_OFED ir something wrong > > > > > > > with your installation, the following file is missing: > > > > > > > /usr/include/infiniband/mlx5_hw.h > > > > > > > > > > > > > > What OFED did you install and how? > > > > > > > > > > > > > > -----Original Message----- > > > > > > > From: Avi Cohen (A) [mailto:avi.co...@huawei.com] > > > > > > > Sent: Tuesday, February 20, 2018 10:21 AM > > > > > > > To: Olga Shern <ol...@mellanox.com>; > > > > > > > ovs-discuss@openvswitch.org > > > > > > > Cc: Erez Ferber <er...@mellanox.com> > > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - > > > > > > > Undefined Mellanox references > > > > > > > > > > > > > > Thank you Olga > > > > > > > What I'm trying to do is to run ovs-dpdk w connectx4 card, I > > > > > > > don't care about the versions but only try to find a > > > > > > > combination of versions (dpdk/ovs/kernel) that is working. > > > > > > > As you've suggested, now I'm working with dpdk.17.05 (ovs 2.8.1) > > > > > > > . > > > > > > > I'm following the > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http%3A > > > > > > > %2 > > > > > > > F% > > > > > > > 2F > > > > > > > dp > > > > > > > dk > > > > > > > .org > > > > > > > %2Fdoc%2Fguides- > > > > > > > > > > > > > > > > > > > > > > > > > > > > 17.05%2Fnics%2Fmlx5.html&data=02%7C01%7Colgas%40mellanox.com%7C45 > > > > > > > > > > > > > > > > > > > > > > > > > > > > 2a99fe115941a1fd0508d5783add13%7Ca652971c7d2e4d9ba6a4d149256f461b > > > > > > > > > > > > > > > > > > > > > > > > > > > > %7C0%7C0%7C636547116571396518&sdata=YyijRGomnVwvz8epD90ec1lx4YyB > > > > > > > 2Fn2InZvgK5fqfY%3D&reserved=0 And I have compilation error > > > > > > > when building dpdk - [ note that dpdk > > > > > > > 18.02 and > > > > > > > dpdk.17.11 build pass ok, but then ovs failed with undefined > > > > > > > mlx ref.] > > > > > > > > > > > > > > Dpdk.17.05 - compilation error: > > > > > > > -------------- > > > > > > > In file included from /home/avi/dpdk-stable- > > > > > > > 17.05.2/drivers/net/mlx5/mlx5.h:68:0, > > > > > > > from /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:67: > > > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxtx.h:46:32: > > > > > > > fatal > > > > > > > error: infiniband/mlx5_hw.h: No such file or directory > > > > > > > ------------------- > > > > > > > > > > > > > > Best Regards > > > > > > > Avi > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > > From: Olga Shern [mailto:ol...@mellanox.com] > > > > > > > > Sent: Monday, 19 February, 2018 11:31 PM > > > > > > > > To: Avi Cohen (A); ovs-discuss@openvswitch.org > > > > > > > > Cc: Erez Ferber > > > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - > > > > > > > > Undefined Mellanox references > > > > > > > > > > > > > > > > Hi Avi, > > > > > > > > > > > > > > > > Can you please explain what you are trying to do? > > > > > > > > Are you trying to test latest DPDK with OVS 2.8.1? > > > > > > > > OVS 2.8.1 supports DPDK 17.05.1 , and as far as I know, it > > > > > > > > also working with DPDK 17.08 DPDK 17.11 is supported with > > > > > > > > OVS > > 2.9. > > > > > > > > > > > > > > > > If you want help regarding DPDK you should send emails to > > > > > > > > the us...@dpdk.org > > > > > > > > > > > > > > > > Now, regarding what I stated before, you need to follow > > > > > > > > procedure from DPDK.org for mlx PMDs : > > > > > > > > For 17.08: > > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http% > > > > > > > > 3A > > > > > > > > %2 > > > > > > > > F% > > > > > > > > 2F > > > > > > > > dp > > > > > > > > dk > > > > > > > > .org%2Fdoc%2Fguides- > > > > > > > 17.08%2Fnics%2Fmlx5.html&data=02%7C01%7Colgas%40me > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > llanox.com%7C452a99fe115941a1fd0508d5783add13%7Ca652971c7d2e4d9ba > > > > > > > 6a4d1 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 49256f461b%7C0%7C0%7C636547116571396518&sdata=ITJ%2FVuP09A2911IU > > > > > > > %2BN%2 > > > > > > > > BQqscF4aYBGl2vYbEK7qU9QfM%3D&reserved=0 , Please go to > > > section > > > > > > 20.7. > > > > > > > > Quick Start Guide and check section 20.5. Prerequisites > > > > > > > > MLNX_OFED > > > > > > > > 4.1 ./mlnxofedinstall For 17.11: > > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http% > > > > > > > > 3A > > > > > > > > %2 > > > > > > > > F% > > > > > > > > 2F > > > > > > > > dp > > > > > > > > dk > > > > > > > > .org%2Fdoc%2Fguides- > > > > > > > &data=02%7C01%7Colgas%40mellanox.com%7C452a99fe115 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 941a1fd0508d5783add13%7Ca652971c7d2e4d9ba6a4d149256f461b%7C0%7C0 > > > > > > > %7C636 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 547116571396518&sdata=gxX93MLNYo3vhR0p32hQn37I8yuSm5g4xqsWpBsKQ > > > > > > > 3U%3D&r > > > > > > > > eserved=0 17.11/nics/mlx5.html , please go to section > > > > > > > > 21.7 (Quick Start Guide on OFED) and check section 21.5.1.2. > > > > > > > > Mellanox OFED for the right MLNX_OFED to use MLNX_OFED 4.2 > > > > > > > > ./mlnxofedinstall --upstream-libs --dpdk > > > > > > > > > > > > > > > > Etc ... > > > > > > > > > > > > > > > > Hope this helps > > > > > > > > > > > > > > > > Best Regards, > > > > > > > > Olga > > > > > > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > > > > > > From: ovs-discuss-boun...@openvswitch.org > > > > > > > > [mailto:ovs-discuss- boun...@openvswitch.org] On Behalf Of > > > > > > > > Avi Cohen (A) > > > > > > > > Sent: Monday, February 19, 2018 6:21 PM > > > > > > > > To: ovs-discuss@openvswitch.org > > > > > > > > Subject: [ovs-discuss] OvS build (w DPDK) failed - > > > > > > > > Undefined Mellanox references > > > > > > > > > > > > > > > > Hi, > > > > > > > > I build dpdk-18.02 with MLX5_PMD - ok.. > > > > > > > > Then I failed to build ovs - 2.8.1] with dpdk and get > > > > > > > > many undefined reference for mlx I have mellanox OFED > > > > > > > > installed > > > > > > > > > > > > > > > > Some of the errors here : > > > > > > > > > > > > > > > > > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > `mlx5_glue_dv_init_obj': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:307: > > > > > > > > undefined reference to `mlx5dv_init_obj' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > > > `mlx5_glue_dv_set_context_attr': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:301: > > > > > > > > undefined reference to `mlx5dv_set_context_attr' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > > > `mlx5_glue_dv_query_device': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:294: > > > > > > > > undefined reference to `mlx5dv_query_device' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > > > `mlx5_glue_dv_create_cq': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:287: > > > > > > > > undefined reference to `mlx5dv_create_cq' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > > > `mlx5_glue_port_state_str': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:273: > > > > > > > > undefined reference to `ibv_port_state_str' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > > > `mlx5_glue_get_async_event': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:267: > > > > > > > > undefined reference to `ibv_get_async_event' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > > > `mlx5_glue_ack_async_event': > > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:260: > > > > > > > > undefined reference to `ibv_ack_async_event' > > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp- > > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function > > > > > > `mlx5_glue_dereg_mr': > > > > > > > > > > > > > > > > Who can help ? > > > > > > > > Best Regards > > > > > > > > Avi > > > > > > > > _______________________________________________ > > > > > > > > discuss mailing list > > > > > > > > disc...@openvswitch.org > > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=https > > > > > > > > %3 > > > > > > > > A% > > > > > > > > 2F > > > > > > > > %2 > > > > > > > > Fm > > > > > > > > ai > > > > > > > > l.op > > > > > > > > envswitch.org%2Fmailman%2Flistinfo%2Fovs- > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > discuss&data=02%7C01%7Colgas%40mellanox.com%7Cbd7017779e624a247e3 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 508d577b4d322%7Ca652971c7d2e4d9ba6a4d149256f461b%7C0%7C0%7C6365 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 46540872320081&sdata=qPOVcZSoBvPQzpSKw9632jOC0iRhPwpnGdULr3u8KU > > > > > > > > Q%3D&reserved=0 _______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss