Re: [ewg] To OFED or not to OFED
We had already talked in our last ewg meeting that we are working on providing backports support (for NES) for OFED-3.2. In our next ewg meeting, timelines will be discussed. It has taken long and as we have been going over the new OFED package and had issues earlier and hopefully we will have the package with all the drivers. Thanks Faisal From: ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of richard Croucher Sent: Friday, April 20, 2012 2:45 AM To: Woodruff, Robert J Cc: ewg@lists.openfabrics.org Subject: Re: [ewg] To OFED or not to OFED As a OFED User I would rather it include all the low level drivers. The problem comes with mixed hardware environments. If I have to go to Mellanox for their drivers they will insist I run their complete MLNX OFED build. If I go to Qlogic/Intel they will say the same. I will then end up with two different OFED distros running which makes our life really difficult. At least today I can choose, i'e as these drivers are all in OFED, they are also all in the MLNX_OFED as well so I can choose to run that if I wish. If they are taken out of OFED, I won't have that choice. I like choice. If the other vendors are not maintaining their drivers and there are know bugs with them, then this should be documented in the release notes and as a last recourse they get dropped from a specific OFED release. We need to keep the door open to these other vendors, then the User community can apply pressure to them. I'll mention this to both the Chelsio and Intel sales teams when they next come knocking at my door to buy their stuff. -- Richard Croucher www.informatix-sol.comhttp://www.informatix-sol.com +44-7802-213901 On Wed, 2012-04-18 at 15:42 +, Woodruff, Robert J wrote: I think it is too soon to discuss this with the board. Right now the EWG is not recommending anything, just soliciting input from the larger community. Let's have the discussion on the list first to get people's position on this before we have any discussions at the board meeting. -Original Message- From: ewg-boun...@lists.openfabrics.orgmailto:ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Gilad Shainer Sent: Wednesday, April 18, 2012 8:32 AM To: Ryan, Jim; Tziporet Koren; ewg@lists.openfabrics.orgmailto:ewg@lists.openfabrics.org Subject: Re: [ewg] To OFED or not to OFED Jim, I believe that we should also include Tziporet and maybe others, therefore Friday will not work for folks from Israel. Gilad -Original Message- From: ewg-boun...@lists.openfabrics.orgmailto:ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Ryan, Jim Sent: Wednesday, April 18, 2012 8:28 AM To: Tziporet Koren; ewg@lists.openfabrics.orgmailto:ewg@lists.openfabrics.org Subject: Re: [ewg] To OFED or not to OFED Tziporet, I think this is a very important decision. I'd like to make it an agenda item for the Board meeting on Friday. Woody typically participates -- would this be ok? Thanks, Jim -Original Message- From: ewg-boun...@lists.openfabrics.orgmailto:ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Tziporet Koren Sent: Wednesday, April 18, 2012 8:04 AM To: ewg@lists.openfabrics.orgmailto:ewg@lists.openfabrics.org Subject: [ewg] To OFED or not to OFED Hi All, We started to work on OFED 3.2 and for now we already have the base code working with the new compat framework: - IB core (all modules) - IPoIB - mlx4, mthca - Mellanox drivers However for the last few months there was no progress on any other low level driver: - qib - Intel - nec - Intel - cxgb3/4 - Chelsio Since there is no reason to have OFED release for Mellanox only we need to understand the other companies position and commitment for OFED. We have two options: - Drop OFED releases all together. Focus our EWG efforts in pushing APIs, testing of the Linux inbox SW stack and driver enhancements for the RDMA technology - Get real commitment from the vendors on dates to provide the backport support (we can move to kernel 3.3 if we decide this) Please do your internal consideration and come back with your decision. The final decision will be taken in next EWG meeting on May 1. Thanks Tziporet Woody ___ ewg mailing list ewg@lists.openfabrics.orgmailto:ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.orgmailto:ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.orgmailto:ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] [PATCH] RDMA/nes: Fix for sending MPA reject frame
Hi Vlad, This is critical patch and please apply for OFED-1.5.4.1 release. Thanks Faisal -Original Message- From: Nikolova, Tatyana E Sent: Tuesday, January 17, 2012 10:19 AM To: v...@dev.mellanox.co.il Cc: ewg@lists.openfabrics.org; Latif, Faisal Subject: [PATCH] RDMA/nes: Fix for sending MPA reject frame Set a reject flag, when sending MPA reject message to inform the peer that the application has rejected the connection. Signed-off-by: Tatyana Nikolova tatyana.e.nikol...@intel.com Signed-off-by: Faisal Latif faisal.la...@intel.com --- kernel_patches/fixes/nes_0069_mpa_reject_fix.patch | 24 + -- 1.7.1 ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] EWG/OFED meeting minutes for Nov 29, 2011
Thanks, We are getting the patch ready and will be submitting in an hour or so to make it for OFED-1.5.4 GA. Faisal -Original Message- From: Tziporet Koren [mailto:tzipo...@mellanox.com] Sent: Sunday, December 04, 2011 12:47 AM To: Latif, Faisal; Woodruff, Robert J; 'jeffrey.c.bec...@nasa.gov' Cc: 'ewg@lists.openfabrics.org' Subject: RE: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 Hi Faisal I prefer to have 1.5.4.1 and not delay the release any more Tziporet -Original Message- From: Latif, Faisal [mailto:faisal.la...@intel.com] Sent: Saturday, December 03, 2011 9:21 PM To: Tziporet Koren; Woodruff, Robert J; 'jeffrey.c.bec...@nasa.gov' Cc: 'ewg@lists.openfabrics.org' Subject: RE: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 Hi, We have found a critical bug (under our abnormal test case) in nes driver in OFED-1.5.4.RC5 that needs to be fixed and OFED-1.5.4 GA is set for Monday. We have a patch but it needs to be more tested before submission to the community and my guess is that we will be ready for submission by Wednesday (Dec 07). Are we going to have OFED-1.5.4.1 which may just handle critical bug fixes in RC5/GA? Faisal -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Tziporet Koren Sent: Thursday, December 01, 2011 1:26 PM To: Woodruff, Robert J; 'jeffrey.c.bec...@nasa.gov' Cc: 'ewg@lists.openfabrics.org' Subject: Re: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 I agree with Woody We do not wish to postpone the release any more. Tziporet - Original Message - From: Woodruff, Robert J [mailto:robert.j.woodr...@intel.com] Sent: Thursday, December 01, 2011 09:20 PM To: Jeff Becker jeffrey.c.bec...@nasa.gov; Tziporet Koren Cc: ewg@lists.openfabrics.org ewg@lists.openfabrics.org Subject: RE: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 Are these items absolutely required for OFED-1.5.4 ? Personally, I have some people that really need to have this release out ASAP and do not want to hold it up anymore if possible. The release has already slipped a lot from our original plan. woody -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Jeff Becker Sent: Thursday, December 01, 2011 11:12 AM To: Tziporet Koren Cc: ewg@lists.openfabrics.org Subject: Re: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 Hi Tziporet On 12/01/11 09:42, Tziporet Koren wrote: Meeting minutes for EWG/OFED meeting for Nov 29, 2011: --- -- --- 1. OFED 1.5.4: We have decide that all issues are not critical except for the compilation issue Rc5 - Thu Dec 1 - was released by Vlad GA - next Mon - Dec 5 I still need to do the NFSRDMA ports for kernel.org 2.6.39 and 3.0. I don't envision any issues getting these done before Monday. However, I am seeing a performance issue in one of the NFS Connectathon tests for 2.6.37, and I've tracked it down to a slow MMAP call response on the server. The test completes correctly however. I am currently debugging this, but if it is more important, I can submit the remaining ports (although the bug may affect them as well) and resume debugging. Please advise. Thanks. -jeff ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] [PATCH] RDMA/nes: Fix terminate during fatal AE
Hi Vlad, Please apply this patch for OFED-1.5.4 ga. Thanks Faisal -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Tatyana Nikolova Sent: Monday, December 05, 2011 10:53 AM To: v...@dev.mellanox.co.il Cc: ewg@lists.openfabrics.org Subject: [ewg] [PATCH] RDMA/nes: Fix terminate during fatal AE Fix for reset which happens right after sending a terminate message. Terminate timer is not deleted when the connection is closed. Signed-off-by: Tatyana Nikolova tatyana.e.nikol...@intel.com Signed-off-by: Faisal Latif faisal.la...@intel.com --- kernel_patches/fixes/nes_0064_term_rst_fix.patch | 30 ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] EWG/OFED meeting minutes for Nov 29, 2011
Hi, We have found a critical bug (under our abnormal test case) in nes driver in OFED-1.5.4.RC5 that needs to be fixed and OFED-1.5.4 GA is set for Monday. We have a patch but it needs to be more tested before submission to the community and my guess is that we will be ready for submission by Wednesday (Dec 07). Are we going to have OFED-1.5.4.1 which may just handle critical bug fixes in RC5/GA? Faisal -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Tziporet Koren Sent: Thursday, December 01, 2011 1:26 PM To: Woodruff, Robert J; 'jeffrey.c.bec...@nasa.gov' Cc: 'ewg@lists.openfabrics.org' Subject: Re: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 I agree with Woody We do not wish to postpone the release any more. Tziporet - Original Message - From: Woodruff, Robert J [mailto:robert.j.woodr...@intel.com] Sent: Thursday, December 01, 2011 09:20 PM To: Jeff Becker jeffrey.c.bec...@nasa.gov; Tziporet Koren Cc: ewg@lists.openfabrics.org ewg@lists.openfabrics.org Subject: RE: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 Are these items absolutely required for OFED-1.5.4 ? Personally, I have some people that really need to have this release out ASAP and do not want to hold it up anymore if possible. The release has already slipped a lot from our original plan. woody -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Jeff Becker Sent: Thursday, December 01, 2011 11:12 AM To: Tziporet Koren Cc: ewg@lists.openfabrics.org Subject: Re: [ewg] EWG/OFED meeting minutes for Nov 29, 2011 Hi Tziporet On 12/01/11 09:42, Tziporet Koren wrote: Meeting minutes for EWG/OFED meeting for Nov 29, 2011: - --- 1. OFED 1.5.4: We have decide that all issues are not critical except for the compilation issue Rc5 - Thu Dec 1 - was released by Vlad GA - next Mon - Dec 5 I still need to do the NFSRDMA ports for kernel.org 2.6.39 and 3.0. I don't envision any issues getting these done before Monday. However, I am seeing a performance issue in one of the NFS Connectathon tests for 2.6.37, and I've tracked it down to a slow MMAP call response on the server. The test completes correctly however. I am currently debugging this, but if it is more important, I can submit the remaining ports (although the bug may affect them as well) and resume debugging. Please advise. Thanks. -jeff ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
[ewg] [ANNOUNCE] libnes-1.1.3 release
Libnes-1.1.3 is released. tarball is available at http://ww.opefabrics.org/downloads/nes/libnes-1.1.3.tar.gz It has patch for *Fix build error for IBV_QPT_RAW_ETH declaration. I have updated latest.txt to be included in OFED-1.5.4 daily builds Thanks Faisal ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
[ewg] [ANNOUNCE} libnes-1.1.2 release
Libnes-1.1.2 is released. tarball is available at http://ww.opefabrics.org/downloads/nes/libnes-1.1.2.tar.gz It has patch for *Fix build against upstream libibverbs I have updated latest.txt to be included in OFED-1.5.4 daily builds Thanks Faisal ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
[ewg] nes interoperability patches
Hi Vlad, We have fixed interoperability issue with nes driver patches and will be submitting them today for RC1. Thanks Faisal ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] OFED 1.5.4 release schedule change - please review
9/5 would be preferable for Intel also to make sure we get iWARP interoperability code in RC1. Faisal -Original Message- From: ewg-boun...@lists.openfabrics.org [mailto:ewg- boun...@lists.openfabrics.org] On Behalf Of Steve Wise Sent: Tuesday, August 09, 2011 11:07 AM To: ewg@lists.openfabrics.org Subject: Re: [ewg] OFED 1.5.4 release schedule change - please review On 08/09/2011 06:58 AM, Tziporet Koren wrote: Hi All In our last EWG meeting there was a request to delay OFED 1.5.4 release Original plan: First RC: 8/15 GA: 10/11 New suggestion: First RC: 8/30 GA: 11/1 I had actually requested a 3 week push. So that would be 9/5. Please reply if this change is fine with you Tziporet ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] Soft-RoCE on NetEffect NE020 10Gb RNIC
NetEffect cards have iWARP drivers in OFED and RoCEE is not supported by NetEffect cards. Faisal Latif From: ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Richard Croucher Sent: Thursday, May 05, 2011 5:46 AM To: 'Bob Pearson'; 'Tanin'; 'OpenFabrics EWG'; 'Dantong Yu'; 'fatfish'; 'Shudong Jin' Subject: Re: [ewg] Soft-RoCE on NetEffect NE020 10Gb RNIC As I understand it, Soft-RoCEE is only to allow developers to run InfiniBand VERBS over Ethernet cards that do not have native RoCEE drivers. The latter requires RDMA and CEE, whereas Soft-Rocee does not have these dependencies. The NetEffect and Mellanox cards both have RoCEE drivers in OFED and these should be used in preference. The maintainers will accept bugs on these. Soft RoCEE is not currently included or maintained by OFED and is maintained separately by systemfabricworks From: ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Bob Pearson Sent: 05 May 2011 03:24 To: 'Tanin'; 'OpenFabrics EWG'; 'Dantong Yu'; 'fatfish'; 'Shudong Jin' Subject: Re: [ewg] Soft-RoCE on NetEffect NE020 10Gb RNIC Hi Mr Lee, I will respond off list since rxe is not technically part of OFED. Bob Pearson From: ewg-boun...@lists.openfabrics.org [mailto:ewg-boun...@lists.openfabrics.org] On Behalf Of Tanin Sent: Wednesday, May 04, 2011 3:52 PM To: OpenFabrics EWG; Dantong Yu; fatfish; Shudong Jin Subject: [ewg] Soft-RoCE on NetEffect NE020 10Gb RNIC Dear all, I have installed the OFED-1.5.2-rxe on our linux host, which has three network interfaces, Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet NIC, Mellanox Technologies MT26478 [ConnectX EN 40GigE, PCIe 2.0 5GT/s] and NetEffect NE020 10Gb Accelerated Ethernet Adapter (iWARP RNIC). The Soft-RoCE can work on the first two cards, but when I applied the Soft-RoCE to the Neteffect card and use ibv_devinfo to view the RDMA device, I got following errors on some of the hosts in our cluster, and the whole OFED stack doesnot work. [root@netqos14 ~]# rxe_cfg status Name Link Driver Speed MTU IPv4_addr S-RoCE RMTU eth0 yesbnx2 1500 198.124.220.155 eth1 no bnx2 1500 eth2 no bnx2 1500 eth3 no bnx2 1500 eth4 yesiw_nes 1500 198.124.220.207 rxe0 rxe eth_proto_id: 0x8915 [root@netqos14 ~]# ibv_devinfo hca_id: mlx4_0 transport: InfiniBand (0) fw_ver: 2.7.626 node_guid: 0002:c903:000b:f306 sys_image_guid: 0002:c903:000b:f309 vendor_id: 0x02c9 vendor_part_id: 26428 hw_ver: 0xB0 board_id: MT_0D90110009 phys_port_cnt: 1 port: 1 state: PORT_ACTIVE (4) max_mtu:2048 (4) active_mtu: 2048 (4) sm_lid: 6 port_lid: 4 port_lmc: 0x00 link_layer: IB hca_id: nes0 transport: iWARP (1) fw_ver: 3.16 node_guid: 0012:5502:f6ac: sys_image_guid: 0012:5502:f6ac: vendor_id: 0x1255 vendor_part_id: 256 hw_ver: 0x5 board_id: NES020 Board ID phys_port_cnt: 1 port: 1 state: PORT_ACTIVE (4) max_mtu:4096 (5) active_mtu: 1024 (3) sm_lid: 0 port_lid: 1 port_lmc: 0x00 link_layer: Ethernet libnes: nes_ualloc_context: Invalid kernel driver version detected. Detected 0, should be 1 libnes: nes_ualloc_context: Failed to allocate context for device. Failed to open device However, some hosts in our cluster can make Soft-RoCE work on the iWARP RNIC with the same configuration. The info is as follows, [root@netqos13 rftp]# rxe_cfg status Name Link Driver Speed MTU IPv4_addr S-RoCE RMTU eth0 yes bnx2 1500 198.124.220.154 eth1 nobnx2 1500 eth2 nobnx2 1500 eth3 nobnx2 1500 eth4 yes iw_nes 1500 198.124.220.206 rxe01024 (3) rxe eth_proto_id: 0x8915 [root@netqos13 rftp]# ibv_devinfo
[ewg] [ANNOUNCE] libnes-1.1.1 release
New version of libnes v1.1.1 is available at: http://www.openfabrics.org/downloads/nes/libnes-1.1.1.tar.gz Changes since last release: - Check # of sge posted for posting rcv buffers - Fix for frames too long - Fix handling of RAW QP Error state - Fix handling of frames with VLAN flag set libnes provides a device-specific userspace library for NetEffect Ethernet Server Cluster Adapter for use with the libibverbs library. Faisal ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
