Re: [ewg] OFA EWG Meeting: Monday, April 4th 2020 - Minutes
Hi Arlin, I attended the first 30mins of the meeting. Sorry I had to drop off before the end to go to another meeting. I mostly agree with others that having a OFED release with just bug fixes isn't that helpful. It's better to have a fully featured one. Having said that we are happy to do backports to either one. We right now have just enough resources (me) to do backporting. I'll have to check internally if some other folks might volunteer if we want to stick with the full version of OFED. - Adit From: ewg on behalf of Davis, Arlin R Sent: Monday, April 6, 2020 7:56:03 PM To: ewg@lists.openfabrics.org Subject: [ewg] OFA EWG Meeting: Monday, April 4th 2020 - Minutes AttendeesCompany Arlin Davis Intel Bob Woodruff Intel Bill Snapko HPE Rupert Dance SW Forge Vladimir SokolovskyMellanox Devesh Sharma Broadcom Eddie Wai Broadcom Jim Ryan OFA Agenda: · OFA board asked if EWG community would be interested in supporting an OFED “lite” distribution going forward. · OFED lite option: o Simple packaging, update drivers only – ported to in-box distro release of rdma-core o Bug fixing only, no new features, in-kernel rdma_core would not be replaced/modified · IBTA use of OFED – brief history from Rupert o Initially used OFED, supported all vendors with distribution – everyone backported drivers o Then moved to MOFED for Mellanox, OFED for other vendors that still supported backports from upstream kernel o Now, MOFED for Mellanox, in-box distro releases for vendors (Broadcom, Cavium), OFED no longer useful without backports o Unless this new model supported driver updates, within 1-2 months of distro release it will be too dated to be useful * Open discussion regarding OFED lite option * General feeling is that there is little value with driver fixes only, should just go directly to distro upgrade packages, supported and timely (yum update) * OFED driver fixes packaged for in-box release, installed by customers, wouldn’t be supported by distro’s * Requires vendors to build/maintain drivers across many different kernel source trees and rdma_core stacks * Cavium email, “we prefer to deliver our own drivers to customers, we don’t see the added value of having a common ofed release if it’s just for drivers” * Broadcom and HPE still see the value in getting the latest upstream rdma-core feature set for their customers * Broadcom is willing to pick up rdma-core, compat-rdma porting if they get help. * Vlad explained details of compat-rdma backporting, huge amount of work - similar to what RH does for major releases with a 4-person team. * Intel uses own packaging for OPA, works directly with distro’s for other network drivers, no need for OFED or OFED lite. * Mellanox builds and maintains its own distribution for customers, doesn’t need OFED * Suggestion was made to take a quick rollcall - OFED lite vs continue with OFED full support * Company OFED lite OFED full * Broadcom no yes * Mellanox no no * Intel no no * SW Forge no no * HPEno yes * Cavium (email) no no Please send any corrections or omissions as needed. Regards, Arlin ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] OFA EWG Meeting: Monday, Nov 4th, 2019 - Cancelled
On 11/4/19 7:37 AM, Davis, Arlin R wrote: > No updates, no agenda. Waiting for vendor responses before proceeding: > > > > * Do vendors have resources or a commitment to support OFED going forward? > o Chelsio, Cavium, Broadcom, VMware was not on call to give guidance. > * Would it be better to target a newer kernel, possibly target 5.5 early > next year? Hi Arlin, VMware is committed to OFED. Unfortunately, some of the updates we have will get into 5.5 (and would require a rdma-core update). If you decide to release OFED-5.3, there is a backport fix I’ll need to send out (it was caught internally). Its already accepted upstream into 5.4. Thanks, Adit > > > Regards, > > > > Arlin ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] OFED 5.3 backporting updates ??
On 10/7/19, 10:02 AM, "Davis, Arlin R" wrote: >> I'm not sure if the backports for vmware driver can get into OFED 5.3. >> I have already sent them upstream but most likely won't be added until Linux >> 5.5. These also require an updated rdma-core repository. >> So, it's possible that a rdma-core release with those patches may not be >> ready until 5.5RC1 (a few weeks away). >> >> Or can we include backports to rdma-core in OFED now too? >> > > Are you saying these changes will require ABI changes to rdma_core? No but the driver changes only make sense if rdma-core is updated with the required vmw_pvrdma patches. - Adit ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] OFED 5.3 backporting updates ??
Davis, Arlin R wrote on 10/4/2019 at 9:26 AM: > Please send updates on backporting progress and/or an ETA on backport > patches, please CC ewg mailing list. > > o Mellanox – Vlad > o Chelsio – Bharat > o Cavium- Michal (cannot meet deadlines, disable qed, qede, and qedr drivers > in OFED 5.3) > o Broadcom – Devesh > o VMware – Adit I'm not sure if the backports for vmware driver can get into OFED 5.3. I have already sent them upstream but most likely won't be added until Linux 5.5. These also require an updated rdma-core repository. So, it's possible that a rdma-core release with those patches may not be ready until 5.5RC1 (a few weeks away). Or can we include backports to rdma-core in OFED now too? > o Huawei – Lijun Ou > o Intel (i40iw) - Henry (5.3 support only, no backports) – Is that true Henry? ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] OFED-5.3 daily builds
On 9/6/19 12:49 PM, Vladimir Sokolovsky wrote:
> Hi,
> OFED-5.3 daily builds are now available under:
> http://openfabrics.org/downloads/OFED/ofed-5.3-daily/
>
> _Currently supported OSes:_
> SLES15.0
> SLES12 SP4
> RHEL8.0
> RHEL7.6
Thanks Vlad for putting this together!
I believe RHEL 7.7 is already out. Will OFED 5.3 be supporting that too?
>
> _Currently available backports:_
> IB core
> IPoIB
> iSER
> SRP
> MLX4
>
> _Known issue:_
> - Fail to build rdma-core-25.0 on RHEL7.6 and RHEL8.0:
> -- Installing:
> /var/tmp/OFED_topdir/BUILDROOT/rdma-core-25.0-1.x86_64/usr/share/man/man3/umad_get_port.3
> CMake Error at libibumad/man/cmake_install.cmake:241 (file):
> file INSTALL cannot find
>
> "/var/tmp/OFED_topdir/BUILD/rdma-core-25.0/buildlib/pandoc-prebuilt/41bbb0bed7a781be59e8c0dcd8b7278af2ce6882".
> Call Stack (most recent call first):
> cmake_install.cmake:60 (include)
>
>
> _Additional information:_
> _compat-rdma git trees:_
> git://git.openfabrics.org/compat-rdma/compat-rdma.git master
> - compat-rdma backport patches, system services and utilities
>
> git://git.openfabrics.org/compat-rdma/linux-5.3.git master
> - Set of relevant sub trees (as is) from upstream linux kernel 5.3 (rc4) -
> will be updated to 5.3 release. Used to improve clone/build time.
>
> git://git.openfabrics.org/compat-rdma/compat.git ofed
> - backport headers and functionality
> - config/rdma.m4 - autotools script used to scan kernel headers and define
> macros used by backport headers and patches
>
> To build working tree for manual compilation:
> # mkdir ofed
> # cd ofed
> # git clone git://git.openfabrics.org/compat-rdma/compat-rdma.git
> # git clone git://git.openfabrics.org/compat-rdma/linux-5.3.git
> # git clone git://git.openfabrics.org/compat-rdma/compat.git
>
> # OFED_EWG_DIR=$PWD
> # cd compat-rdma
> # GIT_TREE=${OFED_EWG_DIR}/linux-5.3 GIT_COMPAT_TREE=${OFED_EWG_DIR}/compat
> ./scripts/admin_rdma.sh -n -p
>
> To compile drivers:
> # ./configure --with-core-mod --with-ipoib-mod --with-ipoib_debug-mod
> --with-ipoib_debug_data-mod --with-user_mad-mod --with-user_access-mod
> --with-addr_trans-mod --with-mlx4-mod --with-mlx4_core-mod --with-mlx4_en-mod
> --with-mlx4_inf-mod --with-mlx4_debug-mod --with-ipoib-cm --with-srp-mod
> --with-iser-mod --with-iscsi-mod --with-isert-mod
>
> Add other relevant flags...
>
> # make
> # make install
>
>
> Regards,
> Vladimir
>
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.openfabrics.org%2Fmailman%2Flistinfo%2Fewgdata=02%7C01%7Caditr%40vmware.com%7C06d9a19de259435dda4608d733036f45%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C637033962171198186sdata=8zaVYm6gWcxFhwOmBZEZ8gWkuP06fhRH5QA666e38Dg%3Dreserved=0
>
___
ewg mailing list
ewg@lists.openfabrics.org
https://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] [GIT PULL compat-rdma] Add vmw_pvrdma patch from linux-next
On 3/14/19 9:10 AM, Vladimir Sokolovsky wrote: > Hi Adit, > I merged your commit + build: OFED-4.17-1-20190314-0909 > > Awesome, thanks! Will report back after running more tests. > Regards, > Vladimir > > -Original Message- > From: ewg On Behalf Of Adit Ranadive via > ewg > Sent: Thursday, March 14, 2019 1:37 AM > To: v...@dev.mellanox.co.il; ewg@lists.openfabrics.org > Subject: [ewg] [GIT PULL compat-rdma] Add vmw_pvrdma patch from linux-next > > Hi Vlad, > > Here is a patch for vmw_pvrdma that should be added to 4.17-1. > > Thanks, > Adit > --- > > The following changes since commit 7ae07472e88045d53db3865e74854ac1bb02b05f: > >Fixed cma_configfs backport (2018-12-07 10:02:12 -0600) > > are available in the Git repository at: > >git://git.openfabrics.org/~aditr/compat-rdma.git for-vlad > > for you to fetch changes up to e6d62f86c995e8a5bdf1ae2597256da59ec9ed25: > >Add vmw_pvrdma patch from linux-next (2019-03-13 23:14:20 -0700) > > > Adit Ranadive (1): >Add vmw_pvrdma patch from linux-next > > ...-RDMA-vmw_pvrdma-Support-upto-64-bit-PFNs.patch | 93 > ++ > 1 file changed, 93 insertions(+) > create mode 100644 > linux-next-cherry-picks/0052-RDMA-vmw_pvrdma-Support-upto-64-bit-PFNs.patch > > ___ > ewg mailing list > ewg@lists.openfabrics.org > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.openfabrics.org%2Fmailman%2Flistinfo%2Fewgdata=02%7C01%7Caditr%40vmware.com%7C4a9341f3a3c14a07932008d6a8978bd0%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C636881766171453778sdata=fja8PypPXJtIuiBwXAQSgTZrmO7WMwuwUQSIxsFtnrk%3Dreserved=0 > ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
[ewg] [GIT PULL compat-rdma] Add vmw_pvrdma patch from linux-next
Hi Vlad, Here is a patch for vmw_pvrdma that should be added to 4.17-1. Thanks, Adit --- The following changes since commit 7ae07472e88045d53db3865e74854ac1bb02b05f: Fixed cma_configfs backport (2018-12-07 10:02:12 -0600) are available in the Git repository at: git://git.openfabrics.org/~aditr/compat-rdma.git for-vlad for you to fetch changes up to e6d62f86c995e8a5bdf1ae2597256da59ec9ed25: Add vmw_pvrdma patch from linux-next (2019-03-13 23:14:20 -0700) Adit Ranadive (1): Add vmw_pvrdma patch from linux-next ...-RDMA-vmw_pvrdma-Support-upto-64-bit-PFNs.patch | 93 ++ 1 file changed, 93 insertions(+) create mode 100644 linux-next-cherry-picks/0052-RDMA-vmw_pvrdma-Support-upto-64-bit-PFNs.patch ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
Re: [ewg] OFA EWG Meeting: Monday, Jan 14th, 2019 - Minutes
On 1/24/19 9:34 AM, Davis, Arlin R wrote: > All, > > * * > > Please reply to the list with your preference. > > * * > > *Action Item*: Please send your preference to the ewg mailing list so we can > collectively decide the next release. > > > > · Agreement to take the discussion to a wider audience – here are the > questions: > > oDo we work 4.17-1, pick up RH7.6/SLES12.4, March/April GA timeframe? > > oDo we skip 4.17-1, move ahead to OFED 5.0 to get closer to upstream code > base and kernel.org RC’s? > I can go either way. It depends on whether you want to prioritize adding OS support versus new features. If you want a shiny new release for the interop event I would say go with a 4.17-1 that adds the new OS'. Then you can switch to 5.1 which will probably have an RC right around that time. It should also help us get RHEL 8.0 / SLES 15.1 like you mentioned. Thanks, Adit > > > Regards, > > > > Arlin > > > > *From:*ewg [mailto:ewg-boun...@lists.openfabrics.org] *On Behalf Of *Davis, > Arlin R > *Sent:* Monday, January 14, 2019 12:36 PM > *To:* ewg@lists.openfabrics.org > *Cc:* Bowden, Paul > *Subject:* [ewg] OFA EWG Meeting: Monday, Jan 14th, 2019 - Minutes > > > > _Attendees Company _ > > Adit Ranadive VMware > > Bill SnapkoCavium > > Arlin Davis Intel > > Rupert Dance SW Forge > > Sindhu Devale Intel > > Steve Wise Chelsio > > Vladimir Sokolovsky Mellanox > > > > Minutes: > > > > · OFED future plans and timelines for 2019 > > · Discussion on 4.17-1 release, adding RH7.6 > > o Vlad can start in ~3 weeks with core backports, HW vendors follow (2-4 > weeks), and testing (2-4 weeks) > > o This would put RC1 late February/early March, GA April. > > o This may align with interop spring event in March/April timeframe. > > o Note*: I missed SLES12.4* so we would add both RH7.6 and SLES12.4 > > · Discussion on skipping 4.17-1 and moving right to kernel.org 5.0 > > o Kernel.org is now at 5.0 RC2, would be nice to start with RC’s > > § opportunity to test and get fixes upstream kernel > > o Might take a bit longer to get to OFED 5.0 RC and delay OFED support for > RH7.6/SLES 12.4 > > o This might align us with RH8.0 and SLES15.1 and get us support sooner > > > > · Agreement to take the discussion to a wider audience – here are the > questions: > > o Do we work 4.17-1, pick up RH7.6/SLES12.4, March/April GA timeframe? > > o Do we skip 4.17-1, move ahead to OFED 5.0 to get closer to upstream code > base and kernel.org RC’s? > > > > *Action Item*: Please send your preference to the ewg mailing list so we can > collectively decide the next release. > > > > Note: Vlad is busy for next 3 weeks so work won’t start until first week of > February. > > > > Regards, > > > > Arlin > > > > > ___ > ewg mailing list > ewg@lists.openfabrics.org > https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.openfabrics.org%2Fmailman%2Flistinfo%2Fewgdata=02%7C01%7Caditr%40vmware.com%7Cb050c14966684dce580808d682223b00%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C0%7C636839480862392080sdata=jgaTQn1M7BNMx%2FwoMhVyHMJbpK6Lzr03n7lNNaRANJY%3Dreserved=0 > ___ ewg mailing list ewg@lists.openfabrics.org https://lists.openfabrics.org/mailman/listinfo/ewg
