You just have to switch PML to UCX. You have some example of the command line here: https://github.com/openucx/ucx/wiki/OpenMPI-and-OpenSHMEM-installation-with-UCX Best, P.
On Thu, Jun 14, 2018 at 3:25 PM Charles A Taylor <chas...@ufl.edu> wrote: > Hmmm. ompi_info only shows the ucx pml. I don’t see any “transports”. > Will they show up somewhere or are they documented. Right now it looks > like the only UCX related thing I can do with openmpi 3.1.0 is > > export OMPI_MCA_pml=ucx > mpiexec …. > > From ompi_info… > > $ ompi_info --param all all | more | grep ucx > MCA osc: ucx (MCA v2.1.0, API v3.0.0, Component v3.1.0) > MCA pml: ucx (MCA v2.1.0, API v2.0.0, Component v3.1.0) > > I’m assuming there is more to it than that. > > Regards, > > Charlie > > > > On Jun 14, 2018, at 1:18 PM, Jeff Squyres (jsquyres) via users < > users@lists.open-mpi.org> wrote: > > > > Charles -- > > > > It may have gotten lost in the middle of this thread, but the > vendor-recommended way of running on InfiniBand these days is with UCX. > I.e., install OpenUCX and use one of the UCX transports in Open MPI. > Unless you have special requirements, you should likely give this a try and > see if it works for you. > > > > The libfabric / verbs combo *may* work, but I don't know how robust the > verbs libfabric support was in the v1.5 release series. > > > > > >> On Jun 14, 2018, at 10:01 AM, Charles A Taylor <chas...@ufl.edu> wrote: > >> > >> Hi Matias, > >> > >> Thanks for the response. > >> > >> As of a couple of hours ago we are running: > >> > >> libfabric-devel-1.5.3-1.el7.x86_64 > >> libfabric-1.5.3-1.el7.x86_64 > >> > >> As for the provider, I saw that one but just listed “verbs”. I’ll go > with the “verbs;ofi_rxm” going forward. > >> > >> Regards, > >> > >> Charlie > >> > >> > >>> On Jun 14, 2018, at 12:49 PM, Cabral, Matias A < > matias.a.cab...@intel.com> wrote: > >>> > >>> Hi Charles, > >>> > >>> What version of libfabric do you have installed? To run OMPI using the > verbs provider you need to pair it with the ofi_rxm provider. fi_info > should list it like: > >>> … > >>> provider: verbs;ofi_rxm > >>> … > >>> > >>> So in your command line you have to specify: > >>> mpirun -mca pml cm -mca mtl ofi -mca mtl_ofi_provider_include > “verbs;ofi_rxm” …. > >>> > >>> (don’t skip the quotes) > >>> > >> > >> _______________________________________________ > >> users mailing list > >> users@lists.open-mpi.org > >> > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e= > > > > > > -- > > Jeff Squyres > > jsquy...@cisco.com > > > > _______________________________________________ > > users mailing list > > users@lists.open-mpi.org > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.open-2Dmpi.org_mailman_listinfo_users&d=DwIGaQ&c=pZJPUDQ3SB9JplYbifm4nt2lEVG5pWx2KikqINpWlZM&r=HOtXciFqK5GlgIgLAxthUQ&m=6DdoqVoTIfPtbcYwMs5Kf4wAb1E-3ip44LC0DodP-qM&s=Tj45vOxdXErSAFSkD9LEyWCCMfBkS345sgPIqmLRy5c&e= > > _______________________________________________ > users mailing list > users@lists.open-mpi.org > https://lists.open-mpi.org/mailman/listinfo/users
_______________________________________________ users mailing list users@lists.open-mpi.org https://lists.open-mpi.org/mailman/listinfo/users
