[OMPI devel] Is GPU direct RDMA supported in openmpi-2.0.2?

2017-03-13 Thread Ralph Campbell via devel
I have been looking closely at the source code for openmpi-2.0.2 and I see what looks like support for GPU direct RDMA but when testing it with a small GPU direct aware MPI program from Nvidia, I don't see ibv_reg_mr() ever being called with the GPU UVM address. Looking more closely, it appears tha

Re: [OMPI devel] Is GPU direct RDMA supported in openmpi-2.0.2?

2017-03-14 Thread Ralph Campbell via devel
Thanks! That is what I was missing. On Mon, Mar 13, 2017 at 7:03 PM, Akshay Venkatesh wrote: > Hi, Ralph. > > Have you already tried passing the parameter > > --mca btl_openib_want_cuda_gdr 1 > > This may help your case. > > > On Mon, Mar 13, 2017 at 5:52 PM, Ralp