Re: [OMPI devel] GPUDirect v1 issues

2012-01-23 Thread Sebastian Rinke
>> >>> It is documented in >>> http://developer.download.nvidia.com/compute/cuda/4_0/docs/GPUDirect_Technology_Overview.pdf >>> set CUDA_NIC_INTEROP=1 >>> >>> >>> From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On

Re: [OMPI devel] GPUDirect v1 issues

2012-01-21 Thread Kenneth Lloyd
.@open-mpi.org [mailto:devel-boun...@open-mpi.org] On > > Behalf Of Sebastian Rinke > > Sent: Wednesday, January 18, 2012 8:15 AM > > To: Open MPI Developers > > Subject: Re: [OMPI devel] GPUDirect v1 issues > > > > Setting the environment variable f

Re: [OMPI devel] GPUDirect v1 issues

2012-01-20 Thread Rolf vandeVaart
Rinke Sent: Friday, January 20, 2012 12:21 PM To: Open MPI Developers Subject: Re: [OMPI devel] GPUDirect v1 issues With * MLNX OFED stack tailored for GPUDirect * RHEL + kernel patch * MVAPICH2 it is possible to monitor GPUDirect v1 activities by means of observing changes to values in * /sys

Re: [OMPI devel] GPUDirect v1 issues

2012-01-20 Thread Sebastian Rinke
> set CUDA_NIC_INTEROP=1 > > > From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On > Behalf Of Sebastian Rinke > Sent: Wednesday, January 18, 2012 8:15 AM > To: Open MPI Developers > Subject: Re: [OMPI devel] GPUDirect v1 issues > > Settin

Re: [OMPI devel] GPUDirect v1 issues

2012-01-18 Thread Kenneth Lloyd
Developers Subject: Re: [OMPI devel] GPUDirect v1 issues Setting the environment variable fixed the problem for Open MPI with CUDA 4.0. Thanks! However, I'm wondering why this is not documented in the NVIDIA GPUDirect package. Sebastian. On Jan 18, 2012, at 1:28 AM, Rolf vandeVaart

Re: [OMPI devel] GPUDirect v1 issues

2012-01-18 Thread Sebastian Rinke
o longer necessary. > > Rolf > > > From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On > Behalf Of Sebastian Rinke > Sent: Tuesday, January 17, 2012 5:22 PM > To: Open MPI Developers > Subject: Re: [OMPI devel] GPUDirect v1 issues > > Th

Re: [OMPI devel] GPUDirect v1 issues

2012-01-17 Thread Rolf vandeVaart
Yes, the step outlined in your second bullet is no longer necessary. Rolf From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On Behalf Of Sebastian Rinke Sent: Tuesday, January 17, 2012 5:22 PM To: Open MPI Developers Subject: Re: [OMPI devel] GPUDirect v1 issues Thank you

Re: [OMPI devel] GPUDirect v1 issues

2012-01-17 Thread Sebastian Rinke
pen-mpi.org [mailto:devel-boun...@open-mpi.org] On Behalf Of Sebastian Rinke Sent: Tuesday, January 17, 2012 12:08 PM To: Open MPI Developers Subject: Re: [OMPI devel] GPUDirect v1 issues I use CUDA 4.0 with MVAPICH2 1.5.1p1 and Open MPI 1.4.2. Attached you find a little test case which is based on

Re: [OMPI devel] GPUDirect v1 issues

2012-01-17 Thread Rolf vandeVaart
age- >From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] >On Behalf Of Sebastian Rinke >Sent: Tuesday, January 17, 2012 12:08 PM >To: Open MPI Developers >Subject: Re: [OMPI devel] GPUDirect v1 issues > >I use CUDA 4.0 with MVAPICH2 1.5.1p1 and Open MPI 1.4.2

Re: [OMPI devel] GPUDirect v1 issues

2012-01-17 Thread Sebastian Rinke
t; > Ken > -Original Message- > From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On > Behalf Of Rolf vandeVaart > Sent: Tuesday, January 17, 2012 7:54 AM > To: Open MPI Developers > Subject: Re: [OMPI devel] GPUDirect v1 issues > > I am not aware

Re: [OMPI devel] GPUDirect v1 issues

2012-01-17 Thread Kenneth A. Lloyd
pi.org] On Behalf Of Rolf vandeVaart Sent: Tuesday, January 17, 2012 7:54 AM To: Open MPI Developers Subject: Re: [OMPI devel] GPUDirect v1 issues I am not aware of any issues. Can you send me a test program and I can try it out? Which version of CUDA are you using? Rolf >-Original Messa

Re: [OMPI devel] GPUDirect v1 issues

2012-01-17 Thread Rolf vandeVaart
I am not aware of any issues. Can you send me a test program and I can try it out? Which version of CUDA are you using? Rolf >-Original Message- >From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] >On Behalf Of Sebastian Rinke >Sent: Tuesday, January 17, 2012 8:50 AM >