[OMPI devel] MPIRUN error message after ./configure and sudo make all install...

2013-11-07 Thread Solibakke Per Bjarte
Hello System with: Cuda 5.5 and OpenMPI-1.7.3 with system: quadro K5000 and 8 CPUs each with 192 GPUs =1536 cores) ./configure -with-cuda -with-hwloc -enable-dlopen -enable-mca-dso -enable-shared -enable-vt -with-threads=posix -enable-mpi-thread-multiple -prefix=/usr/local Works fine under ins

Re: [OMPI devel] MPIRUN error message after ./configure and sudo make all install...

2013-11-07 Thread Rolf vandeVaart
Hello Solibakke: Let me try and reproduce with your configure options. Rolf From: devel [mailto:devel-boun...@open-mpi.org] On Behalf Of Solibakke Per Bjarte Sent: Thursday, November 07, 2013 8:40 AM To: 'de...@open-mpi.org' Subject: [OMPI devel] MPIRUN error message after ./configure and sudo m

Re: [OMPI devel] MPIRUN error message after ./configure and sudo make all install...

2013-11-07 Thread Ralph Castain
FWIW: I can never recall seeing someone use --enable-mca-dso...though I don't know if that is the source of the problem. On Nov 7, 2013, at 6:00 AM, Rolf vandeVaart wrote: > Hello Solibakke: > Let me try and reproduce with your configure options. > > Rolf > > From: devel [mailto:devel-boun

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Ralph Castain
I'm sorry, but I just don't believe this belongs in our code base. If you want to create Debian packages (and I don't understand why), then do so in your own branch of the repo and maintain this stuff there. It just doesn't belong in our shared repository. Please remove it, or explain why this

Re: [OMPI devel] MPIRUN error message after ./configure and sudo make all install...

2013-11-07 Thread Rolf vandeVaart
Solibakke: I have not reproduced the issue, but I think I have an idea of what is happening. What type of interconnect are you running over in this cluster? Note that in the Open MPI 1.7.3 series, CUDA-aware support is only available within a node and between nodes using the verbs interface over

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Mike Dubman
how it is differ from other related stuf kept in svn to support: - rpm based distros? (dist/linux/) - macos (contrib/dist/macosx-pkg/) - __debian_stuff_could_be_here_as_well no prob to remove it, i think it is handy, logical and helps to at least one project member and most likely to others (eve

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Ralph Castain
On Nov 7, 2013, at 8:54 AM, Mike Dubman wrote: > how it is differ from other related stuf kept in svn to support: > > - rpm based distros? (dist/linux/) > - macos (contrib/dist/macosx-pkg/) > - __debian_stuff_could_be_here_as_well That's a fair point - I'll let the folks who added those direct

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Jeff Squyres (jsquyres)
On Nov 7, 2013, at 9:10 AM, Ralph Castain wrote: >> how it is differ from other related stuf kept in svn to support: >> >> - rpm based distros? (dist/linux/) >> - macos (contrib/dist/macosx-pkg/) >> - __debian_stuff_could_be_here_as_well > > That's a fair point - I'll let the folks who added th

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Mike Dubman
sorry, I though it was mentioned: motivation is to build .deb OMPI package as part of debian/ubuntu ofed distribution. (similar logic/rationale as buildrpm.sh which is part of OMPI) On Thu, Nov 7, 2013 at 8:15 PM, Jeff Squyres (jsquyres) wrote: > On Nov 7, 2013, at 9:10 AM, Ralph Castain wrote:

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Jeff Squyres (jsquyres)
On Nov 7, 2013, at 10:21 AM, Mike Dubman wrote: > sorry, I though it was mentioned: > motivation is to build .deb OMPI package as part of debian/ubuntu ofed > distribution. Ah, this is a fairly critical piece of information that was not supplied. :-) Is this OFED or MOFED? I thought OFED sto

Re: [OMPI devel] [EXTERNAL] Re: [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Barrett, Brian W
On 11/7/13 11:15 AM, "Jeff Squyres (jsquyres)" wrote: >On Nov 7, 2013, at 9:10 AM, Ralph Castain wrote: > >>> how it is differ from other related stuf kept in svn to support: >>> >>> - rpm based distros? (dist/linux/) >>> - macos (contrib/dist/macosx-pkg/) >>> - __debian_stuff_could_be_here_as_

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Mike Dubman
it is for MOFED now and probably OFED later. will rename to contrib/dist/mofed tomorrow. Thanks On Thu, Nov 7, 2013 at 9:08 PM, Jeff Squyres (jsquyres) wrote: > On Nov 7, 2013, at 10:21 AM, Mike Dubman wrote: > > > sorry, I though it was mentioned: > > motivation is to build .deb OMPI package

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29633 - in trunk: . contrib contrib/dist/linux contrib/dist/linux/debian contrib/dist/linux/debian/source

2013-11-07 Thread Brice Goglin
OFED is already in Debian as far as I know. At least Roland Dreier takes care of uploading some IB-related packages. And I didn't have any problem getting Mellanox IB to work on Debian in the last years, but I haven't played with Mellanox custom APIs. Brice Le 07/11/2013 20:27, Mike Dubman a éc

Re: [OMPI devel] [OMPI svn] svn:open-mpi r29644 - trunk/orte/mca/rmaps/mindist

2013-11-07 Thread Ralph Castain
Ummm...you can't do that, Josh. You are violating the abstraction break rather badly by searching for specific IB devices down in ORTE. Please revert this and let's talk about what you are actually trying to do. On Nov 7, 2013, at 8:28 PM, svn-commit-mai...@open-mpi.org wrote: > Author: jladd