Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-09 Thread Jeff Squyres
This looks like it could get complex. I've filed https://svn.open-mpi.org/trac/ompi/ticket/1916 to followup on this issue. I'll exchange some off-list mails with Ken about this topic to try to figure it out; we'll post the final resolution back here to the list. On May 7, 2009, at 9:13

Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-07 Thread Ken Cain
Jeff Squyres wrote: On May 6, 2009, at 4:45 PM, Ken Cain wrote: Is it possible for OMPI to generate output at runtime indicating exactly what btl(s) will be used? At present, we only have a fairly lame system to do this. We wanted to print out a connection map in v1.3, but it didn't

Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-07 Thread Jeff Squyres
On May 6, 2009, at 4:45 PM, Ken Cain wrote: Is it possible for OMPI to generate output at runtime indicating exactly what btl(s) will be used? At present, we only have a fairly lame system to do this. We wanted to print out a connection map in v1.3, but it didn't happen -- this

Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-06 Thread Ken Cain
Jon Mason wrote: On Wed, May 06, 2009 at 01:20:48PM -0400, Ken Cain wrote: Thanks Jon. I have some responses inline. Jon Mason wrote: On Wed, May 06, 2009 at 12:15:19PM -0400, Ken Cain wrote: I am trying to run NetPIPE-3.7.1 NPmpi using Open MPI version 1.3.2 with the openib btl in an

Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-06 Thread Jon Mason
On Wed, May 06, 2009 at 01:20:48PM -0400, Ken Cain wrote: > Thanks Jon. I have some responses inline. > > Jon Mason wrote: >> On Wed, May 06, 2009 at 12:15:19PM -0400, Ken Cain wrote: >>> I am trying to run NetPIPE-3.7.1 NPmpi using Open MPI version 1.3.2 >>> with the openib btl in an OFED-1.4

Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-06 Thread Ken Cain
Thanks Jon. I have some responses inline. Jon Mason wrote: On Wed, May 06, 2009 at 12:15:19PM -0400, Ken Cain wrote: I am trying to run NetPIPE-3.7.1 NPmpi using Open MPI version 1.3.2 with the openib btl in an OFED-1.4 environment. The system environment is two Linux (2.6.27) ppc64 blades,

Re: [OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-06 Thread Jon Mason
On Wed, May 06, 2009 at 12:15:19PM -0400, Ken Cain wrote: > I am trying to run NetPIPE-3.7.1 NPmpi using Open MPI version 1.3.2 with > the openib btl in an OFED-1.4 environment. The system environment is two > Linux (2.6.27) ppc64 blades, each with one Chelsio RNIC device, > interconnected

[OMPI users] OMPI-1.3.2, openib/iWARP(cxgb3) problem: PML add procs failed (Unreachable)

2009-05-06 Thread Ken Cain
I am trying to run NetPIPE-3.7.1 NPmpi using Open MPI version 1.3.2 with the openib btl in an OFED-1.4 environment. The system environment is two Linux (2.6.27) ppc64 blades, each with one Chelsio RNIC device, interconnected by a 10GbE switch. The problem is that I cannot (using Open MPI)