Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
failing autogen.sh output at: http://scl.ameslab.gov/~troy/ompi-autogen.log

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
I don't know what Libtool 1.6 is -- there is no such version. I use Libtool 1.5.18. (Troy and I talked on the phone and cleared up a bunch of stuff -- resolution was first to fix the Libtool stuff and recompile, and we'll go from there -- potentially talking to Rich/Galen tomorrow when they

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 04:12:59PM -0400, Jeff Squyres wrote: > On Aug 25, 2005, at 3:45 PM, Troy Benjegerdes wrote: > > >>> 42: 771 bytes 12011 times --> 1063.33 Mbps in 5.53 usec > >>> 43:1021 bytes 6095 times --> mpirun noticed that job rank 1 > >>> with > >>> PID 5569 on

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
On Aug 25, 2005, at 3:45 PM, Troy Benjegerdes wrote: 42: 771 bytes 12011 times --> 1063.33 Mbps in 5.53 usec 43:1021 bytes 6095 times --> mpirun noticed that job rank 1 with PID 5569 on node "da5" exited on signal 11. 1 process killed (possibly by Open MPI) What are you

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 09:22:55AM -0600, Galen Mark Shipman wrote: > > > What would you prefer I build from? > > > Build from svn if possible. > > > I figured out I need -mca mpi_leave_pinned 1, but now I get: > This is correct. > > > > > 42: 771 bytes 12011 times --> 1063.33 Mbps in

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Galen Mark Shipman
> What would you prefer I build from? > Build from svn if possible. > I figured out I need -mca mpi_leave_pinned 1, but now I get: This is correct. > > 42: 771 bytes 12011 times --> 1063.33 Mbps in 5.53 usec > 43:1021 bytes 6095 times --> mpirun noticed that job rank 1 with

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 10:57:02AM -0400, Jeff Squyres wrote: > On Aug 25, 2005, at 10:43 AM, Troy Benjegerdes wrote: > > >> Look for RTLD_GLOBAL in opal/libltdl/ltdl.c. If it is not there openib > >> will not work if compiled as dynamic module. What version of libtool > >> are > >> you using? Ol

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
On Aug 25, 2005, at 10:43 AM, Troy Benjegerdes wrote: Look for RTLD_GLOBAL in opal/libltdl/ltdl.c. If it is not there openib will not work if compiled as dynamic module. What version of libtool are you using? Older libtool haven't used RTLD_GLOBAL for opening libraries. It's not there... tr

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Gleb Natapov
On Thu, Aug 25, 2005 at 09:43:31AM -0500, Troy Benjegerdes wrote: > On Thu, Aug 25, 2005 at 04:35:41PM +0300, Gleb Natapov wrote: > > On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > > > I also get the following messages on startup: > > > > > > libibverbs: Warning: no userspace

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 04:35:41PM +0300, Gleb Natapov wrote: > On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > > I also get the following messages on startup: > > > > libibverbs: Warning: no userspace device-specific driver found for > > uverbs0 driver search path: /usr/lib/in

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
Is this the right command line for this? mpirun -mca btl_openib_leave_pinned 1 -np 2 -host opteron1,opteron2 ./NPmpi-openmpi -o /tmp/foo On Wed, Aug 24, 2005 at 10:48:31PM -0600, Galen M. Shipman wrote: > Hi Troy, > > Tim and I would like to discuss this with you as well. One thing I > would a

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Gleb Natapov
On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > I also get the following messages on startup: > > libibverbs: Warning: no userspace device-specific driver found for > uverbs0 driver search path: /usr/lib/infiniband > [0,1,1][btl_openib_component.c:267:mca_btl_openib_compo

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
Galen -- When you guys return to the office, it's probably worthwhile to see if it's possible to set leave_pinned to 1 automatically if the memory hooks are being set properly (Brian keeps explaining this stuff to me, but it's so complicated that the details quickly fall out of my brain ;-) )

Re: [O-MPI devel] processor affinity

2005-08-25 Thread Jeff Squyres
On Aug 24, 2005, at 10:27 PM, Troy Benjegerdes wrote: Processor affinity is now implemented. You must ask for it via the MCA param "mpi_paffinity_alone". If this parameter is set to a nonzero value, OMPI will assume that its job is alone on the nodes that it is running on, and, if you have no