Re: [O-MPI devel] OpenIB results

2005-08-27 Thread Gleb Natapov
On Fri, Aug 26, 2005 at 09:18:06AM -0500, Troy Benjegerdes wrote: > On Thu, Aug 25, 2005 at 05:53:27PM +0300, Gleb Natapov wrote: > > On Thu, Aug 25, 2005 at 09:43:31AM -0500, Troy Benjegerdes wrote: > > > On Thu, Aug 25, 2005 at 04:35:41PM +0300, Gleb Natapov wrote: > > > > On Wed, Aug 24, 2005 at

Re: [O-MPI devel] OpenIB results

2005-08-27 Thread Jeff Squyres
I committed a variant of this -- thanks! I did not yet increase the required version of Libtool -- see my next mail about this. On Aug 26, 2005, at 10:38 PM, Troy Benjegerdes wrote: On Fri, Aug 26, 2005 at 12:35:07PM -0400, Jeff Squyres wrote: On Aug 26, 2005, at 12:19 PM, Ralf Wildenhues

Re: [O-MPI devel] OpenIB results

2005-08-27 Thread Ralf Wildenhues
Hi Troy, * Troy Benjegerdes wrote on Sat, Aug 27, 2005 at 04:38:02AM CEST: > On Fri, Aug 26, 2005 at 12:35:07PM -0400, Jeff Squyres wrote: > > On Aug 26, 2005, at 12:19 PM, Ralf Wildenhues wrote: > > > > > (It would be good to augment the autogen.sh script so that it honored > > > a setting like

Re: [O-MPI devel] OpenIB results

2005-08-26 Thread Troy Benjegerdes
On Fri, Aug 26, 2005 at 12:35:07PM -0400, Jeff Squyres wrote: > On Aug 26, 2005, at 12:19 PM, Ralf Wildenhues wrote: > > > (It would be good to augment the autogen.sh script so that it honored > > a setting like ACLOCAL="path/to/aclocal -I ..." (in Bourne shell speak) > > and similarly for AUTOMAK

Re: [O-MPI devel] OpenIB results

2005-08-26 Thread Jeff Squyres
On Aug 26, 2005, at 12:19 PM, Ralf Wildenhues wrote: (It would be good to augment the autogen.sh script so that it honored a setting like ACLOCAL="path/to/aclocal -I ..." (in Bourne shell speak) and similarly for AUTOMAKE, AUTOCONF, LIBTOOLIZE). I have no objections to this... :-) -- {+} Jef

Re: [O-MPI devel] OpenIB results

2005-08-26 Thread Ralf Wildenhues
* Troy Benjegerdes wrote on Fri, Aug 26, 2005 at 04:18:06PM CEST: > > Did you manage to get this working on a debian system with just the > newer version of libtool? Jeff suggests I build libtool and all the > other autotools as well, but I'd like to see if I can avoid that, and > just update libt

Re: [O-MPI devel] OpenIB results

2005-08-26 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 05:53:27PM +0300, Gleb Natapov wrote: > On Thu, Aug 25, 2005 at 09:43:31AM -0500, Troy Benjegerdes wrote: > > On Thu, Aug 25, 2005 at 04:35:41PM +0300, Gleb Natapov wrote: > > > On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > > > > I also get the followin

Re: [O-MPI devel] OpenIB results

2005-08-26 Thread Jeff Squyres
This is symptomatic of you not installing all 3 tools in the same $prefix (I mentioned this on the phone yesterday). You *must* install all 3 tools together (they have interdependencies). Check out the HACKING file for details... On Aug 25, 2005, at 7:19 PM, Troy Benjegerdes wrote: failin

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
failing autogen.sh output at: http://scl.ameslab.gov/~troy/ompi-autogen.log

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
I don't know what Libtool 1.6 is -- there is no such version. I use Libtool 1.5.18. (Troy and I talked on the phone and cleared up a bunch of stuff -- resolution was first to fix the Libtool stuff and recompile, and we'll go from there -- potentially talking to Rich/Galen tomorrow when they

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 04:12:59PM -0400, Jeff Squyres wrote: > On Aug 25, 2005, at 3:45 PM, Troy Benjegerdes wrote: > > >>> 42: 771 bytes 12011 times --> 1063.33 Mbps in 5.53 usec > >>> 43:1021 bytes 6095 times --> mpirun noticed that job rank 1 > >>> with > >>> PID 5569 on

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
On Aug 25, 2005, at 3:45 PM, Troy Benjegerdes wrote: 42: 771 bytes 12011 times --> 1063.33 Mbps in 5.53 usec 43:1021 bytes 6095 times --> mpirun noticed that job rank 1 with PID 5569 on node "da5" exited on signal 11. 1 process killed (possibly by Open MPI) What are you

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 09:22:55AM -0600, Galen Mark Shipman wrote: > > > What would you prefer I build from? > > > Build from svn if possible. > > > I figured out I need -mca mpi_leave_pinned 1, but now I get: > This is correct. > > > > > 42: 771 bytes 12011 times --> 1063.33 Mbps in

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Galen Mark Shipman
> What would you prefer I build from? > Build from svn if possible. > I figured out I need -mca mpi_leave_pinned 1, but now I get: This is correct. > > 42: 771 bytes 12011 times --> 1063.33 Mbps in 5.53 usec > 43:1021 bytes 6095 times --> mpirun noticed that job rank 1 with

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 10:57:02AM -0400, Jeff Squyres wrote: > On Aug 25, 2005, at 10:43 AM, Troy Benjegerdes wrote: > > >> Look for RTLD_GLOBAL in opal/libltdl/ltdl.c. If it is not there openib > >> will not work if compiled as dynamic module. What version of libtool > >> are > >> you using? Ol

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
On Aug 25, 2005, at 10:43 AM, Troy Benjegerdes wrote: Look for RTLD_GLOBAL in opal/libltdl/ltdl.c. If it is not there openib will not work if compiled as dynamic module. What version of libtool are you using? Older libtool haven't used RTLD_GLOBAL for opening libraries. It's not there... tr

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Gleb Natapov
On Thu, Aug 25, 2005 at 09:43:31AM -0500, Troy Benjegerdes wrote: > On Thu, Aug 25, 2005 at 04:35:41PM +0300, Gleb Natapov wrote: > > On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > > > I also get the following messages on startup: > > > > > > libibverbs: Warning: no userspace

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
On Thu, Aug 25, 2005 at 04:35:41PM +0300, Gleb Natapov wrote: > On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > > I also get the following messages on startup: > > > > libibverbs: Warning: no userspace device-specific driver found for > > uverbs0 driver search path: /usr/lib/in

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Troy Benjegerdes
Is this the right command line for this? mpirun -mca btl_openib_leave_pinned 1 -np 2 -host opteron1,opteron2 ./NPmpi-openmpi -o /tmp/foo On Wed, Aug 24, 2005 at 10:48:31PM -0600, Galen M. Shipman wrote: > Hi Troy, > > Tim and I would like to discuss this with you as well. One thing I > would a

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Gleb Natapov
On Wed, Aug 24, 2005 at 09:21:37PM -0500, Troy Benjegerdes wrote: > I also get the following messages on startup: > > libibverbs: Warning: no userspace device-specific driver found for > uverbs0 driver search path: /usr/lib/infiniband > [0,1,1][btl_openib_component.c:267:mca_btl_openib_compo

Re: [O-MPI devel] OpenIB results

2005-08-25 Thread Jeff Squyres
Galen -- When you guys return to the office, it's probably worthwhile to see if it's possible to set leave_pinned to 1 automatically if the memory hooks are being set properly (Brian keeps explaining this stuff to me, but it's so complicated that the details quickly fall out of my brain ;-) )

Re: [O-MPI devel] OpenIB results

2005-08-24 Thread Galen M. Shipman
Hi Troy, Tim and I would like to discuss this with you as well. One thing I would ask, are you using the btl_mvapi_leave_pinned=1 option? otherwise it is not a apples to apples comparison. - Galen On Aug 24, 2005, at 8:21 PM, Troy Benjegerdes wrote: I have some Netpipe graphs of OpenMPI a

Re: [O-MPI devel] OpenIB results

2005-08-24 Thread Timothy S. Woodall
Hello Troy, Can you forward the graphs? From the error output - doesn't look like it's actually using IB - may be using TCP instead. I won't be back in the office until friday - but could give you a call then if you'd like. Regards, Tim > I have some Netpipe graphs of OpenMPI and Mviapich on