Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Ralph Castain
Umm...actually, I said there isn't a bug to fix :-) I don't think there is a bug. I think it is doing what it should do. Note that Geoffroy and I are specifically *not* talking about 1.3.1. We know that there are bugs in that release (specifically relating to multiple app_contexts, though t

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Gus Correa
Hi Ralph and Geffroy I've been following this thread with a lot of interest. Setting processor affinity and pin the processes to cores was next on my "TODO" list, and I just started it. I tried to use three different versions of rankfile, with OpenMPI 1.3.1 on a dual-socket quad-core Opteron mac

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente Puig
I forgot to say that "../../../gcc-4.2-20060805/libgfortran/fmain.c" is neither the path nor the program that I am trying to debug. 2009/5/5 Vicente Puig > But it doesn't work well. > For example, I am trying to debug a program, "floyd" in this case, and when > I make a breakpoint: > > No line 2

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente Puig
But it doesn't work well. For example, I am trying to debug a program, "floyd" in this case, and when I make a breakpoint: No line 26 in file "../../../gcc-4.2-20060805/libgfortran/fmain.c". I am getting disappointed and frustrated that I can not work well with openmpi in my Mac. There should be

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Geoffroy Pignot
Hi Ralph Thanks for your extra tests. Before leaving , I just pointed out a problem coming from running plpa across different rh distribs (<=> different Linux kernels). Indeed, I configure and compile openmpi on rhel4 , then I run on rhel5. I think my problem comes from this approximation. I'll d

Re: [OMPI users] users Digest, Vol 1217, Issue 2, Message3

2009-05-04 Thread Jeff Squyres
On May 4, 2009, at 9:50 AM, jan wrote: Thank you Jeff. I have passed the mail to the IB vendor Dell company(the blade was ordered from Dell Taiwan), but he todl me that he didn't understand "layer 0 diagnostics". Coluld you help us to get more information of "layer 0 diagnostics". Thanks agai

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Ralph Castain
Hmmm...I'm afraid I can't replicate the problem. All seems to be working just fine on the RHEL systems available to me. The procs indeed bind to the specified processors in every case. rhc@odin ~/trunk]$ cat rankfile rank 0=odin001 slot=0 rank 1=odin002 slot=1 [rhc@odin mpi]$ mpirun -rf ../../../

Re: [OMPI users] mca: base: component_find: unable toopen/usr/local/lib/openmpi/mca_crs_blcr: file not found (ignored)

2009-05-04 Thread Jeff Squyres
On May 4, 2009, at 9:57 AM, Kritiraj Sajadah wrote: In fact i am testing it on my laptop before installing it on the cluster. I downloaded BLCR and installed it in /usr/local on my laptop Then i installed openmpi using the following option: ./configure --prefix=/usr/local --with-

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Jeff Squyres
I get those as well. I believe that they are (annoying but) harmless -- an artifact of how the freeware gcc/gofrtran that I use was built. On May 4, 2009, at 1:47 PM, Vicente Puig wrote: Maybe I had to open a new thread, but if you have any idea why I receive it when I use gdb for debuggin

[OMPI users] error while loading shared libraries: libcr.so.0: cannot open shared object file: No such file or directory.

2009-05-04 Thread Kritiraj Sajadah
Dear All, I have install openmpi and blcr on my laptop and is trying to checkpoint an mpi application. Both openmpi and blcr are installed in /usr/local. When i try to checkpoint and mpi application, i get the following error: error while loading shared libraries: libcr.so.0: cannot op

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente Puig
Maybe I had to open a new thread, but if you have any idea why I receive it when I use gdb for debugging an openmpi program: warning: Could not find object file "/Users/admin/build/i386-apple-darwin9.0.0/libgcc/_umoddi3_s.o" - no debug information available for "../../../gcc-4.3-20071026/libgcc/../

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente Puig
I can run openmpi perfectly with command line, but I wanted a graphic interface for debugging because I was having problems. Thanks anyway. Vincent 2009/5/4 Warner Yuen > Admittedly, I don't use Xcode to build Open MPI either. > > You can just compile Open MPI from the command line and install

[OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Warner Yuen
Admittedly, I don't use Xcode to build Open MPI either. You can just compile Open MPI from the command line and install everything in /usr/local/. Make sure that gfortran is set in your path and you should just be able to do a './configure --prefix=/usr/local' After the installation, just m

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente Puig
If I can not make it work with Xcode, which one could I use?, which one do you use to compile and debug OpenMPI?. Thanks Vincent 2009/5/4 Jeff Squyres > Open MPI comes pre-installed in Leopard; as Warner noted, since Leopard > doesn't ship with a Fortran compiler, the Open MPI that Apple ship

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Jeff Squyres
Open MPI comes pre-installed in Leopard; as Warner noted, since Leopard doesn't ship with a Fortran compiler, the Open MPI that Apple ships has non-functional mpif77 and mpif90 wrapper compilers. So the Open MPI that you installed manually will use your Fortran compilers, and therefore will

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente
I can use openmpi from terminal, but I am having problems with gdb, so I wanted to know if there was posible to use openmpi with Xcode. However, for mac users, which is the best way to compile and debug an mpi program??. Thanks. Vincent El 04/05/2009, a las 17:42, Jeff Squyres escribió:

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente
Yes, I already have gfortran compiler on /usr/local/bin, the same path as my mpif90 compiler. But I've seen when I use the mpif90 on /usr/bin and on /Developer/usr/bin says it: "Unfortunately, this installation of Open MPI was not compiled with Fortran 90 support. As such, the mpif90 compil

Re: [OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Jeff Squyres
FWIW, I don't use Xcode, but I use the precompiled gcc/gfortran from here with good success: http://hpc.sourceforge.net/ On May 4, 2009, at 11:38 AM, Warner Yuen wrote: Have you installed a Fortran compiler? Mac OS X's developer tools do not come with a Fortran compiler, so you'll need

[OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Warner Yuen
Have you installed a Fortran compiler? Mac OS X's developer tools do not come with a Fortran compiler, so you'll need to install one if you haven't already done so. I routinely use the Intel IFORT compilers with success. However, I hear many good things about the gfortran compilers on Mac O

Re: [OMPI users] Myrinet optimization with OMP1.3 and macosX

2009-05-04 Thread Bogdan Costescu
On Mon, 4 May 2009, Ricardo Fern�ndez-Perea wrote: any idea where I should look for the cause. Can you try adding to the mpirun/mpiexec command line '--mca mtl mx --mca pml cm' to specify usage of the non-default MX MTL ? (sorry if you already do, I haven't found it in your e-mail) -- Bogd

Re: [OMPI users] Myrinet optimization with OMP1.3 and macosX

2009-05-04 Thread Ricardo Fernández-Perea
I finally have opportunity to run the imb-3.2 benchmark over myrinet I am running in a cluster of 16 node Xservers connected with myrinet 15 of them are 8core ones and the last one is a 4 cores one. Having a limit of 124 process I have run the test with the bynode option so from the 2 to the 16 pro

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Ralph Castain
Unfortunately, I didn't write any of that code - I was just fixing the mapper so it would properly map the procs. From what I can tell, the proper things are happening there. I'll have to dig into the code that specifically deals with parsing the results to bind the processes. Afraid that will tak

[OMPI users] How do I compile OpenMPI in Xcode 3.1

2009-05-04 Thread Vicente
Hi, I've seen the FAQ "How do I use Open MPI wrapper compilers in Xcode", but it's only for MPICC. I am using MPIF90, so I did the same, but changing MPICC for MPIF90, and also the path, but it did not work. Building target “fortran” of project “fortran” with configuration “Debug” Checki

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Geoffroy Pignot
Hi, So, there are no more crashes with my "crazy" mpirun command. But the paffinity feature seems to be broken. Indeed I am not able to pin my processes. Simple test with a program using your plpa library : r011n006% cat hostf r011n006 slots=4 r011n006% cat rankf rank 0=r011n006 slot=0 >

Re: [OMPI users] mca: base: component_find: unable to open/usr/local/lib/openmpi/mca_crs_blcr: file not found (ignored)

2009-05-04 Thread Kritiraj Sajadah
Hi Jeff, In fact i am testing it on my laptop before installing it on the cluster. I downloaded BLCR and installed it in /usr/local on my laptop Then i installed openmpi using the following option: ./configure --prefix=/usr/local --with-ft=cr --enable-ft-thread --enable-mpi-thread

Re: [OMPI users] users Digest, Vol 1217, Issue 2, Message3

2009-05-04 Thread jan
Thank you Jeff. I have passed the mail to the IB vendor Dell company(the blade was ordered from Dell Taiwan), but he todl me that he didn't understand "layer 0 diagnostics". Coluld you help us to get more information of "layer 0 diagnostics". Thanks again. Regards, Gloria Jan Wavelink Technol

Re: [OMPI users] users Digest, Vol 1217, Issue 2, Message3

2009-05-04 Thread jan
Thank you Jeff. I have passed the mail to the IB vendor Dell company(the blade was ordered from Dell Taiwan), but he todl me that he didn't understand "layer 0 diagnostics". Coluld you help us to get more information of "layer 0 diagnostics". Thanks again. Regards, Gloria Jan Wavelink Technol

Re: [OMPI users] mca: base: component_find: unable to open/usr/local/lib/openmpi/mca_crs_blcr: file not found (ignored)

2009-05-04 Thread Jeff Squyres
On May 4, 2009, at 9:06 AM, Kritiraj Sajadah wrote: raj@raj:mpirun -np 1 -am ft-enable-cr mpisleep I got the following with no checkpointing performed: raj@raj:mca: base: component_find: unable to open /usr/local/lib/ openmpi/mca_crs_blcr: file not found (ignored) This is usually a faulty

[OMPI users] mca: base: component_find: unable to open /usr/local/lib/openmpi/mca_crs_blcr: file not found (ignored)

2009-05-04 Thread Kritiraj Sajadah
Dear All, Thanks to Josh and Yaakoub, i was able to configure my openmpi as follows: raj@raj:./configure --prefix=/usr/local --with-ft=cr --enable-ft-thread --enable-mpi-threads --with-blcr=/usr/local. raj@raj:make all install I try to checkppoint an mpi application using the follow

Re: [OMPI users] users Digest, Vol 1217, Issue 2, Message3

2009-05-04 Thread Jeff Squyres
As I've indicated a few times in this thread: >> Have you run layer 0 diagnostics to know that your fabric is clean? >> You might want to contact your IB vendor to find out how to do that. On May 4, 2009, at 4:34 AM, jan wrote: Hi Jeff, I have updated the firmware of Infiniband module on De

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Ralph Castain
My apologies - I wasn't clear enough. You need a tarball from r2 or greater...such as: http://www.open-mpi.org/nightly/trunk/openmpi-1.4a1r21142.tar.gz HTH Ralph On May 4, 2009, at 2:14 AM, Geoffroy Pignot wrote: Hi , I got the openmpi-1.4a1r21095.tar.gz tarball, but unfortunately my

Re: [OMPI users] MPI processes hang when using OpenMPI 1.3.2 and Gcc-4.4.0

2009-05-04 Thread Simone Pellegrini
Hi, sorry for the delay but I did some additional experiments to found out whether the problem was openmpi or gcc! In attach u will find the program that causes the problem before mentioned. I compile the program with the following line: $HOME/openmpi-1.3.2-gcc44/bin/mpicc -O3 -g -Wall -fmessa

[OMPI users] Fw: users Digest, Vol 1217, Issue 2, Message3

2009-05-04 Thread jan
Hi Jeff, I have updated the firmware of Infiniband module on Dell M600, but the problem still occured. === $ mpirun -hostfile clusternode -np 16 --byslot --mca btl openib,sm,self $HOME/test/cpi Process 1 on node1 Proces

Re: [OMPI users] 1.3.1 -rf rankfile behaviour ??

2009-05-04 Thread Geoffroy Pignot
Hi , I got the openmpi-1.4a1r21095.tar.gztarball, but unfortunately my command doesn't work cat rankf: rank 0=node1 slot=* rank 1=node2 slot=* cat hostf: node1 slots=2 node2 slots=2 mpirun --rankfile rankf --hostfile hostf --h

Re: [OMPI users] HPL with OpenMPI: Do I have a memory leak?

2009-05-04 Thread Brian Barrett
Gus - Thanks for the info - it pretty much confirms my suspicion. In 1.3.0 and 1.3.1, we configured the glibc memory allocator to not give memory back to the OS. If most of the allocations are similarly sized or small, this all works out, because the allocator reuses the old allocations