[OMPI users] questions about MPI-IO

2010-12-21 Thread Tom Rosmond
I have been experimenting with some simple fortran test programs to write files with some of the MPI-IO functions, and have come across a troubling issue. I use the function MPI_FILE_SET_VIEW with the 'native' data representation and correctly write a file with MPI_FILE_WRITE_ALL. However, if I ch

Re: [OMPI users] Running OpenMPI on SGI Altix with 4096 cores: very poor performance

2010-12-21 Thread Matthieu Brucher
Don't forget that MPT has some optimizations OpenMPI may not have, as "overriding" free(). This way, MPT can have a huge performance boost if you're allocating and freeing memory, and the same happens if you communicate often. Matthieu 2010/12/21 Gilbert Grosdidier : > Hi George, >  Thanks for yo

Re: [OMPI users] Running OpenMPI on SGI Altix with 4096 cores: very poor performance

2010-12-21 Thread Gilbert Grosdidier
Hi George, Thanks for your help. The bottom line is that the processes are neatly placed on the nodes/cores, as far as I can tell from the map : [...] Process OMPI jobid: [33285,1] Process rank: 4 Process OMPI jobid: [33285,1] Process rank: 5 Process OMPI jobid: [3328

[OMPI users] memory consumption on rank 0 and btl_openib_receive_queues use

2010-12-21 Thread Eloi Gaudry
hi, when launching a parallel computation on 128 nodes using openib and the "-mca btl_openib_receive_queues P,65536,256,192,128" option, i observe a rather large memory consumption (2GB: 65336*256*128) on the process with rank 0 (only). this memory seems to be initialized and in use as the r