Re: [OMPI users] Problems on large clusters

2011-06-27 Thread Thorsten Schuett
want to look at our FAQ > category for large clusters: > > http://www.open-mpi.org/faq/?category=large-clusters > > On Jun 22, 2011, at 9:43 AM, Thorsten Schuett wrote: > > Thanks for the tip. I can't tell yet whether it helped or not. However, > > with y

Re: [OMPI users] Problems on large clusters

2011-06-22 Thread Thorsten Schuett
num 128 -mca > mpi_preconnect_mpi 0 -mca mpool_sm_min_size 131072 -mca btl > sm,openib,self -mca btl_openib_want_fork_support 0 -mca > opal_set_max_sys_limits 1 -mca osc_pt2pt_no_locks 1 -mca > osc_rdma_no_locks 1 YOUR_APP > > (Watch the step : only one line only ...) > > This should be suita

Re: [OMPI users] Problems on large clusters

2011-06-22 Thread Thorsten Schuett
On Tuesday, June 21, 2011, Gilbert Grosdidier wrote: > Bonjour Thorsten, > > Could you please be a little bit more specific about the cluster > itself ? > > G. > > Le 21 juin 11 à 17:46, Thorsten Schuett a écrit : > > Hi, > > > > I am runni

[OMPI users] Problems on large clusters

2011-06-21 Thread Thorsten Schuett
Hi, I am running openmpi 1.5.3 on a IB cluster and I have problems starting jobs on larger node counts. With small numbers of tasks, it usually works. But now the startup failed three times in a row using 255 nodes. I am using 255 nodes with one MPI task per node and the mpiexec looks as follo