[OMPI devel] opal/mca/common: you can remove this directory

2012-03-29 Thread Jeffrey Squyres
FYI: The opal/mca/common directory had been functionally empty for a while, so I "svn rm"'ed it last week or so. However, if you svn up, it SVN will likely still leave that directory around because it probably contains a Makefile and Makefile.in. It is safe to rm -rf this entire tree and re-au

[OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Raju
Hi Team, I am using Qlogic Infiniband and Openmpi-1.5.3. I can able to run the jobs by CLI without any issues, but when iam submitting over torque scheduler facing the below issue. I am facing issue while submitting the jobs through Torque scheduler. Error file is attached *Overview of the probl

Re: [OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Ralph Castain
One thing stands out right away: why are you specifying a hostfile? Did you remember to configure OMPI with --with-tm so we launch via Torque? If not, then you could hit issues as you are actually attempting to launch via ssh, which has implications on a Torque-based system. On Mar 29, 2012, a

Re: [OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Raju
Hi Ralph, Thanks for the very quick response, I did compiled with -tm option i am doing now, once it done i will revert back... Thanks Raju.. On Thu, Mar 29, 2012 at 8:29 PM, Ralph Castain wrote: > One thing stands out right away: why are you specifying a hostfile? Did > you remember to config

Re: [OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Raju
Hi Ralph, I recompiled OMPI with --with-tm option, but still same issue... I changed the input file as below... Please let me know what i have to fine tune and verify #!/bin/bash #PBS -N matmul #PBS -l nodes=1:ppn=1 node=1 ppn=1 nprocs=`expr ${node} \* ${ppn}` export PSM_SHAREDCONTEXTS_MAX=16 m

Re: [OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Jeffrey Squyres
This looks like a PSM problem (PSM is the layer than runs below Open MPI on QLogic NICs). You might need to contact QLogic tech support to find out how to solve it. On Mar 29, 2012, at 11:26 AM, Raju wrote: > Hi Ralph, > > I recompiled OMPI with --with-tm option, but still same issue... I c

Re: [OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Raju
Hi Jeffrey, Thanks for that i will contact them... as i mentioned earlier.. OpenMPI developers has provided the solution that we need to set the value for PSM_SHAREDCONTEXTS_MAX="some value" I kept in input file as export PSM_SHAREDCONTEXTS_MAX=16.. Correct me i have to do it same way or a

Re: [OMPI devel] Openmpi-1.5.3 issue " initialization failure on /dev/ipath (err=23)"

2012-03-29 Thread Jeffrey Squyres
I didn't realize from your text that the SHAREDCONTEXTS_MAX value made it work. If so, I would assume that is a good solution. But I don't know for sure; you might well need to contact QLogic and ask. On Mar 29, 2012, at 11:34 AM, Raju wrote: > Hi Jeffrey, > > Thanks for that i will contact