Re: [OMPI users] problem calling mpirun from script invoked

2009-10-29 Thread Ralph Castain
Please see my earlier response. This proposed solution will work, but may be unstable as it (a) removes all of OMPI's internal variables, some of which are required; and (b) also removes all the variables that might be needed by your system. For example, envars directing the use of specific transpo

[OMPI users] problem calling mpirun from script invoked

2009-10-29 Thread Per Madsen
Could your problem is related to the MCA parameter "contamination" problem, where the child MPI process inherits MCA environment variables from the parent process still exists. Back in 2007 I was implementing a program that solves two large interrelated systems of equations (+200.000.000 eq.)

Re: [OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Luke Shulenburger
Thanks, That's what I wanted to know. And thanks for all the help! Luke On Wed, Oct 28, 2009 at 9:06 PM, Ralph Castain wrote: > I see. No, we don't copy your envars and ship them to remote nodes. Simple > reason is that we don't know which ones we can safely move, and which would > cause probl

Re: [OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Ralph Castain
I see. No, we don't copy your envars and ship them to remote nodes. Simple reason is that we don't know which ones we can safely move, and which would cause problems. However, we do provide a mechanism for you to tell us which envars to move. Just add: -x LD_LIBRARY_PATH to your mpirun cmd line

Re: [OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Luke Shulenburger
My apologies for not being clear. These variables are set in my environment, they just are not published to the other nodes in the cluster when the jobs are run through the scheduler. At the moment, even though I can use mpirun to run jobs locally on the head node without touching my environment,

Re: [OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Ralph Castain
Normally, one does simply set the ld_library_path in your environment to point to the right thing. Alternatively, you could configure OMPI with --enable-mpirun-prefix-by-default This tells OMPI to automatically add the prefix you configured the system with to your ld_library_path and path envars.

Re: [OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Luke Shulenburger
Thanks for the quick reply. This leads me to another issue I have been having with openmpi as it relates to sge. The "tight integration" works where I do not have to give mpirun a hostfile when I use the scheduler, but it does not seem to be passing on my environment variables. Specifically beca

Re: [OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Ralph Castain
I'm afraid we have never really supported this kind of nested invocations of mpirun. If it works with any version of OMPI, it is totally a fluke - it might work one time, and then fail the next. The problem is that we pass envars to the launched processes to control their behavior, and these confl

[OMPI users] problem calling mpirun from script invoked with mpirun

2009-10-28 Thread Luke Shulenburger
Hello, I am having trouble with a script that calls mpi. Basically my problem distills to wanting to call a script with: mpirun -np # ./script.sh where script.sh looks like: #!/bin/bash mpirun -np 2 ./mpiprogram Whenever I invoke script.sh normally (as ./script.sh for instance) it works fine, b