Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-09-14 Thread Dave Love
"Lane, William" writes: > So qsort_args is supposed to be set to NONE? I had thought when the > FAQ said qsort_args is > "necessary" that meant a value other than NONE had to be put there. It means the PE definition for the current version includes qsort_args, as in the example and the man page.

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-09-10 Thread Lane, William
Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7 "Lane, William" writes: > Our issues with OpenMPI 1.8.7 and Son-of-Gridengine turned out to be > down to using the wrong Parallel Environment. Having a PE with > control_slaves set to TRUE and start

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-09-10 Thread Dave Love
"Lane, William" writes: > Our issues with OpenMPI 1.8.7 and Son-of-Gridengine turned out to be > down to using the wrong Parallel Environment. Having a PE with > control_slaves set to TRUE and start_proc_args and stop_proc_args set > to NONE cleared up all our issues, at least for my MPI test cod

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-09-04 Thread Lane, William
. -Bill L. From: users [users-boun...@open-mpi.org] on behalf of Gilles Gouaillardet [gilles.gouaillar...@gmail.com] Sent: Wednesday, August 12, 2015 7:40 AM To: Open MPI Users Subject: Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-12 Thread Gilles Gouaillardet
basically, without --hetero-nodes, ompi assumes all nodes have the same topology (fast startup) with --hetero-nodes, ompi does not assume anything and request node topology (slower startup) I am nor sure if this is still 100% true on all versions. iirc, at least on master, a hwloc signature is che

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-12 Thread Dave Love
"Lane, William" writes: > I can successfully run my OpenMPI 1.8.7 jobs outside of Son-of-Gridengine but > not via qrsh. We're > using CentOS 6.3 and a heterogeneous cluster of hyperthreaded and > non-hyperthreaded blades > and x3550 chassis. OpenMPI 1.8.7 has been built w/the debug switch as we

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-11 Thread Lane, William
___ From: users [users-boun...@open-mpi.org] on behalf of Dave Love [d.l...@liverpool.ac.uk] Sent: Tuesday, August 11, 2015 9:34 AM To: Open MPI Users Subject: Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7 "Lane, William" writes: > I

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-11 Thread Dave Love
"Lane, William" writes: > I read @ > > https://www.open-mpi.org/faq/?category=sge > > that for OpenMPI Parallel Environments there's > a special consideration for Son of Grid Engine: > >'"qsort_args" is necessary with the Son of Grid Engine distribution, >version 8.1.1 and later, and prob

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-10 Thread Lane, William
e_verbose 5 mpirun switches. -Bill L. From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain [r...@open-mpi.org] Sent: Wednesday, August 05, 2015 4:41 PM To: Open MPI Users Subject: Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenM

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-05 Thread Ralph Castain
appropriate settings > and see if that makes a difference. > > -Bill L > > -- > *From:* users [users-boun...@open-mpi.org] on behalf of Ralph Castain [ > r...@open-mpi.org] > *Sent:* Wednesday, August 05, 2015 1:18 PM > *To:* Open MP

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-05 Thread Lane, William
_ From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain [r...@open-mpi.org] Sent: Wednesday, August 05, 2015 1:18 PM To: Open MPI Users Subject: Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7 You know, I honestly don't know - there is a patch in

Re: [OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-05 Thread Ralph Castain
You know, I honestly don't know - there is a patch in there for qsort, but I haven't checked it against SGE. Let us know if you hit a problem and we'll try to figure it out. Glad to hear your cluster is working - nice to have such challenges to shake the cobwebs out :-) On Wed, Aug 5, 2015 at 12:

[OMPI users] Son of Grid Engine, Parallel Environments and OpenMPI 1.8.7

2015-08-05 Thread Lane, William
I read @ https://www.open-mpi.org/faq/?category=sge that for OpenMPI Parallel Environments there's a special consideration for Son of Grid Engine: '"qsort_args" is necessary with the Son of Grid Engine distribution, version 8.1.1 and later, and probably only applicable to it. For very