Re: [OMPI devel] processor affinity -- OpenMPI / batch system integration

2009-10-22 Thread Rayson Ho
The code for the Job to Core Binding (aka. thread binding, or CPU binding) feature was checked into the Grid Engine project cvs. It uses OpenMPI's Portable Linux Processor Affinity (PLPA) library, and is topology and NUMA aware. The presentation from HPC Software Workshop '09: http://wikis.sun.com

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Ralph Castain
Note that we would also have to modify OMPI to: 1. recognize these environmental variables, and 2. use them to actually set the binding, instead of using OMPI- internal directives Not a big deal to do, but not something currently in the system. Since we launch through our own daemons (somet

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Jeff Squyres
On Sep 30, 2008, at 2:51 PM, Rayson Ho wrote: Restarting this discussion. A new update version of Grid Engine 6.2 will come out early next year [1], and I really hope that we can get at least the interface defined. Great! At the minimum, is it enough for the batch system to tell OpenMPI via

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Rayson Ho
Restarting this discussion. A new update version of Grid Engine 6.2 will come out early next year [1], and I really hope that we can get at least the interface defined. At the minimum, is it enough for the batch system to tell OpenMPI via an env variable which core (or virtual core, in the SMT cas

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-01-11 Thread Jeff Squyres
carto is more intended to be a discovery and provider of topology information. How various parts of the OMPI code base use that information is a different issue. With regards to processor affinity, there are two general ways of doing it: 1. The resource manager tells us what processors h

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-01-11 Thread Pak Lui
Hi Rayson, I guess this is an issue only for SGE. I believe there is something called 'carto' framework is being developed to represent the node-socket relationship in order to address the multicore issue. I think there are other folks in the team who are actively working on it so they probabl

[OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-01-09 Thread Rayson Ho
Hello, I'm from the Sun Grid Engine (SGE) project ( http://gridengine.sunsource.net ). I am working on processor affinity support for SGE. In 2005, we had some discussions on the SGE mailing list with Jeff on this topic. As quad-core processors are available from AMD and Intel, and higher core co