Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Ralph Castain
Note that we would also have to modify OMPI to: 1. recognize these environmental variables, and 2. use them to actually set the binding, instead of using OMPI- internal directives Not a big deal to do, but not something currently in the system. Since we launch through our own daemons (somet

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Jeff Squyres
On Sep 30, 2008, at 2:51 PM, Rayson Ho wrote: Restarting this discussion. A new update version of Grid Engine 6.2 will come out early next year [1], and I really hope that we can get at least the interface defined. Great! At the minimum, is it enough for the batch system to tell OpenMPI via

Re: [OMPI devel] processor affinity -- OpenMPI/batch system integration

2008-09-30 Thread Rayson Ho
Restarting this discussion. A new update version of Grid Engine 6.2 will come out early next year [1], and I really hope that we can get at least the interface defined. At the minimum, is it enough for the batch system to tell OpenMPI via an env variable which core (or virtual core, in the SMT cas

[OMPI devel] RDMA CM CPC HG ready again

2008-09-30 Thread Jeff Squyres
(putting this on devel just so that others can see it) Ok, I put in all the things in the RDMA CM CPC HG tree that we've talked about and it now should work out of the box with: - any iwarp (no need for kernel hacks to have initiator send first) - any IB (setup the stuff to do the initiator_d