Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-09 Thread Lenny Verkhovsky
Hi, 1. please, provide #cat /proc/cpu_info 2. see http://www.open-mpi.org/faq/?category=tuning#paffinity-defs. Best regards Lenny.

Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-05 Thread V. Ram
Terry Frankcombe wrote: > Isn't it up to the OS scheduler what gets run where? I was under the impression that the processor affinity API was designed to let the OS (at least Linux) know how a given task preferred to be bound in terms of the system topology. -- V. Ram v_r_...@fastmail.fm --

Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-05 Thread V. Ram
Ralph Castain wrote: > Thanks - yes, that helps. Can you do add --display-map to you cmd > line? That will tell us what mpirun thinks it is doing. The output from display map is below. Note that I've sanitized a few items, but nothing relevant to this: [granite:29685] Map for job: 1 Gener

Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-04 Thread Terry Frankcombe
Isn't it up to the OS scheduler what gets run where? > We have an 8-way, 32-core AMD processor machine (single system image) > and are at present running OpenMPI 1.2.8 . Jobs are launched locally on > the machine itself. As far as I can see, there doesn't seem to be any > way to tell OpenMPI to

Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-04 Thread Ralph Castain
Thanks - yes, that helps. Can you do add --display-map to you cmd line? That will tell us what mpirun thinks it is doing. Thanks Ralph On Dec 4, 2008, at 2:07 PM, V. Ram wrote: Ralph H. Castain wrote: I confess to confusion. OpenMPI will by default map your processes in a round-robin fashi

Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-04 Thread V. Ram
Ralph H. Castain wrote: > I confess to confusion. OpenMPI will by default map your processes in > a round-robin fashion based on process slot. If you are in a resource > managed environment (e.g., TM or SLURM), then the slots correspond to > cores. If you are in an unmanaged environment, then your

Re: [OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-04 Thread Ralph Castain
I confess to confusion. OpenMPI will by default map your processes in a round-robin fashion based on process slot. If you are in a resource managed environment (e.g., TM or SLURM), then the slots correspond to cores. If you are in an unmanaged environment, then your hostfile needs to specif

[OMPI users] Processor/core selection/affinity for large shared memory systems

2008-12-04 Thread V. Ram
We have an 8-way, 32-core AMD processor machine (single system image) and are at present running OpenMPI 1.2.8 . Jobs are launched locally on the machine itself. As far as I can see, there doesn't seem to be any way to tell OpenMPI to launch the MPI processes on adjacent cores. Presumably such f