Hi, I have an issue using the option -cpus-per-proc 2. As I have Bulldozer machines and I want only one process per FP core, I thought using -cpus-per-proc 2 would be the way to go. Initially I had this issue inside GridEngine but then tried it outside any queuingsystem and face exactly the same behavior.
@) Each machine has 4 CPUs with each having 16 integer cores, hence 64 integer cores per machine in total. Used Open MPI is 1.6.4. a) mpiexec -cpus-per-proc 2 -report-bindings -hostfile machines -np 64 ./mpihello and a hostfile containing only the two lines listing the machines: node006 node007 This works as I would like it (see working.txt) when initiated on node006. b) mpiexec -cpus-per-proc 2 -report-bindings -hostfile machines -np 64 ./mpihello But changing the hostefile so that it is having a slot count which might mimic the behavior in case of a parsed machinefile out of any queuing system: node006 slots=64 node007 slots=64 This fails with: -------------------------------------------------------------------------- An invalid physical processor ID was returned when attempting to bind an MPI process to a unique processor on node: Node: node006 This usually means that you requested binding to more processors than exist (e.g., trying to bind N MPI processes to M processors, where N > M), or that the node has an unexpectedly different topology. Double check that you have enough unique processors for all the MPI processes that you are launching on this host, and that all nodes have identical topologies. You job will now abort. -------------------------------------------------------------------------- (see failed.txt) b1) mpiexec -cpus-per-proc 2 -report-bindings -hostfile machines -np 32 ./mpihello This works and the found universe is 128 as expected (see only32.txt). c) Maybe the used machinefile is not parsed in the correct way, so I checked: c1) mpiexec -hostfile machines -np 64 ./mpihello => works c2) mpiexec -hostfile machines -np 128 ./mpihello => works c3) mpiexec -hostfile machines -np 129 ./mpihello => fails as expected So, it got the slot counts in the correct way. What do I miss? -- Reuti
reuti@node006:~> mpiexec -cpus-per-proc 2 -report-bindings -hostfile machines -np 64 ./mpihello -------------------------------------------------------------------------- An invalid physical processor ID was returned when attempting to bind an MPI process to a unique processor on node: Node: node006 This usually means that you requested binding to more processors than exist (e.g., trying to bind N MPI processes to M processors, where N > M), or that the node has an unexpectedly different topology. Double check that you have enough unique processors for all the MPI processes that you are launching on this host, and that all nodes have identical topologies. You job will now abort. -------------------------------------------------------------------------- [node006:44140] MCW rank 0 bound to socket 0[core 0-1]: [B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 1 bound to socket 0[core 2-3]: [. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 2 bound to socket 0[core 4-5]: [. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 3 bound to socket 0[core 6-7]: [. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 4 bound to socket 0[core 8-9]: [. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 5 bound to socket 0[core 10-11]: [. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 6 bound to socket 0[core 12-13]: [. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 7 bound to socket 0[core 14-15]: [. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 8 bound to socket 1[core 0-1]: [. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 9 bound to socket 1[core 2-3]: [. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 10 bound to socket 1[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 11 bound to socket 1[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 12 bound to socket 1[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 13 bound to socket 1[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 14 bound to socket 1[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 15 bound to socket 1[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 16 bound to socket 2[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 17 bound to socket 2[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 18 bound to socket 2[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 19 bound to socket 2[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 20 bound to socket 2[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 21 bound to socket 2[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 22 bound to socket 2[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 23 bound to socket 2[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .] [node006:44140] MCW rank 24 bound to socket 3[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .] [node006:44140] MCW rank 25 bound to socket 3[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .] [node006:44140] MCW rank 26 bound to socket 3[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .] [node006:44140] MCW rank 27 bound to socket 3[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .] [node006:44140] MCW rank 28 bound to socket 3[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .] [node006:44140] MCW rank 29 bound to socket 3[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .] [node006:44140] MCW rank 30 bound to socket 3[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .] [node006:44140] MCW rank 31 bound to socket 3[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B] -------------------------------------------------------------------------- mpiexec was unable to start the specified application as it encountered an error on node node006. More information may be available above. -------------------------------------------------------------------------- 64 total processes failed to start reuti@node006:~>
reuti@node006:~> mpiexec -cpus-per-proc 2 -report-bindings -hostfile machines -np 32 ./mpihello [node006:44897] MCW rank 20 bound to socket 2[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 21 bound to socket 2[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 22 bound to socket 2[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 23 bound to socket 2[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 24 bound to socket 3[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .] [node006:44897] MCW rank 25 bound to socket 3[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .] [node006:44897] MCW rank 26 bound to socket 3[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .] [node006:44897] MCW rank 27 bound to socket 3[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .] [node006:44897] MCW rank 28 bound to socket 3[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .] [node006:44897] MCW rank 29 bound to socket 3[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .] [node006:44897] MCW rank 30 bound to socket 3[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .] [node006:44897] MCW rank 31 bound to socket 3[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B] [node006:44897] MCW rank 0 bound to socket 0[core 0-1]: [B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 1 bound to socket 0[core 2-3]: [. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 2 bound to socket 0[core 4-5]: [. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 3 bound to socket 0[core 6-7]: [. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 4 bound to socket 0[core 8-9]: [. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 5 bound to socket 0[core 10-11]: [. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 6 bound to socket 0[core 12-13]: [. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 7 bound to socket 0[core 14-15]: [. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 8 bound to socket 1[core 0-1]: [. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 9 bound to socket 1[core 2-3]: [. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 10 bound to socket 1[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 11 bound to socket 1[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 12 bound to socket 1[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 13 bound to socket 1[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 14 bound to socket 1[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 15 bound to socket 1[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 16 bound to socket 2[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 17 bound to socket 2[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 18 bound to socket 2[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:44897] MCW rank 19 bound to socket 2[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .] Total: 32 Universe: 128 Hello World from Node 0. Hello World from Node 1. Hello World from Node 2. Hello World from Node 3. Hello World from Node 4. Hello World from Node 5. Hello World from Node 6. Hello World from Node 7. Hello World from Node 8. Hello World from Node 9. Hello World from Node 10. Hello World from Node 11. Hello World from Node 12. Hello World from Node 13. Hello World from Node 14. Hello World from Node 15. Hello World from Node 16. Hello World from Node 17. Hello World from Node 18. Hello World from Node 19. Hello World from Node 20. Hello World from Node 22. Hello World from Node 23. Hello World from Node 21. Hello World from Node 24. Hello World from Node 25. Hello World from Node 26. Hello World from Node 27. Hello World from Node 28. Hello World from Node 29. Hello World from Node 30. Hello World from Node 31. reuti@node006:~>
reuti@node006:~> mpiexec -cpus-per-proc 2 -report-bindings -hostfile machines -np 64 ./mpihello [node006:43869] MCW rank 24 bound to socket 1[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 26 bound to socket 1[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 28 bound to socket 1[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 30 bound to socket 1[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 32 bound to socket 2[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 34 bound to socket 2[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 36 bound to socket 2[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 38 bound to socket 2[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 40 bound to socket 2[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 42 bound to socket 2[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 44 bound to socket 2[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 46 bound to socket 2[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 48 bound to socket 3[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .] [node006:43869] MCW rank 50 bound to socket 3[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .] [node006:43869] MCW rank 52 bound to socket 3[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .] [node006:43869] MCW rank 54 bound to socket 3[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .] [node006:43869] MCW rank 56 bound to socket 3[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .] [node006:43869] MCW rank 58 bound to socket 3[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .] [node006:43869] MCW rank 60 bound to socket 3[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .] [node006:43869] MCW rank 62 bound to socket 3[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B] [node006:43869] MCW rank 0 bound to socket 0[core 0-1]: [B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 2 bound to socket 0[core 2-3]: [. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 4 bound to socket 0[core 4-5]: [. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 6 bound to socket 0[core 6-7]: [. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 8 bound to socket 0[core 8-9]: [. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 10 bound to socket 0[core 10-11]: [. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 12 bound to socket 0[core 12-13]: [. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 14 bound to socket 0[core 14-15]: [. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 16 bound to socket 1[core 0-1]: [. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 18 bound to socket 1[core 2-3]: [. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 20 bound to socket 1[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node006:43869] MCW rank 22 bound to socket 1[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 33 bound to socket 2[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 35 bound to socket 2[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 37 bound to socket 2[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 39 bound to socket 2[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 41 bound to socket 2[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 43 bound to socket 2[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 45 bound to socket 2[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 47 bound to socket 2[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 49 bound to socket 3[core 0-1]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .] [node007:40674] MCW rank 51 bound to socket 3[core 2-3]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .] [node007:40674] MCW rank 53 bound to socket 3[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .] [node007:40674] MCW rank 55 bound to socket 3[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .] [node007:40674] MCW rank 57 bound to socket 3[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .] [node007:40674] MCW rank 59 bound to socket 3[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .] [node007:40674] MCW rank 61 bound to socket 3[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .] [node007:40674] MCW rank 63 bound to socket 3[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B] [node007:40674] MCW rank 1 bound to socket 0[core 0-1]: [B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 3 bound to socket 0[core 2-3]: [. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 5 bound to socket 0[core 4-5]: [. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 7 bound to socket 0[core 6-7]: [. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 9 bound to socket 0[core 8-9]: [. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 11 bound to socket 0[core 10-11]: [. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 13 bound to socket 0[core 12-13]: [. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 15 bound to socket 0[core 14-15]: [. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 17 bound to socket 1[core 0-1]: [. . . . . . . . . . . . . . . .][B B . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 19 bound to socket 1[core 2-3]: [. . . . . . . . . . . . . . . .][. . B B . . . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 21 bound to socket 1[core 4-5]: [. . . . . . . . . . . . . . . .][. . . . B B . . . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 23 bound to socket 1[core 6-7]: [. . . . . . . . . . . . . . . .][. . . . . . B B . . . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 25 bound to socket 1[core 8-9]: [. . . . . . . . . . . . . . . .][. . . . . . . . B B . . . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 27 bound to socket 1[core 10-11]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . B B . . . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 29 bound to socket 1[core 12-13]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . B B . .][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] [node007:40674] MCW rank 31 bound to socket 1[core 14-15]: [. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . B B][. . . . . . . . . . . . . . . .][. . . . . . . . . . . . . . . .] Total: 64 Universe: 2 Hello World from Node 0. Hello World from Node 2. Hello World from Node 4. Hello World from Node 6. Hello World from Node 8. Hello World from Node 10. Hello World from Node 12. Hello World from Node 14. Hello World from Node 16. Hello World from Node 18. Hello World from Node 20. Hello World from Node 22. Hello World from Node 24. Hello World from Node 26. Hello World from Node 28. Hello World from Node 30. Hello World from Node 32. Hello World from Node 34. Hello World from Node 36. Hello World from Node 38. Hello World from Node 42. Hello World from Node 44. Hello World from Node 46. Hello World from Node 48. Hello World from Node 50. Hello World from Node 52. Hello World from Node 54. Hello World from Node 56. Hello World from Node 58. Hello World from Node 60. Hello World from Node 62. Hello World from Node 40. Hello World from Node 1. Hello World from Node 3. Hello World from Node 9. Hello World from Node 11. Hello World from Node 13. Hello World from Node 15. Hello World from Node 21. Hello World from Node 23. Hello World from Node 29. Hello World from Node 39. Hello World from Node 5. Hello World from Node 7. Hello World from Node 17. Hello World from Node 19. Hello World from Node 25. Hello World from Node 27. Hello World from Node 31. Hello World from Node 33. Hello World from Node 35. Hello World from Node 41. Hello World from Node 37. Hello World from Node 43. Hello World from Node 45. Hello World from Node 47. Hello World from Node 49. Hello World from Node 51. Hello World from Node 53. Hello World from Node 55. Hello World from Node 57. Hello World from Node 59. Hello World from Node 61. Hello World from Node 63. reuti@node006:~>
