Hi,
Reuti <mailto:re...@staff.uni-marburg.de>
Mittwoch, 22. August 2012 22:19
Hi,
Am 22.08.2012 um 21:39 schrieb Henrichs, Juryk:
we have a heterogeneous cluster consisting of nodes with 32 and
48
cpu's. Some of our jobs are best run either on one complete
node or
distributed over a number of nodes. In either case it is
desired that
the job runs exclusively on each node and uses all available
slots.
The reason for this is that we use mpirun with --mca
mpi_paffinity_alone
1 as this gives the best performance.
The problem is, that up to now we have to take care on which
type of
nodes a job is running and that jobs are not distributed over
mixed nodes.
You mean only 32 core machine or 48 core machines?
Yes.
Is there a way to submit jobs with a somehow flexible number of
slots
such that only complete nodes are allocated?
Sure, you can specify a slot range for the PE request in `qsub`.
How is determined on how many slots the job is finally started? Available slots
depending on the requested resources? Can I be sure to end up with completely
filled nodes?
I am aware of the $pe_slots allocation rule, but as I
understand it, a
job which requests more slots than available on one single node
will
never get started.
Correct.
There is also something like the "allocation_rule 48" to get multiple
of 48 slots.
Problem is if my queue spans over nodes with 32 and 48 cores. I could set the
allocation rule to 32 and using exclusive scheduling I could be sure that each
node is used exclusively for this job. However on a 48 core node 16 cores would
be idle, which is not effective.
-- Reuti
Juryk
This e-mail and any attachment thereto may contain confidential
information and/or information protected by intellectual property rights for
the exclusive attention of the intended addressees named above. Any access of
third parties to this e-mail is unauthorised. Any use of this e-mail by
unintended recipients such as total or partial copying, distribution,
disclosure etc. is prohibited and may be unlawful. When addressed to our
clients the content of this e-mail is subject to the General Terms and
Conditions of GL's Group of Companies applicable at the date of this e-mail.
If you have received this e-mail in error, please notify the
sender either by telephone or by e-mail and delete the material from any
computer.
GL's Group of Companies does not warrant and/or guarantee that
this message at the moment of receipt is authentic, correct and its
communication free of errors, interruption etc.
FutureShip GmbH, HRB 106781 AG HH, VAT Reg. No. DE263937825
Geschäftsführer (CEO): Volker Höppner, Henning Kinkhorst,
Stefan Deucker
_______________________________________________
users mailing list
users@gridengine.org
https://gridengine.org/mailman/listinfo/users
--
Juryk Henrichs,
Senior Project Engineer
Fluid Engineering
FutureShip GmbH -- A GL company
Office Potsdam
Behlertstr. 3a, Haus G
D-14467 Potsdam
Tel.: +49 331 9799 179-16
Fax.: +49 331 9799 179-9
http://www.futureship.net
http://www.gl-group.com
This e-mail and any attachment thereto may contain confidential information
and/or information protected by intellectual property rights for the exclusive
attention of the intended addressees named above. Any access of third parties
to this e-mail is unauthorised. Any use of this e-mail by unintended recipients
such as total or partial copying, distribution, disclosure etc. is prohibited
and may be unlawful. When addressed to our clients the content of this e-mail
is subject to the General Terms and Conditions of GL's Group of Companies
applicable at the date of this e-mail.
If you have received this e-mail in error, please notify the sender either by
telephone or by e-mail and delete the material from any computer.
GL's Group of Companies does not warrant and/or guarantee that this message at
the moment of receipt is authentic, correct and its communication free of
errors, interruption etc.
FutureShip GmbH, HRB 106781 AG HH, VAT Reg. No. DE263937825
Geschäftsführer (CEO): Volker Höppner, Henning Kinkhorst, Stefan Deucker
<<inline: compose-unknown-contact.jpg>>
_______________________________________________ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
