On 22 August 2012 21:50, Henrichs, Juryk <juryk.henri...@gl-group.com>wrote:
> Hi, > > Reuti <re...@staff.uni-marburg.de> > Mittwoch, 22. August 2012 22:19 > > Hi, > > Am 22.08.2012 um 21:39 schrieb Henrichs, Juryk: > > > we have a heterogeneous cluster consisting of nodes with 32 and 48 > cpu's. Some of our jobs are best run either on one complete node or > distributed over a number of nodes. In either case it is desired that > the job runs exclusively on each node and uses all available slots. > > The reason for this is that we use mpirun with --mca mpi_paffinity_alone > 1 as this gives the best performance. > > The problem is, that up to now we have to take care on which type of > nodes a job is running and that jobs are not distributed over mixed nodes. > > You mean only 32 core machine or 48 core machines? > > Yes. > > Is there a way to submit jobs with a somehow flexible number of slots > such that only complete nodes are allocated? > > Sure, you can specify a slot range for the PE request in `qsub`. > > How is determined on how many slots the job is finally started? > Available slots depending on the requested resources? Can I be sure to end > up with completely filled nodes? > > I am aware of the $pe_slots allocation rule, but as I understand it, a > job which requests more slots than available on one single node will > never get started. > > Correct. > > There is also something like the "allocation_rule 48" to get multiple of 48 > slots. > > Problem is if my queue spans over nodes with 32 and 48 cores. I could > set the allocation rule to 32 and using exclusive scheduling I could be > sure that each node is used exclusively for this job. However on a 48 core > node 16 cores would be idle, which is not effective. > > Well don't do that then. Put the PEs with allocation rule 48 on queues associated solely with 48 core nodes. Similarly for 32 and 16 core PEs. Wildcard the request William > > -- Reuti > > > > Juryk > > > This e-mail and any attachment thereto may contain confidential information > and/or information protected by intellectual property rights for the > exclusive attention of the intended addressees named above. Any access of > third parties to this e-mail is unauthorised. Any use of this e-mail by > unintended recipients such as total or partial copying, distribution, > disclosure etc. is prohibited and may be unlawful. When addressed to our > clients the content of this e-mail is subject to the General Terms and > Conditions of GL's Group of Companies applicable at the date of this e-mail. > If you have received this e-mail in error, please notify the sender either by > telephone or by e-mail and delete the material from any computer. > GL's Group of Companies does not warrant and/or guarantee that this message > at the moment of receipt is authentic, correct and its communication free of > errors, interruption etc. > FutureShip GmbH, HRB 106781 AG HH, VAT Reg. No. DE263937825 > Geschäftsführer (CEO): Volker Höppner, Henning Kinkhorst, Stefan Deucker > > > _______________________________________________ > users mailing > listusers@gridengine.orghttps://gridengine.org/mailman/listinfo/users > > > -- > Juryk Henrichs, > > Senior Project Engineer > Fluid Engineering > FutureShip GmbH -- A GL company > > Office Potsdam > Behlertstr. 3a, Haus G > D-14467 Potsdam > > Tel.: +49 331 9799 179-16 > Fax.: +49 331 9799 179-9 > > http://www.futureship.net > http://www.gl-group.com > This e-mail and any attachment thereto may contain confidential > information and/or information protected by intellectual property rights > for the exclusive attention of the intended addressees named above. Any > access of third parties to this e-mail is unauthorised. Any use of this > e-mail by unintended recipients such as total or partial copying, > distribution, disclosure etc. is prohibited and may be unlawful. When > addressed to our clients the content of this e-mail is subject to the > General Terms and Conditions of GL's Group of Companies applicable at the > date of this e-mail. > If you have received this e-mail in error, please notify the sender either > by telephone or by e-mail and delete the material from any computer. > GL's Group of Companies does not warrant and/or guarantee that this > message at the moment of receipt is authentic, correct and its > communication free of errors, interruption etc. > FutureShip GmbH, HRB 106781 AG HH, VAT Reg. No. DE263937825 > Geschäftsführer (CEO): Volker Höppner, Henning Kinkhorst, Stefan Deucker >
_______________________________________________ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
