[slurm-dev] Re: Submitting to multiple partitions with job_submit plugin (Was: Implementing fair-share policy using BLCR)

2014-09-29 Thread Ryan Cox



On 09/23/2014 11:27 AM, Trey Dockendorf wrote:

Has anyone used the Lua job_submit plugin and also allows multiple partitions?  I'm not 
even user what the partition value would be in the Lua code when a job is submitted with 
--partition=general,background, for example.


We do.  We use the all_partitions plugin and our own Lua plugin for job 
submission.  In the Lua script, we remove partitions from the array that 
they shouldn't have access to for whatever reason. Reasons include:  the 
job didn't request enough memory to need a bigmem node, the job didn't 
request a GPU and this is a GPU partition, etc.  The partition string 
has commas so you can explode() it into an array.



Ryan


[slurm-dev] Re: Submitting to multiple partitions with job_submit plugin (Was: Implementing fair-share policy using BLCR)

2014-09-29 Thread Trey Dockendorf
Ryan,

Thanks for the information.  Is your Lua script something you would be
willing to share with me, either via the mailing list of privately?  I'm
able to stumble my way around Lua and am curious how others are defining
available resources, conditions, allowed partitions, etc, in Lua.  I've so
far resorted to hardcoded Key-value pair variables in the Lua script as
attempts to use slurm CLI commands via popen would result in the script
causing job submissions to timeout.

Thanks,
- Trey

=

Trey Dockendorf
Systems Analyst I
Texas AM University
Academy for Advanced Telecommunications and Learning Technologies
Phone: (979)458-2396
Email: treyd...@tamu.edu
Jabber: treyd...@tamu.edu

On Mon, Sep 29, 2014 at 10:50 AM, Ryan Cox ryan_...@byu.edu wrote:



 On 09/23/2014 11:27 AM, Trey Dockendorf wrote:

 Has anyone used the Lua job_submit plugin and also allows multiple
 partitions?  I'm not even user what the partition value would be in the Lua
 code when a job is submitted with --partition=general,background, for
 example.


 We do.  We use the all_partitions plugin and our own Lua plugin for job
 submission.  In the Lua script, we remove partitions from the array that
 they shouldn't have access to for whatever reason. Reasons include:  the
 job didn't request enough memory to need a bigmem node, the job didn't
 request a GPU and this is a GPU partition, etc.  The partition string has
 commas so you can explode() it into an array.


 Ryan