Nathan and Darby,

For you and anyone else using Lua, see https://bugs.schedmd.com/show_bug.cgi?id=3815 with regards to --mem vs --mem-per-cpu starting in 17.02.

Ryan

On 06/27/2017 02:30 PM, Nathan Vance wrote:
Re: [slurm-dev] Re: Job Submit Lua Plugin
Darby,

The "job_submit.lua: initialized" line in slurm.conf was indeed the issue. When compiling slurm I only got the "yes lua" line without the flags, but that seems to be just a difference in OS's.

Now that I have debugging feedback I should be good to go!

Thanks,
Nathan

On 27 June 2017 at 16:13, Vicker, Darby (JSC-EG311) <darby.vicke...@nasa.gov <mailto:darby.vicke...@nasa.gov>> wrote:

    We recently started using a lua job submit plugin as well.  You
    have to have the lua-devel package installed when you compile
    slurm. It looks like you do (but we use RHEL the package name is
    lua-devel) but confirm that you see something like these in
    config.log:

    configure:24784: result: yes lua

    pkg_cv_lua_LIBS='-llua -lm -ldl '

    lua_CFLAGS='  -DLUA_COMPAT_ALL'

    lua_LIBS='-llua -lm -ldl  '

    Do you have this in your slurm.conf?

    JobSubmitPlugins=lua

    I'm guessing not given you don't see anything in the logs. Before
    I got all the errors worked out, I would see errors like this in
    slurmctld_log:

    error: Couldn't find the specified plugin name for job_submit/lua
    looking at all files

    error: cannot find job_submit plugin for job_submit/lua

    error: cannot create job_submit context for job_submit/lua

    failed to initialize job_submit plugin

    After getting everything working, you should see this:

    job_submit.lua: initialized

    As well as any other slurm.log_info messages you put in your lua
    script.

    *From: *Nathan Vance <naterva...@gmail.com
    <mailto:naterva...@gmail.com>>
    *Reply-To: *slurm-dev <slurm-dev@schedmd.com
    <mailto:slurm-dev@schedmd.com>>
    *Date: *Tuesday, June 27, 2017 at 12:15 PM
    *To: *slurm-dev <slurm-dev@schedmd.com <mailto:slurm-dev@schedmd.com>>
    *Subject: *[slurm-dev] Job Submit Lua Plugin

    Hello all!

    I've been working on getting off the ground with Lua plugins. The
    goal is to implement Torque's routing queues for SLURM, but so far
    I have been unable to get SLURM to even call my plugin.

    What I have tried:

    1) Copied contrib/lua/job_submit.lua to /etc/slurm/ (the same
    directory as slurm.conf)

    2) Restarted slurmctld and verified that no functionality was broken

    3) Added slurm.log_info("I got here") to several points in the
    script. After restarting slurmctld and submitting a job, grep "I
    got here" -R /var/log found no results.

    4) In case there was a problem with the log file, I added
    os.execute("touch /home/myUser/slurm_job_submitted") to the top of
    the slurm_job_submit method. Restarting slurmctld and submitting a
    job still produced no evidence that my plugin was called.

    5) In case there were permission issues, I made job_submit.lua
    executable. Nothing. Even grep "job_submit" -R /var/log (in case
    there was an error calling the script) comes up dry.

    Relevant information:

    OS: Ubuntu 16.04

    Lua: lua5.2 and liblua5.2-dev (I can use Lua interactively)

    SLURM version: 17.02.5, compiled from source (after installing
    Lua) using ./configure --prefix=/usr --sysconfdir=/etc/slurm

    Any guidance to get me up and running would be greatly appreciated!

    Thanks,

    Nathan



--
Ryan Cox
Operations Director
Fulton Supercomputing Lab
Brigham Young University

Reply via email to