Hi All,

We created a slurm job script archiver which you may find handy. We initially 
attempted to do this through slurm with a slurmctld prolog but it really bogged 
the scheduler down. This new solution is a custom c++ program that uses inotify 
to watch for job scripts and environment files to show up out in 
/var/spool/slurm/hash.* on the head node. When they do, the program copies the 
jobscript and environment out to a local archive directory. The program is 
multithreaded and has a dedicated thread watching each hash directory. The 
program is super-fast and lightweight and has no side effects on the scheduler. 
The program by default will apply ACLs to the archived job scripts so that only 
the owner of the jobscript can read the files. Feel free to try it out and let 
us know how it works for you!

https://github.com/nauhpc/job_archive

Best,
Chris

—
Christopher Coffey
High-Performance Computing
Northern Arizona University
928-523-1167
 

Reply via email to