On Monday, 2 September 2019 11:02:57 AM PDT Ole Holm Nielsen wrote: > We have some users requesting that a certain minimum size of the > *Available* (i.e., free) TmpFS disk space should be present on nodes > before a job should be considered by the scheduler for a set of nodes.
At Swinburne I did this by defining a GRES called "tmp" for nodes and then translated any --tmp request into a GRES request in the submit filter. The prolog for the job would then create a directory for the job in the nodes local NVME XFS /tmp filesystem, set a project quota on that directory to the amount requested (so it couldn't be exceeded) and then used the private tmp spank plugin to map that into what the job saw as /tmp, /var/tmp and /dev/shm. The epilog then cleaned up after the job. Worked nicely! All the best, Chris -- Chris Samuel : http://www.csamuel.org/ : Berkeley, CA, USA
