Moe,

In what way is it experimental? Is it possibly unstable or just not feature-complete?

We're writing a script to independently gather statistics for our own database and would like to use the cpuacct cgroup, thus the interest in the jobacct_gather/cgroup plugin.

Ryan

On 08/09/2013 10:07 AM, Moe Jette wrote:

I misspoke. The JobAcctGatherType=jobacct_gather/cgroup plugin is experimental and not ready for use. Your configuration should work.

Quoting Moe Jette <je...@schedmd.com>:

Your explanation seems likely. You probably want to change your configuration to:
JobAcctGatherType=jobacct_gather/cgroup

Quoting Andy Wettstein <wettst...@uchicago.edu>:


I understand this problem more fully now.

Certains jobs that our users run fork processes in a way that the parent
PID gets set to 1. The _get_offspring_data function in
jobacct_gather/linux ignores these when adding up memory usage.

It seems like if proctrack/cgroup is enabled, the jobacct_gather/linux
plugin should rely on the cgroup.procs file to identify the pids instead
of trying to figure things out based on parent PID. Is something like
that reasonable?

Andy

On Tue, Jul 30, 2013 at 10:59:56AM -0700, Andy Wettstein wrote:

Hi,

I have the following set:

ProctrackType           = proctrack/cgroup
TaskPlugin              = task/cgroup
JobAcctGatherType       = jobacct_gather/linux

This is on slurm 2.5.7.

When I use sstat on all running jobs, there are a large number of jobs
that say they have no steps running (for example: sstat: error: couldn't
get steps for job 4783548).

This seems to be the case for all steps that use the step_batch cgroup.
If the step gets created in something like step_0, everything seems to
be reported ok. In both instances, the PIDs are actually listed in the
right cgroup.procs file.

I noticed this because there were several jobs that should have been
killed due to memory limits, but were not. The jobacct_gather plugin
doesn't know about the processes in the step_batch cgroup so it doesn't
count the memory usage.


Andy




--
andy wettstein
hpc system administrator
research computing center
university of chicago
773.702.1104

--
andy wettstein
hpc system administrator
research computing center
university of chicago
773.702.1104







--
Ryan Cox
Operations Director
Fulton Supercomputing Lab
Brigham Young University

Reply via email to