Re: [slurm-users] gres with docker problem

2019-01-07 Thread Chris Samuel
On 7/1/19 6:11 am, Marcus Wagner wrote: But that means, the docker container runs outside the cgroup of the slurm job. Thus there exists no restriction to the container, so it can use all resources! [...] If this is the case, in my opinion docker cannot be used on shared systems but only

Re: [slurm-users] gres with docker problem

2019-01-07 Thread Marcus Wagner
- *From:* "Chris Samuel" *To:* ; *Cc:* *Sent:* 2019-01-07 (월) 11:59:09 *Subject:* Re: [slurm-users] gres with docker problem On 4/1/19 5:48 am, Marcin Stolarek wrote: > I think that the main reason is the lack of access to some /dev "files" > in your docker contai

Re: [slurm-users] gres with docker problem

2019-01-06 Thread Chris Samuel
On 4/1/19 5:48 am, Marcin Stolarek wrote: I think that the main reason is the lack of access to some /dev "files" in your docker container. For singularity nvidia plugin is required, maybe there is something similar for docker... That's unlikely, the problem isn't that nvidia-smi isn't

Re: [slurm-users] gres with docker problem

2019-01-04 Thread Marcin Stolarek
Hi Chris. > > > > Thank you so much for your response. > > > > I'll try it! > > > > Happy New Year. > > > > -Original Message- > *From:* "Chris Samuel" > *To:* ; > *Cc:* > *Sent:* 2019-01-02 (수) 13:42:13 > *Subject:* Re: [slur

Re: [slurm-users] gres with docker problem

2019-01-01 Thread 허웅
Hi Chris. Thank you so much for your response. I'll try it! Happy New Year. -Original Message- From: "Chris Samuel" To: ; Cc: Sent: 2019-01-02 (수) 13:42:13 Subject: Re: [slurm-users] gres with docker problem On 1/1/19 8:21 pm, 허웅 wrote: > here is my cgroup.conf T

Re: [slurm-users] gres with docker problem

2019-01-01 Thread Chris Samuel
On 1/1/19 8:21 pm, 허웅 wrote: here is my cgroup.conf Thanks - so my guess is that you have Docker installed so it can run as root and it's overriding the cgroups that Slurm sets up. This is a reason why Docker tends to get frowned upon at HPC sites and alternatives like Shifter,

Re: [slurm-users] gres with docker problem

2019-01-01 Thread 허웅
here is my cgroup.conf CgroupAutomount=yes CgroupReleaseAgentDir="/etc/slurm/cgroup" ConstrainCores=yes ConstrainDevices=yes ConstrainRAMSpace=yes -Original Message- From: "Chris Samuel" To: ; Cc: Sent: 2019-01-02 (수) 13:17:52 Subject: Re: [slurm-users] gres

Re: [slurm-users] gres with docker problem

2019-01-01 Thread Chris Samuel
On 1/1/19 5:25 pm, 허웅 wrote: what's the problem? Are you using cgroups to constrain access to GPUs? -- Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC

[slurm-users] gres with docker problem

2019-01-01 Thread 허웅
Hi I'm using slurm with GRES(4 GPU). I wanna allocate jobs uniformly through GRES(especially GPU). But, It does not work when I use Docker. For example, If i run this command for 4 times with different tty, I could get what i want to get. As you can see, All Bus-Ids are different. #1