Hello, thank you for your help.
I had asked on this list because I am a beginner with slurm so I
didn't know how to do this. Also reading at the CC documentation I
believed that installing a venv on each node was the right way to go.
Gareth was right: I needed to sleep forever at the end th
Actually, you are not allowed to install things in your home on computecanada,
this is why you need to install everything in a virtualenv with pip
install. Also, you have to install each virtualenv in $SLURM_TMDIR which is the
local drive of the node, because everything else is slow, so I thin
-users On Behalf Of Yann
Bouteiller
Sent: Monday, 18 November 2019 5:39 PM
To: Slurm User Community List
Subject: Re: [slurm-users] How to use a pyhon virtualenv with srun?
Hi Gareth, thank you for your answer,
I have thought about it too, but I think the --block option that I use in ray
s
On 17/11/19 10:39 pm, Yann Bouteiller wrote:
I have thought about it too, but I think the --block option that I use
in ray start is supposed to sleep indefinitely for this not to happen.
However maybe this is not taken into account due to the fact that I use
'&' at this end of the ray start co
Yann Bouteiller writes:
> Hello Brian, thank you for your answer.
>
> Actually, you are not allowed to install things in your home on
> computecanada,
> this is why you need to install everything in a virtualenv with pip
> install. Also, you have to install each virtualenv in $SLURM_TMDIR whi
cript computecanada will probably clean up for you
automatically - but it is polite to clean up after yourself.
Gareth
-Original Message-
From: slurm-users On Behalf
Of Yann Bouteiller
Sent: Monday, 18 November 2019 1:49 PM
To: Slurm User Community List
Subject: Re: [slurm-users] H
49 PM
To: Slurm User Community List
Subject: Re: [slurm-users] How to use a pyhon virtualenv with srun?
Hello Brian, thank you for your answer.
Actually, you are not allowed to install things in your home on computecanada,
this is why you need to install everything in a virtualenv with pip in
Hello Brian, thank you for your answer.
Actually, you are not allowed to install things in your home on
computecanada, this is why you need to install everything in a
virtualenv with pip install. Also, you have to install each virtualenv
in $SLURM_TMDIR which is the local drive of the node,
I suspect when you say "head node" you mean the primary node from the
nodes your were allocated.
Normally, when you use pip as a user, it installs in your home
directory. Are you certain all your nodes share the same homes?
If they are merely synched, that would not be the same. Not actually
s
Hello,
I am trying to do this on computecanada, which is managed by slurm:
https://ray.readthedocs.io/en/latest/deploying-on-slurm.html
However, on computecanada, you cannot install things on nodes before
the job has started, and you can only install things in a python
virtualenv once t
10 matches
Mail list logo
