Re: [slurm-users] Changing job order
Thanks Ole. Regards Navin On Thu, Jun 18, 2020 at 11:56 AM Ole Holm Nielsen < ole.h.niel...@fysik.dtu.dk> wrote: > The scontrol command to set the nice level is on the list here: > https://wiki.fysik.dtu.dk/niflheim/SLURM#useful-commands > > /Ole > > On 6/18/20 8:05 AM, navin srivastava wrote: > > Thanks ** > > What is the command to modify the Nice value of an already submitted job. > > > > Regards > > Navin > > > > On Thu, Jun 18, 2020 at 4:00 AM Rodrigo Santibáñez > > mailto:rsantibanez.uch...@gmail.com>> > wrote: > > > > HI Navin, > > > > You could set the nice value of both jobs to change the priority and > > modify the order of execution. > > > > El mié., 17 jun. 2020 a las 12:31, navin srivastava > > (mailto:navin.alt...@gmail.com>>) escribió: > > > > Hi Team, > > > > Is their a way to change the job order in slurm.similar to sorder > > in PBS. > > > > I want to swap my job from the other top job. > >
Re: [slurm-users] Nodes do not return to service after scontrol reboot
On 17/6/20 11:32 pm, David Baker wrote: Thank you for your comments. The scontrol reboot command is now working as expected. Fantastic! For those who don't know, using scontrol reboot in this way also allows Slurm to take these rebooting nodes into account for scheduling; so if you have a large job needing a lot of nodes waiting to begin with high priority and you need to reboot some nodes then Slurm won't give up on them and put smaller jobs on the system on all the other nodes, delaying the larger job for no good reason. All the best, Chris -- Chris Samuel : http://www.csamuel.org/ : Berkeley, CA, USA
Re: [slurm-users] howto list/get all scripts run by a job?
Hi Adrain, Adrian Sevcenco writes: > Hi! I'm trying to retrieve the actual executable of jobs but i did not find > how > to do it .. i would like to found this for both case when the job is started > with sbatch or with srun. For running jobs: scontrol show job For completed jobs the information about the executable is not kept by the standard accounting mechanism. However, it is possible to extract more information yourself from either the prolog or epilog and save this somewhere. Cheers, Loris -- Dr. Loris Bennett (Mr.) ZEDAT, Freie Universität Berlin Email loris.benn...@fu-berlin.de
Re: [slurm-users] Nodes do not return to service after scontrol reboot
Hello Chris, Thank you for your comments. The scontrol reboot command is now working as expected. Best regards, David From: slurm-users on behalf of Christopher Samuel Sent: 16 June 2020 18:16 To: slurm-users@lists.schedmd.com Subject: Re: [slurm-users] Nodes do not return to service after scontrol reboot On 6/16/20 8:16 am, David Baker wrote: > We are running Slurm v19.05.5 and I am experimenting with the *scontrol > reboot * command. I find that compute nodes reboot, but they are not > returned to service. Rather they remain down following the reboot.. How are you using "scontrol reboot" ? We do: scontrol reboot ASAP nextstate=resume reason=$REASON $NODE Which works for us (and we have health checks in our epilog that can trigger this for known issues like running low on unfragmented huge pages). All the best, Chris -- Chris Samuel : https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.csamuel.org%2Fdata=01%7C01%7Cd.j.baker%40soton.ac.uk%7C6fa4d9db3b0e47f6a03308d812197d60%7C4a5378f929f44d3ebe89669d03ada9d8%7C0sdata=V9%2Fytt3ActVODtPjD%2FXAB2w5TvVhSJDYJ9%2B0xUmJRUU%3Dreserved=0 : Berkeley, CA, USA
Re: [slurm-users] Changing job order
The scontrol command to set the nice level is on the list here: https://wiki.fysik.dtu.dk/niflheim/SLURM#useful-commands /Ole On 6/18/20 8:05 AM, navin srivastava wrote: Thanks ** What is the command to modify the Nice value of an already submitted job. Regards Navin On Thu, Jun 18, 2020 at 4:00 AM Rodrigo Santibáñez mailto:rsantibanez.uch...@gmail.com>> wrote: HI Navin, You could set the nice value of both jobs to change the priority and modify the order of execution. El mié., 17 jun. 2020 a las 12:31, navin srivastava (mailto:navin.alt...@gmail.com>>) escribió: Hi Team, Is their a way to change the job order in slurm.similar to sorder in PBS. I want to swap my job from the other top job.
Re: [slurm-users] Changing job order
Thanks What is the command to modify the Nice value of an already submitted job. Regards Navin On Thu, Jun 18, 2020 at 4:00 AM Rodrigo Santibáñez < rsantibanez.uch...@gmail.com> wrote: > HI Navin, > > You could set the nice value of both jobs to change the priority and > modify the order of execution. > > El mié., 17 jun. 2020 a las 12:31, navin srivastava (< > navin.alt...@gmail.com>) escribió: > >> Hi Team, >> >> Is their a way to change the job order in slurm.similar to sorder in PBS. >> >> I want to swap my job from the other top job. >> >> Regards >> Navin >> >>
