Another useful format string – and again, this is if you mess up and don’t do a
reservation early enough (or your environment has no concept of a time limit) –
is this one:
squeue -o %u,%i,%L
Will show you username, job id, and remaining time – which is sometimes easier
to deal with than end d
On 9/11/21 5:42 am, Loris Bennett wrote:
We just set up a reservation at a point at a time which is further in the
future than our maximum run-time. There is then no need to drain
anything. Short running jobs can still run right up to the reservation.
This is the same technique we use too, w
Hi Ahmed,
Ahmad Khalifa writes:
> If I plan maintenance on a certain day, how long before that day
> should I set the queue to drain mode?! Is there a way to estimate the
> completion date / time of current running jobs?!
We just set up a reservation at a point at a time which is further in the
On 11/9/21 13:55, Marcus Wagner wrote:
I have written a script, which loops through all runnning jobs to tell me,
when a job ends on a specific node. This can be also done for all nodes.
The output would be for the longest job e.g.:
ncm0430 -> 2021-12-04T15:48:35
Nonetheless, we
I have written a script, which loops through all runnning jobs to tell me, when
a job ends on a specific node. This can be also done for all nodes. The output
would be for the longest job e.g.:
ncm0430 -> 2021-12-04T15:48:35
Nonetheless, we also plan maintenances with reservations
Hi.
I usually create a maintenance reservation with IGNORE_JOBS flag, so I
can avoid new jobs interfering with it. Then I'll contact job owners to
warn 'em I'll kill their jobs if needed.
Actually that's useful only for nodes that allow unlimited time jobs:
for the others it's sufficient to pl
Hi Ahmad,
you could use squeue -h -t r --format="%i %e" | sort -k2 to get a list
of all running jobs sorted by their endtime.
We use normaly a maintenance reservation with starttime of the
mainenance (or with some leading time before) to get the system free of
jobs. That make things easier,
If I plan maintenance on a certain day, how long before that day should I
set the queue to drain mode?! Is there a way to estimate the completion
date / time of current running jobs?!
Regards.
