Re: [slurm-users] [EXT] Alert-Verify-Sender: Elasticsearch Plugin Not Working After Update

2021-08-24 Thread Dana, Jason T.
slurm-users on behalf of "Dana, Jason T." Reply-To: Slurm User Community List Date: Tuesday, August 24, 2021 at 9:19 AM To: Slurm User Community List Subject: [EXT] Alert-Verify-Sender: [slurm-users] Elasticsearch Plugin Not Working After Update APL external email warning: Verify s

[slurm-users] Elasticsearch Plugin Not Working After Update

2021-08-24 Thread Dana, Jason T.
Hello all, I recently updated our cluster from Slurm 20.02.03 to 20.11.8. The Elasticsearch plugin was working great before the upgrade, but afterwards I’m not seeing any indications of the plugin running or attempting to connect in the logs. Here is the slurm.conf entry for 20.11.8:

Re: [slurm-users] [EXT] Re: Slurm Scheduler Help

2021-06-11 Thread Dana, Jason T.
0,bf_max_job_user=80,bf_continue,default_queue_depth=200 in our setup. bf_window is driven by our 30-day max job time, bf_resolution is at 5% of that time, and the other values are just what we landed on. This did manage to address some backfill issues we had in previous years. From: slurm-users on behalf of Dan

[slurm-users] Slurm Scheduler Help

2021-06-11 Thread Dana, Jason T.
Hello, I currently manage a small cluster separated into 4 partitions. I am experiencing unexpected behavior with the scheduler when the queue has been flooded with a large number of jobs by a single user (around 6) to a single partition. We have each user bound to a global grptres CPU

[slurm-users] Compiling Slurm with nvml support

2020-09-24 Thread Dana, Jason T.
Hello, I hopefully have a quick question. I have compiled Slurm RPMs on a CentOS system with nvidia drivers installed so that I can utilize AutoDetect=nvml configuration in our GPU nodes’ gres.conf. All seems to be going well on the GPU nodes since I have done that. I was unable to install

Re: [slurm-users] Question/Clarification: Batch array multiple tasks on nodes

2020-09-01 Thread Dana, Jason T.
sly. Best of luck, -Spencer On 1 September 2020 at 18:50:30, Dana, Jason T. (jason.d...@jhuapl.edu<mailto:jason.d...@jhuapl.edu>) wrote: Hello, I am new to Slurm and I am working on setting up a cluster. I am testing out running a batch execution using an array and am seeing only one tas

[slurm-users] Question/Clarification: Batch array multiple tasks on nodes

2020-09-01 Thread Dana, Jason T.
Hello, I am new to Slurm and I am working on setting up a cluster. I am testing out running a batch execution using an array and am seeing only one task executed in the array per node. Even if I specify in the sbatch command that only one node should be used, it executes a single task on each