Re: [slurm-users] Determining Cluster Usage Rate

2021-05-17 Thread Diego Zuccato
Il 17/05/21 09:25, Ole Holm Nielsen ha scritto: I hope that someone on the list can help you build Debian packages. The problem is not just rebuilding Slurm: if I rebuild Slurm, I have to rebuild OpenMPI, OpenIB and a alot of other stuff that I don't know with the needed detail. When you fi

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-17 Thread Ole Holm Nielsen
On 5/17/21 8:59 AM, Diego Zuccato wrote: Il 15/05/21 00:43, Christopher Samuel ha scritto: It just doesn't recognize 'ALL'. It works if I specify the resources. That's odd, what does this say? sreport --version slurm-wlm 18.08.5-2 That's the package from Debian stable (we don't have the manpo

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-17 Thread Diego Zuccato
Il 15/05/21 00:43, Christopher Samuel ha scritto: It just doesn't recognize 'ALL'. It works if I specify the resources. That's odd, what does this say? sreport --version slurm-wlm 18.08.5-2 That's the package from Debian stable (we don't have the manpower to handle manually-compiled packages)

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-16 Thread Juergen Salk
* Juergen Salk [210515 23:54]: > * Christopher Samuel [210514 15:47]: > > > > Usage reported in Percentage of Total > > > > > > > > >   Cluster  TRES Name    Allocated Down PLND Dow    Idle > > > Reser

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-15 Thread Juergen Salk
* Christopher Samuel [210514 15:47]: > > Usage reported in Percentage of Total > > > > > >   Cluster  TRES Name    Allocated Down PLND Dow    Idle > > Reserved Reported > > - --

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-14 Thread Christopher Samuel
On 5/14/21 1:45 am, Diego Zuccato wrote: Usage reported in Percentage of Total   Cluster  TRES Name    Allocated Down PLND Dow    Idle Reserved Reported - --

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-14 Thread Christopher Samuel
On 5/14/21 1:45 am, Diego Zuccato wrote: It just doesn't recognize 'ALL'. It works if I specify the resources. That's odd, what does this say? sreport --version All the best, Chris -- Chris Samuel : http://www.csamuel.org/ : Berkeley, CA, USA

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-14 Thread Paul Edmon
XDMod can give these sorts of stats.  I also have some diamond collectors we use in concert with grafana to pull data and plot it which is useful for seeing large scale usage trends: https://github.com/fasrc/slurm-diamond-collector -Paul Edmon- On 5/13/2021 6:08 PM, Sid Young wrote: Hi All,

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-14 Thread Diego Zuccato
Il 14/05/21 10:24, Ole Holm Nielsen ha scritto: Referring to https://slurm.schedmd.com/tres.html, which TRES are defined on your cluster? It just doesn't recognize 'ALL'. It works if I specify the resources. root@str957-cluster:/var/log# sacctmgr show tres TypeName ID -

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-14 Thread Ole Holm Nielsen
On 14-05-2021 08:52, Diego Zuccato wrote: Il 14/05/2021 08:19, Christopher Samuel ha scritto: sreport -t percent -T ALL cluster utilization "sreport: fatal: No valid TRES given" :( This works correctly on our cluster: $ sreport -t percent -T ALL cluster utilization

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-13 Thread Diego Zuccato
Il 14/05/2021 08:19, Christopher Samuel ha scritto: sreport -t percent -T ALL cluster utilization "sreport: fatal: No valid TRES given" :( -- Diego Zuccato DIFA - Dip. di Fisica e Astronomia Servizi Informatici Alma Mater Studiorum - Università di Bologna V.le Berti-Pichat 6/2 - 40127 Bologna

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-13 Thread Christopher Samuel
On 5/13/21 3:08 pm, Sid Young wrote: Hi All, Hiya, Is there a way to define an effective "usage rate" of a HPC Cluster using the data captured in the slurm database. Primarily I want to see if it can be helpful in presenting to the business a case for buying more hardware for the HPC  :)

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-13 Thread Sid Young
Yes, on reflection I should have said utilization rather than usage! I've been researching what the most likely combination of metrics would give me an overall utilization of the HPC. Sadly its not as clear cut as I would have hoped. Does anyone have any ideas? Sid Young On Fri, May 14, 2021

Re: [slurm-users] Determining Cluster Usage Rate

2021-05-13 Thread Doug Meyer
Probably need to define the problem a bit better. spreport has very good functionality, see the boom of the man page for examples. You can group orgs in accounting groups to map like use and use wckeys to provide accounting for specific users billing groups. Configure tres billing to get a charg

[slurm-users] Determining Cluster Usage Rate

2021-05-13 Thread Sid Young
Hi All, Is there a way to define an effective "usage rate" of a HPC Cluster using the data captured in the slurm database. Primarily I want to see if it can be helpful in presenting to the business a case for buying more hardware for the HPC :) Sid Young