On 10/04/17 21:08, Oliver Grant wrote: > We did not have a gres.conf file. I've created one: > cat /cm/shared/apps/slurm/var/etc/gres.conf > # Configure support for our four GPU > NodeName=node[001-018] Name=gpu File=/dev/nvidia[0-3] > > I've read about "global" and "per-node" gres.conf, but I don't know how > to implement them or if I need to?
Yes you do. Here's an (anonymised) example from a cluster that I help with that has both GPUs and MIC's on various nodes. # We will have GPU & KNC nodes so add the GPU & MIC GresType to manage them GresTypes=gpu,mic # Node definitions for nodes with GPUs NodeName=thing-gpu[001-005] Weight=3000 NodeAddr=thing-gpu[001-005] RealMemory=254000 CoresPerSocket=6 Sockets=2 Gres=gpu:k80:4 # Node definitions for nodes with Xeon Phi NodeName=thing-knc[01-03] Weight=2000 NodeAddr=thing-knc[01-03] RealMemory=126000 CoresPerSocket=10 Sockets=2 ThreadsPerCore=2 Gres=mic:5110p:2 You'll also need to restart slurmctld & all slurmd's to pick up this new config, I don't think "scontrol reconfigure" will deal with this. Best of luck, Chris -- Christopher Samuel Senior Systems Administrator Melbourne Bioinformatics - The University of Melbourne Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545
