+1 for xCAT as well. We’ve enjoyed it for the most part, although we have found a few bugs, but the xCAT team good to work with just like the Slurm team. I will note, like Daniel, we’re looking for some better integration with configuration management software stacks as well as the number of support nodes (i.e., not compute nodes) grows and need for additional services beyond job scheduling, storage, etc. I have used Rocks, Warewulf, and trialed Bright, but we’ve selected xCAT with Warewulf as a highly preferable secondary option.
-Jared From: Daniel Letai [mailto:d...@letai.org.il] Sent: Tuesday, March 15, 2016 8:29 AM To: slurm-dev <slurm-dev@schedmd.com> Subject: [slurm-dev] Re: What cluster provisioning system do you use? Another vote for xCAT here - been using it for ~3 years now, on installations ranging from 8 to 1+k nodes. Once you get to know xCAT it's quite easy to manage, although familiarity with perl will help in any troubleshooting or customization (not required, you can do without, but it helps). That said, I've been meaning for a long time to look at foreman (http://theforeman.org/) especially with it's good integration with puppet/chef/salt etc. which increasingly become more relevant to large cluster management. xCAT's integration with configuration management tools is somewhat lacking, from my experience. On 03/15/2016 02:40 PM, Bjørn-Helge Mevik wrote: I apologize for the slightly off-topic subject, but I could not think of a better forum to ask. If you know of a more proper place to ask this, I'd be happy to know about it. We are currently in the design fase for a new cluster that is going to be set up next year. We have so far used Rocks (on top of CentOS) for cluster provisioning. However, Rocks don't support CentOS >= 7, and it doesn't look like it will in the near future. Also for other reasons, we are looking for alternatives to Rocks. So, what are you using for cluster provisioning? - Rocks? - A different provisioning tool? - A locally developed solution? -- Regards, Bjørn-Helge Mevik, dr. scient, Department for Research Computing, University of Oslo
