Sounds pretty safe, but with the current COVID-19 difficulties, including Spring quarter classes being taught remotely (starts tomorrow, fun times ahead), I'm a bit reluctant to poke a running system. This will get put on the giant list of things waiting for a scheduled downtime once campus re-opens. Thanks, Nate
On Thu, Mar 26, 2020 at 8:26 AM Steven Dick <kg4...@gmail.com> wrote: > When I changed this on a running system, no jobs were killed, but > slurm lost track of jobs on nodes and was unable to kill them or tell > when they were finished until slurmd on each node was restarted. I > let running jobs complete and monitored them manually, and restarted > slurmd on each node as they finished. > > In desperation, you can do it, but it might be better to wait until no > jobs (or few jobs) are running. > > On Thu, Mar 26, 2020 at 10:40 AM Pär Lindfors <par.lindf...@uppmax.uu.se> > wrote: > > > > Hi Nate, > > > > On Fri, 2020-02-21 at 11:38 -0800, Nathan R Crawford wrote: > > > If it just requires restarting slurmctld and the slurmd processes > > > on the nodes, I will be happy! Can you confirm that no running or > > > pending jobs were lost in the transition? > > > > Did you change your SelectType to cons_tres? How did it go? > > > > We need to do the same change on one of our clusters. I have done a few > > tests on a tiny test cluster which so far indicates that changing works > > even with jobs running, but a configuration change with even a small > > risk of purging the job list makes me a little nervous. > > > > Regards, > > Pär Lindfors, > > UPPMAX > > > > > > > > > > > > > > > > > > När du har kontakt med oss på Uppsala universitet med e-post så innebär > det att vi behandlar dina personuppgifter. För att läsa mer om hur vi gör > det kan du läsa här: http://www.uu.se/om-uu/dataskydd-personuppgifter/ > > > > E-mailing Uppsala University means that we will process your personal > data. For more information on how this is performed, please read here: > http://www.uu.se/en/about-uu/data-protection-policy > > -- Dr. Nathan Crawford nathan.crawf...@uci.edu Director of Scientific Computing School of Physical Sciences 164 Rowland Hall Office: 2101 Natural Sciences II University of California, Irvine Phone: 949-824-4508 Irvine, CA 92697-2025, USA