Re: [slurm-users] Debian dist-upgrade?
Hi Steffen, Steffen Grunewald writes: > Salut Stephane, > > On Tue, 2023-01-24 at 15:53:03 +0100, Stephane Vaillant wrote: >> Le 24/01/2023 à 10:09, Steffen Grunewald a écrit : >> > Hello, >> > >> > is there anyone using plain Debian with Slurm (as provided by the OS >> > repository), >> > who might have suggestions for our upgrade from Buster to Bullseye? >> > Of course we'd like to keep the database (user definitions and job >> > history), but >> > We're now running version 18.08.5.2 (Buster's version) while Bullseye >> > comes with >> > 20.11.x, which is beyond the 2-version upgrade range. Is there hope (and >> > how to >> > verify that) that a dist-upgrade would do the right thing? >> >> Hello, >> >> I've done an upgrade from Debian 7 (slurm 2.3.4) to Debian 8 (slurm >> 14.03.9). > > I don't remember when the naming scheme was changed... but apparently it took > you > two intermediate stages: > >> - download and compile an intermediary version (2.4.5) >> - redo the same for another intermediary version (2.6.9) >> - finally install slurm from Debian 8 (14.03.9) > [...] >> Preparing the upgrade procedure on an experimental setup was time consuming >> but rewarding. > > > If this slurmdbd machine was the only thing I'd have to care about I might > consider going the same way, but... > ... basically you're saying that for Deb 7->8 no smooth dist-upgrade was > possible. Given that my upgrade path will be 10->11, I'm still hoping that > this might be easier. > My user base is small, and the history isn't too valuable, so I might as > well start from scratch. Could you create/find a deb-package for a Slurm 19.x version to use as an intermediate? Never having built such a package, I don't now how much trouble that would be. However, Building RPMs I do know is easy, so you could also dump your database, find a (virtual) machine running some appropriate RedHat-like OS, create the RPMs for the three versions of Slurm you need, install the first one, import your database and then do the updates. Finally you can dump the database again and import it on your Debian 11 system. That would still be a bit of a faff and so still may not be worth it. Cheers, Loris -- Dr. Loris Bennett (Herr/Mr) ZEDAT, Freie Universität Berlin
Re: [slurm-users] [EXT]Re: srun with &&, |, and > oh my!
Try first with small things like shell scripts you write which would tell you where the thing is running (e.g. by using hostname). Keep in mind that what would happen will most importantly depend on the shell. For example, if you use "sudo" you know that using wildcards is tricky, because your username you sudo from may not have reading permissions to expand them, so will pass them literally to the command, rather than expanding them as root. Bottom line, good to be afraid. Understand shell syntax, but don't trust and instead verify what happens with innocuous things before opening the firehose :-) On Mon, Jan 23, 2023 at 9:31 PM Chandler wrote: > > Williams, Gareth (IM&T, Black Mountain) wrote on 1/23/23 7:55 PM: > > Be brave and experiment! How far wrong can you go? > Hmm I do love breaking and re-fixing things... > > > srun bash -c "cmd1 infile1 | cmd2 opt2 arg2 | cmd3 opt3 arg3 -- > outfile > > && cmd4 opt4 arg4" > Yes this will work! Thanks! >
Re: [slurm-users] Debian dist-upgrade?
Salut Stephane, On Tue, 2023-01-24 at 15:53:03 +0100, Stephane Vaillant wrote: > Le 24/01/2023 à 10:09, Steffen Grunewald a écrit : > > Hello, > > > > is there anyone using plain Debian with Slurm (as provided by the OS > > repository), > > who might have suggestions for our upgrade from Buster to Bullseye? > > Of course we'd like to keep the database (user definitions and job > > history), but > > We're now running version 18.08.5.2 (Buster's version) while Bullseye comes > > with > > 20.11.x, which is beyond the 2-version upgrade range. Is there hope (and > > how to > > verify that) that a dist-upgrade would do the right thing? > > Hello, > > I've done an upgrade from Debian 7 (slurm 2.3.4) to Debian 8 (slurm > 14.03.9). I don't remember when the naming scheme was changed... but apparently it took you two intermediate stages: > - download and compile an intermediary version (2.4.5) > - redo the same for another intermediary version (2.6.9) > - finally install slurm from Debian 8 (14.03.9) [...] > Preparing the upgrade procedure on an experimental setup was time consuming > but rewarding. If this slurmdbd machine was the only thing I'd have to care about I might consider going the same way, but... ... basically you're saying that for Deb 7->8 no smooth dist-upgrade was possible. Given that my upgrade path will be 10->11, I'm still hoping that this might be easier. My user base is small, and the history isn't too valuable, so I might as well start from scratch. Thanks, Steffen
Re: [slurm-users] Debian dist-upgrade?
Le 24/01/2023 à 10:09, Steffen Grunewald a écrit : Hello, is there anyone using plain Debian with Slurm (as provided by the OS repository), who might have suggestions for our upgrade from Buster to Bullseye? Of course we'd like to keep the database (user definitions and job history), but We're now running version 18.08.5.2 (Buster's version) while Bullseye comes with 20.11.x, which is beyond the 2-version upgrade range. Is there hope (and how to verify that) that a dist-upgrade would do the right thing? Thanks, Steffen Hello, I've done an upgrade from Debian 7 (slurm 2.3.4) to Debian 8 (slurm 14.03.9). I've prepared the upgrade with a small setup in virtualbox and experienced the fact that dist-upgrade failed. The actual upgrade process of the front node was: - stop slurm and backup the data (/var/lib/slurm and the mysql database) - uninstall slurm - do the debian upgrade - download and compile an intermediary version (2.4.5) - start slurmdbd and wait for the mysql database to be updated - start slurmctld and wait for the data in /var/lib/slurm to be updated - redo the same for another intermediary version (2.6.9) - finally install slurm from Debian 8 (14.03.9) - check that all the user data and job history are preserved (sacctmgr, sacct, sreport) Preparing the upgrade procedure on an experimental setup was time consuming but rewarding. Regards, -- Stéphane Vaillant https://www.imcce.fr https://www.obspm.fr
[slurm-users] Debian dist-upgrade?
Hello, is there anyone using plain Debian with Slurm (as provided by the OS repository), who might have suggestions for our upgrade from Buster to Bullseye? Of course we'd like to keep the database (user definitions and job history), but We're now running version 18.08.5.2 (Buster's version) while Bullseye comes with 20.11.x, which is beyond the 2-version upgrade range. Is there hope (and how to verify that) that a dist-upgrade would do the right thing? Thanks, Steffen -- Steffen Grunewald, Cluster Administrator Max Planck Institute for Gravitational Physics (Albert Einstein Institute) Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany ~~~ Fon: +49-331-567 7274 Mail: steffen.grunewald(at)aei.mpg.de ~~~
