Hi Alan, So EasyBuild is indeed even more wonderful than I already thought!
Thanks for the pointer, Loris Alan O'Cais <[email protected]> writes: > Hi Loris, > > Since EB already consumes all the local cores during the build (typically), > you probably want to consider using the `--job` option, see > https://easybuild.readthedocs.io/en/latest/Submitting_jobs.html > This will handle all the interdependencies for you. One caveat is that > typically back-end nodes are not connected to the internet so probably need > to download the sources in advance (with `eb --fetch ...`) and even > then you may still have a few corner cases that failand you will have to > finish on the frontend. > > Alan > > On Fri, 18 Jan 2019 at 09:42, Loris Bennett <[email protected]> > wrote: > > Hi, > > As I need to build a lot of software in as short a time as possible I > was considering how feasible it would be to start multiple builds each > in its own shell. It seems like doing this willy-nilly would probably > be a bad idea, but I could do dry runs and check for overlapping > modules. > > Am I overlooking the fact that either (a) there is some other problem > even if the modules don't overlap or (b) EasyBuild is even more > wonderful than I already think and can deal with this situation out of > the box? > > Cheers, > > Loris > > -- > Dr. Loris Bennett (Mr.) > ZEDAT, Freie Universität Berlin Email [email protected] -- Dr. Loris Bennett (Mr.) ZEDAT, Freie Universität Berlin Email [email protected]
