Hi Loris, Since EB already consumes all the local cores during the build (typically), you probably want to consider using the `--job` option, see https://easybuild.readthedocs.io/en/latest/Submitting_jobs.html This will handle all the interdependencies for you. One caveat is that typically back-end nodes are not connected to the internet so probably need to download the sources in advance (with `eb --fetch ...`) and even then you may still have a few corner cases that failand you will have to finish on the frontend.
Alan On Fri, 18 Jan 2019 at 09:42, Loris Bennett <[email protected]<mailto:[email protected]>> wrote: Hi, As I need to build a lot of software in as short a time as possible I was considering how feasible it would be to start multiple builds each in its own shell. It seems like doing this willy-nilly would probably be a bad idea, but I could do dry runs and check for overlapping modules. Am I overlooking the fact that either (a) there is some other problem even if the modules don't overlap or (b) EasyBuild is even more wonderful than I already think and can deal with this situation out of the box? Cheers, Loris -- Dr. Loris Bennett (Mr.) ZEDAT, Freie Universität Berlin Email [email protected]<mailto:[email protected]> -- Dr. Alan O'Cais E-CAM Software Manager Juelich Supercomputing Centre Forschungszentrum Juelich GmbH 52425 Juelich, Germany Phone: +49 2461 61 5213 Fax: +49 2461 61 6656 E-mail: [email protected]<mailto:[email protected]> WWW: http://www.fz-juelich.de/ias/jsc/EN ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------ Forschungszentrum Juelich GmbH 52425 Juelich Sitz der Gesellschaft: Juelich Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender), Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt, Prof. Dr. Sebastian M. Schmidt ------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------------------------------
