Re: Make and Clusters

2017-10-13 Thread Tim Murphy
Hi, Firstly I must warn you that I am an interested party since I do consulting related to this product but I did use it purely as a customer for several years. Electric Accelerator is pretty much the pièce de résistance for running GNU Make and Ninja makefiles on clusters and there is a free

Re: Make and Clusters

2017-10-13 Thread David Delahaye
Hello, Thanks a lot to everyone for the numerous clues. Best regards, David. Le 10/10/2017 à 18:55, Shaun Jackman a écrit : Hi, David. Two options: 1. Use Biomake, which is mostly compatible with GNU Make, and supports submitting jobs to Slurm. https://github.com/evoldoers/biomake It can

Re: Make and Clusters

2017-10-10 Thread Martin d'Anjou
Hi David, I explored this problem a while ago. I captured my musings in a blog: https://ninjaverification.wordpress.com/2008/10/21/overriding-gnu-make-shell-variable-for-massive-parallel-make/ In the end the idea is to have make call out to a job scheduler as part of the target recipe. This is

Make and Clusters

2017-10-10 Thread Shaun Jackman
Hi, David. Two options: 1. Use Biomake, which is mostly compatible with GNU Make, and supports submitting jobs to Slurm. https://github.com/evoldoers/biomake It can be installed with Linuxbrew on Linux or Homebrew on macOS. brew install homebrew/science/biomake 2. Precede each command that you

RE: Make and Clusters

2017-10-10 Thread Cook, Malcolm
bounces+mec=stowers@gnu.org] > On Behalf Of Paul Smith > Sent: Tuesday, October 10, 2017 9:28 AM > To: help-make@gnu.org > Subject: Re: Make and Clusters > > On Tue, 2017-10-10 at 15:53 +0200, David Delahaye wrote: > > I wonder how the make command is compatible with

Re: Make and Clusters

2017-10-10 Thread Paul Smith
On Tue, 2017-10-10 at 15:53 +0200, David Delahaye wrote: > I wonder how the make command is compatible with clusters. I know the > "-j" option, which allows us to run several jobs simultaneously and > uses the several cores of a given processor. But if we have several > nodes of computation of a

Re: Make and Clusters

2017-10-10 Thread Alberto Luaces
David Delahaye writes: > Hello, > > I wonder how the make command is compatible with clusters. I know the > "-j" option, which allows us to run several jobs simultaneously and > uses the several cores of a given processor. But if we have several > nodes of computation of a cluster, is the command

Make and Clusters

2017-10-10 Thread David Delahaye
Hello, I wonder how the make command is compatible with clusters. I know the "-j" option, which allows us to run several jobs simultaneously and uses the several cores of a given processor. But if we have several nodes of computation of a cluster, is the command "make -j" able to run over