Re: Compiling Rakudo in parallel

[Steve Mynott]

On 26 May 2017 at 07:04, Gabor Szabo  wrote:

> Would someone update the README that comes with Rakudo Star with this
> information, please?

I don't see any point since I think he is basically saying it's not
worth trying to compile in parallel -- the bits which compile slowly
can't be compiled in parallel and the only bit which can be compiled
in parallel is fast anyway.  So little win.  Most people will probably
only compile rarely anyway and only one backend at once.

Again I don't think it's worth confusing people about this in Star
especially since it's aimed at the average user.

Parallelism does help with the test runs however.

S

Re: Compiling Rakudo in parallel

[Gabor Szabo]

That just confuses me :(

Do I need to type

make -j 4

and hope for some concurrency?

or

export MAKEFLAGS="-j2 --load-average=2"
make

as I was pointed to off-list?

Would someone update the README that comes with Rakudo Star with this
information, please?

regards
   Gabor


On Fri, May 26, 2017 at 1:19 AM, Timo Paulssen  wrote:
> Sadly, the majority of rakudo's and nqp's compilation is serialized (due
> to the dependencies between the individual pieces).
>
> If you build more than one backend at the same time, i.e. moar + jvm,
> you can build both in parallel.
>
> On the other hand, the biggest chunk of time is spent compiling the core
> setting, which commonly takes a minute on moarvm.
>
> nqp behaves very similarly.
>
> moarvm on the other hand can compile all .c files at the same time and
> use up as many cores as there are .c files, but it compiles so fast that
> it's hardly worth anything.
>
> hope that helps
>   - Timo

Re: Compiling Rakudo in parallel

[Timo Paulssen]

Sadly, the majority of rakudo's and nqp's compilation is serialized (due
to the dependencies between the individual pieces).

If you build more than one backend at the same time, i.e. moar + jvm,
you can build both in parallel.

On the other hand, the biggest chunk of time is spent compiling the core
setting, which commonly takes a minute on moarvm.

nqp behaves very similarly.

moarvm on the other hand can compile all .c files at the same time and
use up as many cores as there are .c files, but it compiles so fast that
it's hardly worth anything.

hope that helps
  - Timo

Compiling Rakudo in parallel

[Gabor Szabo]

Hi,

is it possible to run any of the compilation and installation phases
of Rakudo in parallel?  (eg. so the "make" will use all the cores in
my Linux machine)

Gabor