Re: How to better parallelize GHC build.

2015-04-01 Thread Karel Gardas
Hi Thomas, thanks for your suggestion. Also thanks for the PR number. I've tried with quick way (build.mk) and benchmarking ghc while compiling ghc-cabal manually and here are the results: -j1: 45s -j2: 28s -j3: 26s -j4: 24s -j5: 24s -j6: 25s -j6 -A32m: 23s -j6 -A64m: 21s -j6 -A128m: 23s re

Re: How to better parallelize GHC build.

2015-04-01 Thread Thomas Miedema
Hi Karel, could you try adding `-j8` to `SRC_HC_OPTS` for the build flavor you're using in `mk/build.mk`, and running `gmake -j8` instead of `gmake -j64`. A graph like the one you attached will likely look even worse, but the walltime of your build should hopefully be improved. The build system s

RE: How to better parallelize GHC build.

2015-03-09 Thread Simon Peyton Jones
hing over because it is manifestly better. Andrey can give a status report. Simon | -Original Message- | From: ghc-devs [mailto:ghc-devs-boun...@haskell.org] On Behalf Of Karel | Gardas | Sent: 07 March 2015 10:50 | To: ghc-devs | Subject: How to better parallelize GHC build. | | | Folk

Re: How to better parallelize GHC build.

2015-03-09 Thread Karel Gardas
Hi Neil, On 03/ 8/15 02:58 PM, Neil Mitchell wrote: Hi Karel, I am. Is this agreed way among the GHC developers? I was not sure so I mentioned shake just lightly... It's certainly agreed to give it a go, and implementation work is ongoing. If it works better than the existing system then I s

Re: How to better parallelize GHC build

2015-03-09 Thread Karel Gardas
Hi Andrey, great to hear that you will find some time for Shaking ghc in the near future and even that you aim to commit first version around April. This is just in a month and half time. Great! I'll see what it will brings us, certainly will test it's paralellization capability and will repo

Re: How to better parallelize GHC build.

2015-03-08 Thread Neil Mitchell
Hi Karel, > I am. Is this agreed way among the GHC developers? I was not sure so I > mentioned shake just lightly... It's certainly agreed to give it a go, and implementation work is ongoing. If it works better than the existing system then I suspect we'll switch. I certainly hope to get full par

Re: How to better parallelize GHC build.

2015-03-07 Thread Karel Gardas
On 03/ 7/15 12:09 PM, Herbert Valerio Riedel wrote: On 2015-03-07 at 11:49:53 +0100, Karel Gardas wrote: [...] Is there anything else which may be done to fix that issue? Is someone already working on some of those? (I mean those reasonable from the list)? are you aware of https://ghc.ha

Re: How to better parallelize GHC build.

2015-03-07 Thread Herbert Valerio Riedel
On 2015-03-07 at 11:49:53 +0100, Karel Gardas wrote: [...] > Is there anything else which may be done to fix that issue? Is someone > already working on some of those? (I mean those reasonable from the > list)? are you aware of https://ghc.haskell.org/trac/ghc/wiki/Building/Shake and http

How to better parallelize GHC build.

2015-03-07 Thread Karel Gardas
Folks, first of all, I remember someone already mentioned issue with decreased parallelism of the GHC build recently somewhere but I cann't find it now. Sorry, for that since otherwise I would use this thread if it was on this mailing list. Anyway, while working on SPARC NCG I'm using T2000