[Python-Dev] cpython and parallel make

2014-09-01 Thread Jonas Wagner
Hi, what’s people’s experience with compiling cpython using multiple jobs (e.g., make -j 8)? In my case, I sometimes experience build errors that happen when using -j, whereas the single-job build always works. I haven’t tracked this down in detail, though… here’s an extract from a sample log: 1

Re: [Python-Dev] cpython and parallel make

2014-09-04 Thread Jonas Wagner
Hi, Thanks for your comments! I've done more tests on a new machine and, for better or worse, was no longer able to reproduce the issue. Parallel compilation now works fine; I'll keep collecting output from make, and would post it here if the problem appears again. One additional issue appeared,

Re: [Python-Dev] cpython and parallel make

2014-09-04 Thread Antoine Pitrou
On Thu, 4 Sep 2014 12:06:25 +0200 Jonas Wagner wrote: > > One additional issue appeared, though: it seems that extension modules are > always built sequentially no matter what the value of MAKEFLAGS is. I've > seen that these are being built by a custom setup.py script. Do you think > it would be

Re: [Python-Dev] cpython and parallel make

2014-09-05 Thread Jonas Wagner
>> > Would people be interested in having a parallel version? >> >> See http://bugs.python.org/issue5309 > > Cool! I'll look into this. The patch there works well for me. I've made one small update, and submitted the new version in the bug tracker. Regarding the other build problem, I might have

Re: [Python-Dev] cpython and parallel make

2014-09-05 Thread Jonas Wagner
> > Would people be interested in having a parallel version? > > See http://bugs.python.org/issue5309 Cool! I'll look into this. Just as I was thinking that the parallel build problems are solved, the issue surfaced again. I've attached a complete, unmodified log to this mail. Some notes: - asap

Re: [Python-Dev] cpython and parallel make

2014-09-05 Thread Jonas Wagner
Hi again, the attached Makefile patch seems to fix the parallel build problems. Is there a chance of getting this into trunk? Should I open an issue or send the patch somewhere else? Cheers, Jonas On Fri, Sep 5, 2014 at 12:15 PM, Jonas Wagner wrote: >>> > Would people be interested in having a

Re: [Python-Dev] cpython and parallel make

2014-09-05 Thread Brett Cannon
Open an issue on bugs.python.org and attach the patch there (it should also ask you so sign the contributor agreement, but if not then please also sign that). On Fri Sep 05 2014 at 12:52:45 PM Jonas Wagner wrote: > Hi again, > > the attached Makefile patch seems to fix the parallel build problem

Re: [Python-Dev] cpython and parallel make

2014-09-08 Thread Jonas Wagner
Hi, Open an issue on bugs.python.org and attach the patch there (it should also > ask you so sign the contributor agreement, but if not then please also sign > that). > Submitted as http://bugs.python.org/issue22359 , and signed the agreement. Cheers, Jonas _

Re: [Python-Dev] cpython and parallel make

2014-09-01 Thread Victor Stinner
Hi, My bashrc sets MAKEFLAGS to -j9 and Python compilation works fine on Fedora 20 with GNU make and GCC. My computer has 8 cores (4 physical with hyper threading). It looks like your compiler is Clang. What is your OS and OS version? Can you try to run make in verbose mode and attach the full l

Re: [Python-Dev] cpython and parallel make

2014-09-01 Thread Brett Cannon
On Mon, Sep 1, 2014, 15:16 Victor Stinner wrote: Hi, My bashrc sets MAKEFLAGS to -j9 and Python compilation works fine on Fedora 20 with GNU make and GCC. My computer has 8 cores (4 physical with hyper threading). It looks like your compiler is Clang. What is your OS and OS version? I compil