[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:

I have been asked to backport this to 3.8. There's a very small window
of opportunity:

3.8.6: Monday, 2020-09-21
3.8.7rc1: Monday, 2020-11-02
3.8.7: Monday, 2020-11-16 (final version!)


Backporting procedures since 3.8 are unclear and a source of
constant friction, so most core developers seem to have stopped
doing any backports at all.  It is not a battle I'll choose, but
if you get a second core dev to review this trivial patch I'll
commit it.

There's a simple solution for 3.8: Do not use the parallel build,
the regular build takes around 4 min.


For the buildbots you can ask the operator for a custom command
line.

--
status: closed -> open

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:

This is in master and 3.9.1.  I'll not backport to 3.8 because a release 
candidate is imminent.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
type:  -> behavior
versions: +Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:


New changeset 88b86a9752afc2c50ca196f6ba1a8d62d71cf398 by Miss Islington (bot) 
in branch '3.9':
bpo-19521: Fix parallel build race condition on AIX (GH-22001)
https://github.com/python/cpython/commit/88b86a9752afc2c50ca196f6ba1a8d62d71cf398


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 8.0 -> 9.0
pull_requests: +21107
pull_request: https://github.com/python/cpython/pull/22001

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[miss-islington]

Change by miss-islington :


--
pull_requests: +21108
pull_request: https://github.com/python/cpython/pull/22002

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:


New changeset e6dcd371b2c54a94584dd124e8c592a496d46a47 by Stefan Krah in branch 
'master':
bpo-19521: Fix parallel build race condition on AIX (GH-21997)
https://github.com/python/cpython/commit/e6dcd371b2c54a94584dd124e8c592a496d46a47


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:

I can't find the reason for:

if test -z "$EXPORTSYMS"; then
EXPORTSYMS="Modules/python.exp"
fi


Modules/python.exp is hardcoded elsewhere, and I'd rather set
EXPORTSYMS unconditionally on AIX and unset it unconditionally
for all other systems (which don't build with the patch if
EXPORTSYMS happens to be defined).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:

Okay, thanks.  The -G option is of course attractive for Linux projects
because it requires minimal changes in the build machinery.

I've added support for libmpdec/libmpdec++ (next release) for AIX-style
shared libraries (shr.o inside libmpdec.a).  The AIX linker has a certain
elegance, but it requires something like 150 lines of code changes and
conditionals inside the Makefiles.

I can confirm that -G is substantially slower, so I'm going to commit this
patch soon.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Change by Stefan Krah :


--
pull_requests: +21103
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/21997

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[David Edelsohn]

David Edelsohn  added the comment:

Yes, export file generation still is required.

Python does not need to utilize runtime linking.  Using -G is a very bad choice 
and severely discouraged with severe performance and other penalties.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Stefan Krah  added the comment:

The original patch is a bit dated, do we still need the export symbol 
generation?

https://www.ibm.com/support/knowledgecenter/en/SSGH3R_16.1.0/com.ibm.xlcpp161.aix.doc/proguide/compiling_shared_aix.html

"Use the -G option to create a shared library from the generated object files, 
and to enable runtime linking with applications that support it."

"If you do not specify a -bE option, all the global symbols are exported except 
for those symbols that have the hidden or internal visibility attribute."

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Change by Stefan Krah :


--
nosy: +BTaskaya, Michael.Felt, kadler, skrah

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Stefan Krah]

Change by Stefan Krah :


--
versions: +Python 3.10 -Python 2.7, Python 3.2, Python 3.3, Python 3.4, Python 
3.5, Python 3.6, Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Michael Haubenwallner]

Changes by Michael Haubenwallner :


--
pull_requests: +560

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Eric N. Vander Weele]

Eric N. Vander Weele added the comment:

I may be able to simplify the build on AIX by removing ld_so_aix and python.exp 
entirely.  Would this be a preferred solution if I am able to get something 
working?  If so, should I create a separate issue to track the change?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue19521] Parallel build race condition on AIX since python-2.7

[Eric N. Vander Weele]

Eric N. Vander Weele added the comment:

I also have found this goes back since Python 2.7.

I have refreshed the patched for the tip of CPython.  What can I do to help 
push this forward?

--
title: parallel build race condition on AIX since python-3.2 -> Parallel build 
race condition on AIX since python-2.7
Added file: 
http://bugs.python.org/file45665/aix-parallel-build-race-refresh.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com