[issue18235] _sysconfigdata.py wrong on AIX installations

Eric N. Vander Weele added the comment: > Hmm, the patch seems to be incomplete, as it just removes all the AIX support > scripts and mentions, without adding anything new to accommodate for the > removal. The new changes to accommodate for the script removal are in

[issue18235] _sysconfigdata.py wrong on AIX installations

Marc-Andre Lemburg added the comment: On 24.01.2017 16:47, Eric N. Vander Weele wrote: > > I have a (large) patch that completely eliminates the need for ld_so_aix and > makeexp_aix. I've applied and been using this with for Python 2.7 and 3.5+, > but I still need to go back and validate the

[issue18235] _sysconfigdata.py wrong on AIX installations

Eric N. Vander Weele added the comment: I have a (large) patch that completely eliminates the need for ld_so_aix and makeexp_aix. I've applied and been using this with for Python 2.7 and 3.5+, but I still need to go back and validate the tests to ensure everything passes as expected. It's

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: OK - so details on the failing tests - for the record only. However, I would appreciate some 'expert' feedback on what is expected to be happening in this test: == FAIL:

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: I am back at this: (note: short answer to msg277745 - No. does not work for me) As ... expressed before, this needs to work in three contexts: 2) In-tree testing of build module feature (test_distutils). Below are results of 'in tree' and 'out of tree' testing.

[issue18235] _sysconfigdata.py wrong on AIX installations

Marc-Andre Lemburg added the comment: On 24.01.2017 15:23, Michael Felt wrote: > As far as issue10656 and this issue are concerned: > > Python-3.4 is out of context (but 3.4.6 was just released) - and does not > work with 'out of tree' builds. > > The other versions: 2.7.13, 3.5.3 and 3.6.0

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: As far as issue10656 and this issue are concerned: Python-3.4 is out of context (but 3.4.6 was just released) - and does not work with 'out of tree' builds. The other versions: 2.7.13, 3.5.3 and 3.6.0 do build out-of-tree. Note 3.5.3 and 3.6.0 use a different

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: re: msg286115, 1) Building modules in the tree during the build process. ** if "in the tree" means building outside of source - such as: ../src/python-X.Y.Z/configure ... make ** the tarball for Python-2.7.13 is building from ../src/Python-2.7.13/configure

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: Sorry I meant Issue 10656. I recently committed a fix regarding out-of-tree builds and ld_so_aix, and it sounds like you were thinking of reverting that. -- ___ Python tracker

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: I don’t run AIX, but my understanding is there are three distinct branches (2.7, 3.5, and 3.6+). Some of the following is guessed, so please correct me if I am wrong: Python 2.7: _sysconfigdata.py incorrectly created with LDSHARED = Modules/ld_so_aix. Result:

[issue18235] _sysconfigdata.py wrong on AIX installations

Changes by Antoine Pitrou : -- nosy: -pitrou ___ Python tracker ___ ___ Python-bugs-list

[issue18235] _sysconfigdata.py wrong on AIX installations

Marc-Andre Lemburg added the comment: BTW: Does the ticket still apply to 3.5+ ? From reading the ticket, it seems that the problem is already fixed for those versions. -- ___ Python tracker

[issue18235] _sysconfigdata.py wrong on AIX installations

Marc-Andre Lemburg added the comment: Hmm, looking at the patch again: diff -r a089a8b1f93d Lib/sysconfig.py --- a/Lib/sysconfig.py Fri Jun 21 18:37:02 2013 -0400 +++ b/Lib/sysconfig.py Fri Jun 21 22:33:15 2013 -0700 @@ -368,7 +368,7 @@ # -- these paths are relative to the Python source,

[issue18235] _sysconfigdata.py wrong on AIX installations

Marc-Andre Lemburg added the comment: Reading the ticket, it seems that there is some confusion about what LDSHARED and BLDSHARED are used for. BLDSHARED is used to override the LDSHARED value when building libpython and the shared modules (via setup.py). LDSHARED is what is meant to be used

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: You guys are the experts. I can only comment on what I see. IMHO: the file _sysconfigdata.py is more accurate with nothing in it. I am clearly confused by whatever process this is. If you believe it is more accurate to have the BLD variable 'inaccurate' in this

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: I completely agree with Martin's concern. As I expressed before, this needs to work in three contexts: 1) Building modules in the tree during the build process. 2) In-tree testing of build module feature (test_distutils). 3) Building and installing modules

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: If the assignment is completely removed, won’t this break the test when run from the source or build tree (as opposed to when installed)? Or at least make the situation worse: the AIX buildbot is already failing test_distutils, but at least it is looking for

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: This is "only" for Python-2.7 (for now). The others will be tested as I am able. Working with the patch submitted 2013-10-19 (aka https://bugs.python.org/file32229/issue18235.patch) A) Without/before the patch: root@x064:[/data/prj/python/Python-2.7.13.0]grep

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: Ok. I shall rebuild from scratch. When I do, I start from a "clean" system - only the compiler and my mkinstallp helper script. I am adding the latest zlib for what I would package but I shall forgoe that for this test. --

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: Michael, you need to build from scratch. The values are set and tweaked in various phases of configure and then written to _sysconfigdata.py for installation. The values in the file reflect the values used during the build, but many of them are not used in

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: I did not go through a whole build process. Changing: if _PYTHON_BUILD: vars['BLDSHARED'] = vars['LDSHARED'] to if _PYTHON_BUILD: vars['LDSHARED'] = vars['BLDSHARED'] is not going to help if both variables are wrong in

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: So are you saying you tried patching Python 2 and/or 3, but did not see any relevant change at all? -- ___ Python tracker

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: The "key" bit of the patch is to move the code AND make this assignment: if _PYTHON_BUILD: vars['LDSHARED'] = vars['BLDSHARED'] Besides, imho, skipping around the problem that LDSHARED is not correctly assigned - it cannot work because BLDSHARED is

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: OK - just looked at what happens with Python3-3.6 new file name: _sysconfigdata_m_aix5_.py values: root@x064:[/data/prj/python/python3-3.6.0/X64/opt/lib/python3.6]grep SHARED _sysconf*.py | grep LD 'BLDSHARED': '/opt/lib/python3.6/config-3.6m/ld_so_aix xlc_r '

[issue18235] _sysconfigdata.py wrong on AIX installations

Changes by Eric N. Vander Weele : -- nosy: +ericvw ___ Python tracker ___ ___

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: FYI: after manually creating the .../libpython3.5/config directory and copying three files (see below) I was able to "pip3 install cython" as test. At the packing area: michael@x071:[/data/prj/python3/python3-3.5.2]ls Xany/opt/lib/python3.5/config ld_so_aix

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: As this is the issue still open with regard to issues with ld_so_aix... The current release Python3-3.5.2 does not include ld_so_aix in the "make install DESTDIR=xxx output ("make install" also neglects to install ld_so_aix) Installation Summary

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: Regarding out-of-tree builds (Problem 3), see Issue 10656, which already has a potential patch. -- ___ Python tracker

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: Michael F.: It sounds like you have three separate but related problems: 1. Confusion between LDSHARED and BLDSHARED referring to the in-source build tree vs final installed files. I think this is what David and Michael H. were originally trying to fix here.

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: correction: On 23-Oct-16 20:54, Michael Felt wrote: > except neither BLDSHARED nor LDCXXSHARED have taken the extra LDFLAG except neither LDSHARED nor LDCXXSHARED have taken the extra LDFLAG like BLDSHARED has. > that was exported before configure was called (in

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: The value that works for LDSHARED is the value that LDCXXSHARED has. BLDSHARED is also broken (currently). 'BLDSHARED': './Modules/ld_so_aix xlc_r -bI:./Modules/python.exp -L/opt/lib', 'LDCXXSHARED': '/opt/lib/python2.7/config/ld_so_aix xlc_r

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: This is my understanding: We are talking about the code at that switches the values of LDSHARED and/or BLDSHARED. Yes, Michael H. was suggesting to both move and change (revert) back to

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Haubenwallner added the comment: ...a long time since I've been in this area... David, I'm not completely sure which code fragments you're talking about for "revert or change". Anyway: If I remember correctly, the confusion here is about the idea behind LDSHARED and BLDSHARED. As far

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: Michael Felt, The patch was from Michael Haubenwallner. I was addressing Michael Haubenwallner. -- ___ Python tracker

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Felt added the comment: I am not suggesting anything. I am only trying to report what I experience. The first observation was that I could not build python when src != build directory. I believe that was the original complaint as well. The second observation came when I tried to use

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: Michael, Are you suggesting to move the code fragment *AND* revert or change the reversal of LDSHARED? The Python code seems to be setting and reversing the value in multiple places. This also relates to Issue25825. Repeatedly flipping this around is not

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: Reopening this to fix the original bug in 2.7, and to improve things for Python 3. Michael Felt (or anyone else): Can you confirm if Michael Haubenwallner’s suggested patch from is appropriate? It looks like that

[issue18235] _sysconfigdata.py wrong on AIX installations

Martin Panter added the comment: It might have been good to get this reopened to attract more attention to it. Anyway, Issue 28311 has now been opened for 2.7, and it seems to be about the same problem. -- nosy: +martin.panter superseder: -> AIX shared library extension modules

[issue18235] _sysconfigdata.py wrong on AIX installations

Phil Elson added the comment: FWIW - this doesn't appear to have been backported to v2.7.x. As a result, the ./Modules/ld_so_aix reference still exists in _sysconfigdata.py in v2.7.8 (and therefore I was unable to build numpy). The workaround is easy enough, it is just something that is worth

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Haubenwallner added the comment: Hmm... instead of reversing the order while keeping in _generate_posix_vars(), feels like it would have been better to move the code from 2000 back to _init_posix() where it originally was, without changing the order - because now for sysconfig within

[issue18235] _sysconfigdata.py wrong on AIX installations

Changes by Michael Haubenwallner michael.haubenwall...@salomon.at: Removed file: http://bugs.python.org/file32542/python-tip-aix-absbuilddir.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Haubenwallner added the comment: issue#10656 is the out-of-source part already. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235 ___

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Haubenwallner added the comment: Kindly ping. Do you prefer another report for the aix-absbuilddir patch as this one is already closed? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: Do you want me to open a new issue or do you want to open a new issue? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235 ___

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Haubenwallner added the comment: Erm, question target was the python committers. And I'd create the new issue if they prefer. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

Michael Haubenwallner added the comment: Actually, ld_so_aix is autogenerated from ld_so_aix.in into builddir, while makexp_aix is not. Attached patch eventually might fix the test too? -- nosy: +haubi Added file: http://bugs.python.org/file32542/python-tip-aix-absbuilddir.patch

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: +1 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235 ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: I think I see the source of the confusion. test_distutils fails because it runs in the build tree and without files installed. The test does not use the installed version of sysconfig, so it looks for ./Modules/ld_so_aix, which fails. The kludge from 2000 was

[issue18235] _sysconfigdata.py wrong on AIX installations

Changes by Larry Hastings la...@hastings.org: -- nosy: +larry ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235 ___ ___ Python-bugs-list mailing

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: Patch against current trunk -- keywords: +patch Added file: http://bugs.python.org/file32229/issue18235.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: With my patch applied, _sysconfig.py looks like 'BLDSHARED': '/usr/local/lib/python3.4/config/ld_so_aix gcc -pthread ' '-bI:/usr/local/lib/python3.4/config/python.exp', 'LDSHARED': '/usr/local/lib/python3.4/config/ld_so_aix gcc -pthread '

[issue18235] _sysconfigdata.py wrong on AIX installations

Antoine Pitrou added the comment: Ha, that code dates back to 2000 and 2001 (f1e40abbedb3 and c958678720fd, respectively). -- nosy: +pitrou ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

Roundup Robot added the comment: New changeset c554194240fc by Antoine Pitrou in branch '3.3': Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX. http://hg.python.org/cpython/rev/c554194240fc New changeset e3ac917fcf9c by Antoine Pitrou in branch 'default': Issue

[issue18235] _sysconfigdata.py wrong on AIX installations

Antoine Pitrou added the comment: Committed the patch. I trust you that you got it right! -- resolution: - fixed stage: - committed/rejected status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

Éric Araujo added the comment: Can you suggest how to fix this? -- components: +Build -Extension Modules nosy: +eric.araujo versions: +Python 3.3, Python 3.4 -Python 3.5 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: It looks like someone already tried to fix part of this, but reversed the assignment diff -r a089a8b1f93d Lib/sysconfig.py --- a/Lib/sysconfig.py Fri Jun 21 18:37:02 2013 -0400 +++ b/Lib/sysconfig.py Fri Jun 21 22:33:15 2013 -0700 @@ -368,7 +368,7 @@ #

[issue18235] _sysconfigdata.py wrong on AIX installations

David Edelsohn added the comment: This is the cause of the failures in test_distutils. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18235 ___

[issue18235] _sysconfigdata.py wrong on AIX installations

New submission from David Edelsohn: _sysconfigdata.py includes information about how to build extension modules. On AIX this requires a wrapper script to build shared libraries. The file includes definitions like: 'BLDSHARED': './Modules/ld_so_aix gcc -pthread -bI:./Modules/python.exp',