Laszlo Gaal has uploaded this change for review. ( http://gerrit.cloudera.org:8080/15624
Change subject: Use Python from the toolchain for Impala ...................................................................... Use Python from the toolchain for Impala Historically Impala used the Python2 version that was available on the hosting platform, as long as that version was at least v2.6. This caused constant headache as all Python syntax had to be kept compatible with Python 2.6 (for Centos 6). It also caused a recent problem on Centos 8: here the system Python version was compiled with the system's GCC version (v8.3), which was much more recent than the Impala standard compiler version (GCC 4.9.2). When the Impala virtualenv was built, the system Python version supplied C compiler switches for models containing mative code that were unknown for the Impala version of GCC, thus breaking virtualenv installation. This patch changes the Impala virtualenv to always use the Python2 version from the toolchain, which is built with the toolchain compiler. This ensures that - Impala always has a known Python 2.7 version for all its scripts, - virtualenv modules based on native code will always be installable, as the Python environment and the modules are built with the same compiler version. Additional changes: - Add an assert to Impala tests checking that they are being run with Python 2.7.x - Add an assert to the Impala virtualenv checking that HTTPS modules were loaded successfully - Make bootstrap_toolchain.py independent from the Impala virtualenv: remove the dependency on the "sh" library Most content in this patch was developed but not published earlier by Tim Armstrong. Change-Id: Ic7b40cef89cfb3b467b61b2d54a94e708642882b --- M bin/bootstrap_system.sh M bin/bootstrap_toolchain.py M bin/impala-config.sh M bin/set-pythonpath.sh M docker/entrypoint.sh M infra/python/bootstrap_virtualenv.py A infra/python/tmp.py M tests/common/impala_test_suite.py 8 files changed, 102 insertions(+), 33 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/24/15624/1 -- To view, visit http://gerrit.cloudera.org:8080/15624 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ic7b40cef89cfb3b467b61b2d54a94e708642882b Gerrit-Change-Number: 15624 Gerrit-PatchSet: 1 Gerrit-Owner: Laszlo Gaal <laszlo.g...@cloudera.com>