[ https://issues.apache.org/jira/browse/HADOOP-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Akira Ajisaka resolved HADOOP-17522. ------------------------------------ Resolution: Duplicate > Looking to build Hadoop but start-build-env.sh errors > ----------------------------------------------------- > > Key: HADOOP-17522 > URL: https://issues.apache.org/jira/browse/HADOOP-17522 > Project: Hadoop Common > Issue Type: Bug > Components: build > Reporter: Adam Roberts > Priority: Major > > Hey everyone, we're trying to build Hadoop from source and in building.txt we > see > > The easiest way to get an environment with all the appropriate tools is by > means > of the provided Docker config. > This requires a recent version of docker (1.4.1 and higher are known to work). > On Linux / Mac: > Install Docker and run this command: > $ ./start-build-env.sh > > However, and admittedly this is on 3.1.4, which I want to build - > > > {{Step 26/36 : RUN pip2 install configparser==4.0.2 pylint==1.9.2}}{{ > ---> Running in acf678bc8314}}{{Collecting configparser==4.0.2}}{{ > Downloading > https://files.pythonhosted.org/packages/7a/2a/95ed0501cf5d8709490b1d3a3f9b5cf340da6c433f896bbe9ce08dbe6785/configparser-4.0.2-py2.py3-none-any.whl}}{{Collecting > pylint==1.9.2}}{{ Downloading > https://files.pythonhosted.org/packages/f2/95/0ca03c818ba3cd14f2dd4e95df5b7fa232424b7fc6ea1748d27f293bc007/pylint-1.9.2-py2.py3-none-any.whl > (690kB)}}{{Collecting singledispatch; python_version < "3.4" (from > pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/c5/10/369f50bcd4621b263927b0a1519987a04383d4a98fb10438042ad410cf88/singledispatch-3.4.0.3-py2.py3-none-any.whl}}{{Collecting > isort>=4.2.5 (from pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/a2/f7/f50fc9555dc0fe2dc1e7f69d93f71961d052857c296cad0fb6d275b20008/isort-5.7.0.tar.gz > (169kB)}}{{Collecting astroid<2.0,>=1.6 (from pylint==1.9.2)}}{{ > Downloading > https://files.pythonhosted.org/packages/8b/29/0f7ec6fbf28a158886b7de49aee3a77a8a47a7e24c60e9fd6ec98ee2ec02/astroid-1.6.6-py2.py3-none-any.whl > (305kB)}}{{Collecting backports.functools-lru-cache; python_version == "2.7" > (from pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/da/d1/080d2bb13773803648281a49e3918f65b31b7beebf009887a529357fd44a/backports.functools_lru_cache-1.6.1-py2.py3-none-any.whl}}{{Collecting > mccabe (from pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/87/89/479dc97e18549e21354893e4ee4ef36db1d237534982482c3681ee6e7b57/mccabe-0.6.1-py2.py3-none-any.whl}}{{Collecting > six (from pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/ee/ff/48bde5c0f013094d729fe4b0316ba2a24774b3ff1c52d924a8a4cb04078a/six-1.15.0-py2.py3-none-any.whl}}{{Collecting > enum34>=1.1.3; python_version < "3.4" (from > astroid<2.0,>=1.6->pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/6f/2c/a9386903ece2ea85e9807e0e062174dc26fdce8b05f216d00491be29fad5/enum34-1.1.10-py2-none-any.whl}}{{Collecting > wrapt (from astroid<2.0,>=1.6->pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/82/f7/e43cefbe88c5fd371f4cf0cf5eb3feccd07515af9fd6cf7dbf1d1793a797/wrapt-1.12.1.tar.gz}}{{Collecting > lazy-object-proxy (from astroid<2.0,>=1.6->pylint==1.9.2)}}{{ Downloading > https://files.pythonhosted.org/packages/69/fc/79080e582c17b7f45ac0bb4a13b0260992dcc2519b5a29ac6cde3e81b6fa/lazy_object_proxy-1.5.2-cp27-cp27mu-manylinux1_x86_64.whl > (52kB)}}{{Building wheels for collected packages: isort, wrapt}}{{ Running > setup.py bdist_wheel for isort: started}}{{ Running setup.py bdist_wheel for > isort: finished with status 'error'}}{{ Complete output from command > /usr/bin/python -u -c "import setuptools, > tokenize;__file__='/tmp/pip-build-u9WX19/isort/setup.py';exec(compile(getattr(tokenize, > 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" > bdist_wheel -d /tmp/tmp60t8Japip-wheel- --python-tag cp27:}}{{ > /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution > option: 'python_requires'}}{{ warnings.warn(msg)}}{{ running > bdist_wheel}}{{ running build}}{{ running build_py}}{{ creating build}}{{ > creating build/lib.linux-x86_64-2.7}}{{ creating > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/_version.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/settings.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/logo.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/hooks.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/wrap_modes.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/sections.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/parse.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/utils.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/setuptools_commands.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/files.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/format.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/wrap.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/place.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/profiles.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/__main__.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/output.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/core.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/exceptions.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/pylama_isort.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/literal.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/comments.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/io.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/identify.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/main.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/api.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/__init__.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/sorting.py -> > build/lib.linux-x86_64-2.7/isort}}{{ creating > build/lib.linux-x86_64-2.7/isort/_future}}{{ copying > isort/_future/_dataclasses.py -> build/lib.linux-x86_64-2.7/isort/_future}}{{ > copying isort/_future/__init__.py -> > build/lib.linux-x86_64-2.7/isort/_future}}{{ creating > build/lib.linux-x86_64-2.7/isort/_vendored}}{{ creating > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/ordered.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/tz.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/decoder.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/encoder.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/__init__.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ creating > build/lib.linux-x86_64-2.7/isort/deprecated}}{{ copying > isort/deprecated/finders.py -> > build/lib.linux-x86_64-2.7/isort/deprecated}}{{ copying > isort/deprecated/__init__.py -> > build/lib.linux-x86_64-2.7/isort/deprecated}}{{ creating > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/py38.py > -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying > isort/stdlibs/py39.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/py35.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/py37.py -> > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/all.py -> > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/py3.py -> > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/py27.py > -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/py2.py > -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying > isort/stdlibs/py36.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/__init__.py -> > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ error: can't copy > 'isort/stdlibs': doesn't exist or not a regular file}}{{ }}{{ > ----------------------------------------}}{{ Failed building wheel for > isort}}{{ Running setup.py clean for isort}}{{ Running setup.py bdist_wheel > for wrapt: started}}{{ Running setup.py bdist_wheel for wrapt: finished with > status 'done'}}{{ Stored in directory: > /root/.cache/pip/wheels/b1/c2/ed/d62208260edbd3fa7156545c00ef966f45f2063d0a84f8208a}}{{Successfully > built wrapt}}{{Failed to build isort}}{{Installing collected packages: > configparser, six, singledispatch, isort, enum34, wrapt, > backports.functools-lru-cache, lazy-object-proxy, astroid, mccabe, pylint}}{{ > Running setup.py install for isort: started}}{{ Running setup.py install > for isort: finished with status 'error'}}{{ Complete output from command > /usr/bin/python -u -c "import setuptools, > tokenize;__file__='/tmp/pip-build-u9WX19/isort/setup.py';exec(compile(getattr(tokenize, > 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" > install --record /tmp/pip-Pa5mnZ-record/install-record.txt > --single-version-externally-managed --compile:}}{{ > /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution > option: 'python_requires'}}{{ warnings.warn(msg)}}{{ running > install}}{{ running build}}{{ running build_py}}{{ creating > build}}{{ creating build/lib.linux-x86_64-2.7}}{{ creating > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/_version.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/settings.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/logo.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/hooks.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/wrap_modes.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/sections.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/parse.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/utils.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/setuptools_commands.py > -> build/lib.linux-x86_64-2.7/isort}}{{ copying isort/files.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/format.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/wrap.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/place.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/profiles.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/__main__.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/output.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/core.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/exceptions.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/pylama_isort.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/literal.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/comments.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/io.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/identify.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/main.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/api.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/__init__.py -> > build/lib.linux-x86_64-2.7/isort}}{{ copying isort/sorting.py -> > build/lib.linux-x86_64-2.7/isort}}{{ creating > build/lib.linux-x86_64-2.7/isort/_future}}{{ copying > isort/_future/_dataclasses.py -> build/lib.linux-x86_64-2.7/isort/_future}}{{ > copying isort/_future/__init__.py -> > build/lib.linux-x86_64-2.7/isort/_future}}{{ creating > build/lib.linux-x86_64-2.7/isort/_vendored}}{{ creating > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/ordered.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/tz.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/decoder.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/encoder.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ copying > isort/_vendored/toml/__init__.py -> > build/lib.linux-x86_64-2.7/isort/_vendored/toml}}{{ creating > build/lib.linux-x86_64-2.7/isort/deprecated}}{{ copying > isort/deprecated/finders.py -> > build/lib.linux-x86_64-2.7/isort/deprecated}}{{ copying > isort/deprecated/__init__.py -> > build/lib.linux-x86_64-2.7/isort/deprecated}}{{ creating > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/py38.py > -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying > isort/stdlibs/py39.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/py35.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/py37.py -> > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/all.py > -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying > isort/stdlibs/py3.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/py27.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > copying isort/stdlibs/py2.py -> > build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying isort/stdlibs/py36.py > -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ copying > isort/stdlibs/__init__.py -> build/lib.linux-x86_64-2.7/isort/stdlibs}}{{ > error: can't copy 'isort/stdlibs': doesn't exist or not a regular file}}{{ > }}{{ ----------------------------------------}}{{Command "/usr/bin/python > -u -c "import setuptools, > tokenize;__file__='/tmp/pip-build-u9WX19/isort/setup.py';exec(compile(getattr(tokenize, > 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" > install --record /tmp/pip-Pa5mnZ-record/install-record.txt > --single-version-externally-managed --compile" failed with error code 1 in > /tmp/pip-build-u9WX19/isort/}} > You are using pip version 8.1.1, however version 21.0.1 is available. > You should consider upgrading via the 'pip install --upgrade pip' command. > > If I add that into the Dockerfile, I get > {{}}{{ ---> Running in 5d4c46c61d29}}{{Traceback (most recent call last):}}{{ > File "/usr/local/bin/pip2", line 7, in <module>}}{{ from > pip._internal.cli.main import main}}{{ File > "/usr/local/lib/python2.7/dist-packages/pip/_internal/cli/main.py", line > 60}}{{ sys.stderr.write(f"ERROR: \{exc}")}}{{ > ^}}{{SyntaxError: invalid syntax}} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org