[
https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kyle Weaver updated BEAM-8793:
------------------------------
Description:
This seems to affect the installGcpTest task for all python versions. There are
a few different failure modes, but they look like they might be related.
== 1 ==
11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED
11:01:38 Obtaining
file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python
11:01:38 ERROR: Command errored out with exit status 1:
11:01:38 command:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5
-c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';
__file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
'"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
11:01:38 cwd:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/
11:01:38 Complete output (37 lines):
11:01:38 Traceback (most recent call last):
11:01:38 File "<string>", line 1, in <module>
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py",
line 264, in <module>
11:01:38 'test': generate_protos_first(test),
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
line 144, in setup
11:01:38 _install_setup_requires(attrs)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
line 139, in _install_setup_requires
11:01:38 dist.fetch_build_eggs(dist.setup_requires)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
line 720, in fetch_build_eggs
11:01:38 replace_conflicting=True,
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
line 782, in resolve
11:01:38 replace_conflicting=replace_conflicting
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
line 1065, in best_match
11:01:38 return self.obtain(req, installer)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
line 1077, in obtain
11:01:38 return installer(requirement)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
line 787, in fetch_build_egg
11:01:38 return cmd.easy_install(req)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 679, in easy_install
11:01:38 return self.install_item(spec, dist.location, tmpdir, deps)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 705, in install_item
11:01:38 dists = self.install_eggs(spec, download, tmpdir)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 855, in install_eggs
11:01:38 return [self.install_wheel(dist_filename, tmpdir)]
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 1073, in install_wheel
11:01:38 os.path.dirname(destination)
11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in execute
11:01:38 util.execute(func, args, msg, dry_run=self.dry_run)
11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in execute
11:01:38 func(*args)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
line 101, in install_as_egg
11:01:38 self._install_as_egg(destination_eggdir, zf)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
line 109, in _install_as_egg
11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info,
egg_info)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
line 154, in _convert_metadata
11:01:38 os.rename(dist_info, egg_info)
11:01:38 FileNotFoundError: [Errno 2] No such file or directory:
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info'
->
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO'
11:01:38 ----------------------------------------
11:01:38 ERROR: Command errored out with exit status 1: python setup.py
egg_info Check the logs for full command output.
Another error I saw was:
== 2 ==
12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED
12:35:25 Obtaining
file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python
12:35:25 ERROR: Command errored out with exit status 1:
12:35:25 command:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7
-c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';
__file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
'"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
12:35:25 cwd:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/
12:35:25 Complete output (29 lines):
12:35:25 Traceback (most recent call last):
12:35:25 File "<string>", line 1, in <module>
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py",
line 259, in <module>
12:35:25 'test': generate_protos_first(test),
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
line 144, in setup
12:35:25 _install_setup_requires(attrs)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
line 139, in _install_setup_requires
12:35:25 dist.fetch_build_eggs(dist.setup_requires)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
line 720, in fetch_build_eggs
12:35:25 replace_conflicting=True,
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
line 782, in resolve
12:35:25 replace_conflicting=replace_conflicting
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
line 1065, in best_match
12:35:25 return self.obtain(req, installer)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
line 1077, in obtain
12:35:25 return installer(requirement)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
line 787, in fetch_build_egg
12:35:25 return cmd.easy_install(req)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 679, in easy_install
12:35:25 return self.install_item(spec, dist.location, tmpdir, deps)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 705, in install_item
12:35:25 dists = self.install_eggs(spec, download, tmpdir)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 855, in install_eggs
12:35:25 return [self.install_wheel(dist_filename, tmpdir)]
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 1079, in install_wheel
12:35:25 return self.egg_distribution(destination)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 897, in egg_distribution
12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path))
12:35:25 zipimport.ZipImportError: not a Zip file
12:35:25 ----------------------------------------
12:35:25 ERROR: Command errored out with exit status 1: python setup.py
egg_info Check the logs for full command output.
== 3 ==
07:56:50 > Task :sdks:python:test-suites:portable:py2:installGcpTest FAILED
...
07:56:50 File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py",
line 110, in _install_as_egg
07:56:50 self._convert_metadata(zf, destination_eggdir, dist_info,
egg_info)
07:56:50 File
"/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py",
line 131, in _convert_metadata
07:56:50 os.mkdir(destination_eggdir)
07:56:50 OSError: [Errno 17] File exists:
'/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg'
07:56:50 ----------------------------------------
07:56:50 ERROR: Command errored out with exit status 1: python setup.py
egg_info Check the logs for full command output.
was:
I've also seen this happen with
:sdks:python:test-suites:portable:py37:installGcpTest.
11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED
11:01:38 Obtaining
file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python
11:01:38 ERROR: Command errored out with exit status 1:
11:01:38 command:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5
-c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';
__file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
'"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
11:01:38 cwd:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/
11:01:38 Complete output (37 lines):
11:01:38 Traceback (most recent call last):
11:01:38 File "<string>", line 1, in <module>
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py",
line 264, in <module>
11:01:38 'test': generate_protos_first(test),
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
line 144, in setup
11:01:38 _install_setup_requires(attrs)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
line 139, in _install_setup_requires
11:01:38 dist.fetch_build_eggs(dist.setup_requires)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
line 720, in fetch_build_eggs
11:01:38 replace_conflicting=True,
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
line 782, in resolve
11:01:38 replace_conflicting=replace_conflicting
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
line 1065, in best_match
11:01:38 return self.obtain(req, installer)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
line 1077, in obtain
11:01:38 return installer(requirement)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
line 787, in fetch_build_egg
11:01:38 return cmd.easy_install(req)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 679, in easy_install
11:01:38 return self.install_item(spec, dist.location, tmpdir, deps)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 705, in install_item
11:01:38 dists = self.install_eggs(spec, download, tmpdir)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 855, in install_eggs
11:01:38 return [self.install_wheel(dist_filename, tmpdir)]
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
line 1073, in install_wheel
11:01:38 os.path.dirname(destination)
11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in execute
11:01:38 util.execute(func, args, msg, dry_run=self.dry_run)
11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in execute
11:01:38 func(*args)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
line 101, in install_as_egg
11:01:38 self._install_as_egg(destination_eggdir, zf)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
line 109, in _install_as_egg
11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info,
egg_info)
11:01:38 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
line 154, in _convert_metadata
11:01:38 os.rename(dist_info, egg_info)
11:01:38 FileNotFoundError: [Errno 2] No such file or directory:
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info'
->
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO'
11:01:38 ----------------------------------------
11:01:38 ERROR: Command errored out with exit status 1: python setup.py
egg_info Check the logs for full command output.
Another error I saw was:
12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED
12:35:25 Obtaining
file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python
12:35:25 ERROR: Command errored out with exit status 1:
12:35:25 command:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7
-c 'import sys, setuptools, tokenize; sys.argv[0] =
'"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';
__file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
'"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
'"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
12:35:25 cwd:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/
12:35:25 Complete output (29 lines):
12:35:25 Traceback (most recent call last):
12:35:25 File "<string>", line 1, in <module>
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py",
line 259, in <module>
12:35:25 'test': generate_protos_first(test),
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
line 144, in setup
12:35:25 _install_setup_requires(attrs)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
line 139, in _install_setup_requires
12:35:25 dist.fetch_build_eggs(dist.setup_requires)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
line 720, in fetch_build_eggs
12:35:25 replace_conflicting=True,
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
line 782, in resolve
12:35:25 replace_conflicting=replace_conflicting
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
line 1065, in best_match
12:35:25 return self.obtain(req, installer)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
line 1077, in obtain
12:35:25 return installer(requirement)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
line 787, in fetch_build_egg
12:35:25 return cmd.easy_install(req)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 679, in easy_install
12:35:25 return self.install_item(spec, dist.location, tmpdir, deps)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 705, in install_item
12:35:25 dists = self.install_eggs(spec, download, tmpdir)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 855, in install_eggs
12:35:25 return [self.install_wheel(dist_filename, tmpdir)]
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 1079, in install_wheel
12:35:25 return self.egg_distribution(destination)
12:35:25 File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
line 897, in egg_distribution
12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path))
12:35:25 zipimport.ZipImportError: not a Zip file
12:35:25 ----------------------------------------
12:35:25 ERROR: Command errored out with exit status 1: python setup.py
egg_info Check the logs for full command output.
> installGcpTest task flakes
> --------------------------
>
> Key: BEAM-8793
> URL: https://issues.apache.org/jira/browse/BEAM-8793
> Project: Beam
> Issue Type: Improvement
> Components: test-failures
> Reporter: Kyle Weaver
> Priority: Major
>
> This seems to affect the installGcpTest task for all python versions. There
> are a few different failure modes, but they look like they might be related.
> == 1 ==
> 11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED
> 11:01:38 Obtaining
> file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python
> 11:01:38 ERROR: Command errored out with exit status 1:
> 11:01:38 command:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5
> -c 'import sys, setuptools, tokenize; sys.argv[0] =
> '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';
>
> __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
> '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))'
> egg_info
> 11:01:38 cwd:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/
> 11:01:38 Complete output (37 lines):
> 11:01:38 Traceback (most recent call last):
> 11:01:38 File "<string>", line 1, in <module>
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py",
> line 264, in <module>
> 11:01:38 'test': generate_protos_first(test),
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
> line 144, in setup
> 11:01:38 _install_setup_requires(attrs)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py",
> line 139, in _install_setup_requires
> 11:01:38 dist.fetch_build_eggs(dist.setup_requires)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
> line 720, in fetch_build_eggs
> 11:01:38 replace_conflicting=True,
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
> line 782, in resolve
> 11:01:38 replace_conflicting=replace_conflicting
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
> line 1065, in best_match
> 11:01:38 return self.obtain(req, installer)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py",
> line 1077, in obtain
> 11:01:38 return installer(requirement)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py",
> line 787, in fetch_build_egg
> 11:01:38 return cmd.easy_install(req)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 679, in easy_install
> 11:01:38 return self.install_item(spec, dist.location, tmpdir, deps)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 705, in install_item
> 11:01:38 dists = self.install_eggs(spec, download, tmpdir)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 855, in install_eggs
> 11:01:38 return [self.install_wheel(dist_filename, tmpdir)]
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py",
> line 1073, in install_wheel
> 11:01:38 os.path.dirname(destination)
> 11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in
> execute
> 11:01:38 util.execute(func, args, msg, dry_run=self.dry_run)
> 11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in
> execute
> 11:01:38 func(*args)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
> line 101, in install_as_egg
> 11:01:38 self._install_as_egg(destination_eggdir, zf)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
> line 109, in _install_as_egg
> 11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info,
> egg_info)
> 11:01:38 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py",
> line 154, in _convert_metadata
> 11:01:38 os.rename(dist_info, egg_info)
> 11:01:38 FileNotFoundError: [Errno 2] No such file or directory:
> '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info'
> ->
> '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO'
> 11:01:38 ----------------------------------------
> 11:01:38 ERROR: Command errored out with exit status 1: python setup.py
> egg_info Check the logs for full command output.
> Another error I saw was:
> == 2 ==
> 12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED
> 12:35:25 Obtaining
> file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python
> 12:35:25 ERROR: Command errored out with exit status 1:
> 12:35:25 command:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7
> -c 'import sys, setuptools, tokenize; sys.argv[0] =
> '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';
>
> __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize,
> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"',
> '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))'
> egg_info
> 12:35:25 cwd:
> /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/
> 12:35:25 Complete output (29 lines):
> 12:35:25 Traceback (most recent call last):
> 12:35:25 File "<string>", line 1, in <module>
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py",
> line 259, in <module>
> 12:35:25 'test': generate_protos_first(test),
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
> line 144, in setup
> 12:35:25 _install_setup_requires(attrs)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py",
> line 139, in _install_setup_requires
> 12:35:25 dist.fetch_build_eggs(dist.setup_requires)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
> line 720, in fetch_build_eggs
> 12:35:25 replace_conflicting=True,
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
> line 782, in resolve
> 12:35:25 replace_conflicting=replace_conflicting
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
> line 1065, in best_match
> 12:35:25 return self.obtain(req, installer)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py",
> line 1077, in obtain
> 12:35:25 return installer(requirement)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py",
> line 787, in fetch_build_egg
> 12:35:25 return cmd.easy_install(req)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 679, in easy_install
> 12:35:25 return self.install_item(spec, dist.location, tmpdir, deps)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 705, in install_item
> 12:35:25 dists = self.install_eggs(spec, download, tmpdir)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 855, in install_eggs
> 12:35:25 return [self.install_wheel(dist_filename, tmpdir)]
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 1079, in install_wheel
> 12:35:25 return self.egg_distribution(destination)
> 12:35:25 File
> "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py",
> line 897, in egg_distribution
> 12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path))
> 12:35:25 zipimport.ZipImportError: not a Zip file
> 12:35:25 ----------------------------------------
> 12:35:25 ERROR: Command errored out with exit status 1: python setup.py
> egg_info Check the logs for full command output.
> == 3 ==
> 07:56:50 > Task :sdks:python:test-suites:portable:py2:installGcpTest FAILED
> ...
> 07:56:50 File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py",
> line 110, in _install_as_egg
> 07:56:50 self._convert_metadata(zf, destination_eggdir, dist_info,
> egg_info)
> 07:56:50 File
> "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py",
> line 131, in _convert_metadata
> 07:56:50 os.mkdir(destination_eggdir)
> 07:56:50 OSError: [Errno 17] File exists:
> '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg'
> 07:56:50 ----------------------------------------
> 07:56:50 ERROR: Command errored out with exit status 1: python setup.py
> egg_info Check the logs for full command output.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
