[ https://issues.apache.org/jira/browse/BEAM-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kyle Weaver updated BEAM-8793: ------------------------------ Summary: installGcpTest task flakes (python setup.py egg_info fails) (was: installGcpTest task flakes) > installGcpTest task flakes (python setup.py egg_info fails) > ----------------------------------------------------------- > > Key: BEAM-8793 > URL: https://issues.apache.org/jira/browse/BEAM-8793 > Project: Beam > Issue Type: Improvement > Components: test-failures > Reporter: Kyle Weaver > Priority: Major > > This seems to affect the installGcpTest task for all python versions. There > are a few different failure modes, but they look like they might be related. > == 1 == > 11:01:38 > Task :sdks:python:test-suites:direct:py35:installGcpTest FAILED > 11:01:38 Obtaining > file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python > 11:01:38 ERROR: Command errored out with exit status 1: > 11:01:38 command: > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/bin/python3.5 > -c 'import sys, setuptools, tokenize; sys.argv[0] = > '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"'; > > __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize, > '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', > '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' > egg_info > 11:01:38 cwd: > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/ > 11:01:38 Complete output (37 lines): > 11:01:38 Traceback (most recent call last): > 11:01:38 File "<string>", line 1, in <module> > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/setup.py", > line 264, in <module> > 11:01:38 'test': generate_protos_first(test), > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py", > line 144, in setup > 11:01:38 _install_setup_requires(attrs) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/__init__.py", > line 139, in _install_setup_requires > 11:01:38 dist.fetch_build_eggs(dist.setup_requires) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py", > line 720, in fetch_build_eggs > 11:01:38 replace_conflicting=True, > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py", > line 782, in resolve > 11:01:38 replace_conflicting=replace_conflicting > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py", > line 1065, in best_match > 11:01:38 return self.obtain(req, installer) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/pkg_resources/__init__.py", > line 1077, in obtain > 11:01:38 return installer(requirement) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/dist.py", > line 787, in fetch_build_egg > 11:01:38 return cmd.easy_install(req) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", > line 679, in easy_install > 11:01:38 return self.install_item(spec, dist.location, tmpdir, deps) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", > line 705, in install_item > 11:01:38 dists = self.install_eggs(spec, download, tmpdir) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", > line 855, in install_eggs > 11:01:38 return [self.install_wheel(dist_filename, tmpdir)] > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/command/easy_install.py", > line 1073, in install_wheel > 11:01:38 os.path.dirname(destination) > 11:01:38 File "/usr/lib/python3.5/distutils/cmd.py", line 336, in > execute > 11:01:38 util.execute(func, args, msg, dry_run=self.dry_run) > 11:01:38 File "/usr/lib/python3.5/distutils/util.py", line 301, in > execute > 11:01:38 func(*args) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", > line 101, in install_as_egg > 11:01:38 self._install_as_egg(destination_eggdir, zf) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", > line 109, in _install_as_egg > 11:01:38 self._convert_metadata(zf, destination_eggdir, dist_info, > egg_info) > 11:01:38 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/build/gradleenv/1398941889/lib/python3.5/site-packages/setuptools/wheel.py", > line 154, in _convert_metadata > 11:01:38 os.rename(dist_info, egg_info) > 11:01:38 FileNotFoundError: [Errno 2] No such file or directory: > '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/pytest_runner-5.2.dist-info' > -> > '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35_PR/src/sdks/python/.eggs/pytest_runner-5.2-py3.5.egg/EGG-INFO' > 11:01:38 ---------------------------------------- > 11:01:38 ERROR: Command errored out with exit status 1: python setup.py > egg_info Check the logs for full command output. > Another error I saw was: > == 2 == > 12:35:25 > Task :sdks:python:test-suites:direct:py37:installGcpTest FAILED > 12:35:25 Obtaining > file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python > 12:35:25 ERROR: Command errored out with exit status 1: > 12:35:25 command: > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/bin/python3.7 > -c 'import sys, setuptools, tokenize; sys.argv[0] = > '"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"'; > > __file__='"'"'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py'"'"';f=getattr(tokenize, > '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', > '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' > egg_info > 12:35:25 cwd: > /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/ > 12:35:25 Complete output (29 lines): > 12:35:25 Traceback (most recent call last): > 12:35:25 File "<string>", line 1, in <module> > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/sdks/python/setup.py", > line 259, in <module> > 12:35:25 'test': generate_protos_first(test), > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py", > line 144, in setup > 12:35:25 _install_setup_requires(attrs) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/__init__.py", > line 139, in _install_setup_requires > 12:35:25 dist.fetch_build_eggs(dist.setup_requires) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py", > line 720, in fetch_build_eggs > 12:35:25 replace_conflicting=True, > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py", > line 782, in resolve > 12:35:25 replace_conflicting=replace_conflicting > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py", > line 1065, in best_match > 12:35:25 return self.obtain(req, installer) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/pkg_resources/__init__.py", > line 1077, in obtain > 12:35:25 return installer(requirement) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/dist.py", > line 787, in fetch_build_egg > 12:35:25 return cmd.easy_install(req) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", > line 679, in easy_install > 12:35:25 return self.install_item(spec, dist.location, tmpdir, deps) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", > line 705, in install_item > 12:35:25 dists = self.install_eggs(spec, download, tmpdir) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", > line 855, in install_eggs > 12:35:25 return [self.install_wheel(dist_filename, tmpdir)] > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", > line 1079, in install_wheel > 12:35:25 return self.egg_distribution(destination) > 12:35:25 File > "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37_PR/src/build/gradleenv/1398941891/lib/python3.7/site-packages/setuptools/command/easy_install.py", > line 897, in egg_distribution > 12:35:25 metadata = EggMetadata(zipimport.zipimporter(egg_path)) > 12:35:25 zipimport.ZipImportError: not a Zip file > 12:35:25 ---------------------------------------- > 12:35:25 ERROR: Command errored out with exit status 1: python setup.py > egg_info Check the logs for full command output. > == 3 == > 07:56:50 > Task :sdks:python:test-suites:portable:py2:installGcpTest FAILED > ... > 07:56:50 File > "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py", > line 110, in _install_as_egg > 07:56:50 self._convert_metadata(zf, destination_eggdir, dist_info, > egg_info) > 07:56:50 File > "/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/setuptools/wheel.py", > line 131, in _convert_metadata > 07:56:50 os.mkdir(destination_eggdir) > 07:56:50 OSError: [Errno 17] File exists: > '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Portable_Python_Phrase/src/sdks/python/.eggs/pytest_runner-5.2-py2.7.egg' > 07:56:50 ---------------------------------------- > 07:56:50 ERROR: Command errored out with exit status 1: python setup.py > egg_info Check the logs for full command output. -- This message was sent by Atlassian Jira (v8.3.4#803005)