See <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/573/display/redirect?page=changes>
Changes: [github] [BEAM-5605] Convert all BoundedSources to SplittableDoFns when using ------------------------------------------ [...truncated 32.40 KB...] Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting py<2,>=1.4.17 Using cached py-1.8.1-py2.py3-none-any.whl (83 kB) Collecting toml>=0.9.4 Using cached toml-0.10.0-py2.py3-none-any.whl (25 kB) Requirement already satisfied, skipping upgrade: setuptools>=30.0.0 in <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from tox==3.11.1) (44.0.0) Collecting grpcio>=1.14.2 Using cached grpcio-1.27.1-cp27-cp27mu-manylinux2010_x86_64.whl (21.1 MB) Collecting protobuf>=3.5.0.post1 Using cached protobuf-3.11.3-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB) Processing /home/jenkins/.cache/pip/wheels/0c/88/ac/41500883ea902d3409a83a827870a726346b5ebfd0523e91df/distlib-0.3.0-py2-none-any.whl Collecting importlib-resources<2,>=1.0; python_version < "3.7" Using cached importlib_resources-1.0.2-py2.py3-none-any.whl (32 kB) Collecting pathlib2<3,>=2.3.3; python_version < "3.4" and sys_platform != "win32" Using cached pathlib2-2.3.5-py2.py3-none-any.whl (18 kB) Collecting contextlib2<1,>=0.6.0; python_version < "3.3" Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB) Collecting appdirs<2,>=1.4.3 Using cached appdirs-1.4.3-py2.py3-none-any.whl (12 kB) Collecting importlib-metadata<2,>=0.12; python_version < "3.8" Using cached importlib_metadata-1.5.0-py2.py3-none-any.whl (30 kB) Collecting enum34>=1.0.4; python_version < "3.4" Using cached enum34-1.1.6-py2-none-any.whl (12 kB) Collecting futures>=2.2.0; python_version < "3.2" Using cached futures-3.3.0-py2-none-any.whl (16 kB) Collecting typing; python_version < "3.5" Using cached typing-3.7.4.1-py2-none-any.whl (26 kB) Processing /home/jenkins/.cache/pip/wheels/91/95/75/19c98a91239878abbc7c59970abd3b4e0438a7dd5b61778335/scandir-1.10.0-cp27-cp27mu-linux_x86_64.whl Collecting zipp>=0.5 Using cached zipp-1.1.0-py2.py3-none-any.whl (4.6 kB) Collecting configparser>=3.5; python_version < "3" Using cached configparser-4.0.2-py2.py3-none-any.whl (22 kB) Installing collected packages: six, filelock, distlib, scandir, pathlib2, typing, importlib-resources, contextlib2, appdirs, zipp, configparser, importlib-metadata, virtualenv, pluggy, py, toml, tox, enum34, futures, grpcio, protobuf, grpcio-tools, future > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto] > Task :vendor:sdks-java-extensions-protobuf:compileJava FROM-CACHE > Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :vendor:sdks-java-extensions-protobuf:shadowJar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:fn-execution:jar > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:python:setupVirtualenv Successfully installed appdirs-1.4.3 configparser-4.0.2 contextlib2-0.6.0.post1 distlib-0.3.0 enum34-1.1.6 filelock-3.0.12 future-0.16.0 futures-3.3.0 grpcio-1.27.1 grpcio-tools-1.14.2 importlib-metadata-1.5.0 importlib-resources-1.0.2 pathlib2-2.3.5 pluggy-0.13.1 protobuf-3.11.3 py-1.8.1 scandir-1.10.0 six-1.14.0 toml-0.10.0 tox-3.11.1 typing-3.7.4.1 virtualenv-20.0.3 zipp-1.1.0 > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug] Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='a032972e28060ca4f5644acffae3dfc268cc09db', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] Resolving golang.org/x/sys: commit='37707fdb30a5b38865cfb95e5aab41707daec7fd', urls=[https://go.googlesource.com/sys] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, g...@github.com:coreos/etcd.git] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, g...@github.com:coreos/etcd.git] > Task :sdks:java:harness:shadowJar > Task :sdks:python:sdist setup.py:245: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.20.0.dev' to '2.20.0.dev0' normalized_version, beam_fn_api.proto: warning: Import google/protobuf/descriptor.proto but not used. beam_fn_api.proto: warning: Import google/protobuf/wrappers.proto but not used. DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support Requirement already satisfied: future==0.16.0 in <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (0.16.0) root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: Skipping optional fixer: idioms root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: Skipping optional fixer: ws_comma root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt root: Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: No changes to <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: No changes to <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: Refactored <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> RefactoringTool: Files that were modified: RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:container:py37:copyDockerfileDependencies > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :runners:spark:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:classes > Task :runners:spark:jar > Task :runners:spark:job-server:compileJava NO-SOURCE > Task :runners:spark:job-server:classes UP-TO-DATE > Task :runners:spark:job-server:shadowJar > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, g...@github.com:coreos/etcd.git] Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, g...@github.com:coreos/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:container:resolveBuildDependencies Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/sdks/go> > Task :sdks:python:container:installDependencies > Task :sdks:python:container:buildDarwinAmd64 > Task :sdks:python:container:buildLinuxAmd64 > Task :sdks:python:container:goBuild > Task :sdks:python:container:py37:copyLauncherDependencies > Task :sdks:python:container:py37:dockerPrepare > Task :sdks:python:container:py37:docker > Task :runners:spark:job-server:testJavaJarCreatorPy37 FAILED sh: 1: ./test_spark_pipeline_jar.sh: not found FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_PortableJar_Spark/ws/src/runners/spark/job-server/build.gradle'> line: 159 * What went wrong: Execution failed for task ':runners:spark:job-server:testJavaJarCreatorPy37'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 54s 62 actionable tasks: 49 executed, 12 from cache, 1 up-to-date Publishing build scan... https://gradle.com/s/lbnso6iv6dgxu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org