See <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/75/display/redirect?page=changes>
Changes: [je.ik] [BEAM-9273] Explicitly disable @RequiresTimeSortedInput on unsupported [je.ik] [BEAM-9273] code review - to be squashed [iemejia] Pin Avro dependency in Python SDK to be consistent with Avro versioning [iemejia] [BEAM-6857] Classify unbounded dynamic timers tests in the [iemejia] [BEAM-9315] Allow multiple paths via HADOOP_CONF_DIR in [github] Update container images used by Dataflow runner with unreleased SDKs. ------------------------------------------ [...truncated 564.90 KB...] h5py==2.10.0 hdfs==2.5.6 httplib2==0.12.0 idna==2.8 Keras-Applications==1.0.8 Keras-Preprocessing==1.1.0 Markdown==3.1.1 mock==2.0.0 monotonic==1.5 nose==1.3.7 numpy==1.16.4 oauth2client==3.0.0 oauthlib==3.1.0 opt-einsum==2.3.2 pandas==0.24.2 pbr==5.4.4 pip==20.0.2 proto-google-cloud-datastore-v1==0.90.4 protobuf==3.9.0 protorpc==0.12.0 pyarrow==0.15.1 pyasn1==0.4.8 pyasn1-modules==0.2.8 pydot==1.4.1 PyHamcrest==1.10.1 pymongo==3.8.0 pyparsing==2.4.6 python-dateutil==2.8.1 python-gflags==3.0.6 python-snappy==0.5.4 pytz==2019.1 PyVCF==0.6.8 PyYAML==5.1 requests==2.22.0 requests-oauthlib==1.3.0 rsa==4.0 scipy==1.2.2 setuptools==44.0.0 six==1.14.0 tenacity==6.0.0 tensorboard==2.1.0 tensorflow==2.1.0 tensorflow-estimator==2.1.0 termcolor==1.1.0 typing==3.7.4.1 typing-extensions==3.7.4.1 urllib3==1.25.8 virtualenv==16.7.9 Werkzeug==1.0.0 wheel==0.34.2 wrapt==1.11.2 Removing intermediate container c733f5a34a90 ---> 66f260744a81 Step 12/15 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/ ---> 03ac6140efe3 Step 13/15 : COPY target/LICENSE /opt/apache/beam/ ---> 86257d92a4ad Step 14/15 : COPY target/NOTICE /opt/apache/beam/ ---> 75968c7ff628 Step 15/15 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 617e8646b783 Removing intermediate container 617e8646b783 ---> 96075c205809 Successfully built 96075c205809 Successfully tagged apachebeam/python2.7_sdk:2.20.0.dev > Task :runners:spark:job-server:validatesCrossLanguageRunnerSetup > Task :runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingJava org.apache.beam.runners.core.construction.ExternalTest > expandMultiOutputTest FAILED java.lang.RuntimeException at ExternalTest.java:91 org.apache.beam.runners.core.construction.ExternalTest > expandMultipleTest FAILED java.lang.RuntimeException at ExternalTest.java:91 org.apache.beam.runners.core.construction.ExternalTest > expandSingleTest FAILED java.lang.RuntimeException at ExternalTest.java:91 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combineGloballyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > partitionTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 11 tests completed, 11 failed > Task :runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingJava > FAILED > Task :runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingPython org.apache.beam.runners.core.construction.ExternalTest > expandMultiOutputTest FAILED java.lang.RuntimeException at ExternalTest.java:91 org.apache.beam.runners.core.construction.ExternalTest > expandMultipleTest FAILED java.lang.RuntimeException at ExternalTest.java:91 org.apache.beam.runners.core.construction.ExternalTest > expandSingleTest FAILED java.lang.RuntimeException at ExternalTest.java:91 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combineGloballyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > partitionTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > coGroupByKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > groupByKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > combinePerKeyTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > flattenTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > singleInputOutputTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 org.apache.beam.runners.core.construction.ValidateRunnerXlangTest > multiInputOutputWithSideInputTest FAILED java.lang.RuntimeException at ValidateRunnerXlangTest.java:98 11 tests completed, 11 failed > Task :runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingPython > FAILED > Task :runners:spark:job-server:validatesCrossLanguageRunnerPythonUsingJava setup.py:249: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.20.0.dev' to '2.20.0.dev0' normalized_version, warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:541: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. for spec in yaml.load_all(open(transcript_filename)): test_generate_sequence (apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest) ... ok test_write (apache_beam.io.external.xlang_parquetio_test.XlangParquetIOTest) ... ok test_cogroup_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_combine_globally (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_combine_per_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_flatten (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_group_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_multi_input_output_with_sideinput (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_partition (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_prefix (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok ---------------------------------------------------------------------- XML: nosetests-xlangValidateRunner.xml ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 10 tests in 190.377s OK > Task :runners:spark:job-server:validatesCrossLanguageRunnerPythonUsingPython setup.py:249: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.20.0.dev' to '2.20.0.dev0' normalized_version, warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:541: YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. for spec in yaml.load_all(open(transcript_filename)): test_generate_sequence (apache_beam.io.external.generate_sequence_test.XlangGenerateSequenceTest) ... ok test_write (apache_beam.io.external.xlang_parquetio_test.XlangParquetIOTest) ... ok test_cogroup_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_combine_globally (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_combine_per_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_flatten (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_group_by_key (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_multi_input_output_with_sideinput (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_partition (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok test_prefix (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... ok ---------------------------------------------------------------------- XML: nosetests-xlangValidateRunner.xml ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 10 tests in 120.413s OK > Task :runners:spark:job-server:validatesCrossLanguageRunnerCleanup > Task :runners:spark:job-server:sparkJobServerCleanup FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingJava'. > There were failing tests. See the report at: > file://<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:job-server:validatesCrossLanguageRunnerJavaUsingPython'. > There were failing tests. See the report at: > file://<https://builds.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 19m 43s 102 actionable tasks: 96 executed, 4 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/oyed7tcr4evag Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org