See <https://builds.apache.org/job/beam_Release_NightlySnapshot/428/display/redirect?page=changes>
Changes: [hepei.hp] fix FlinkAccumulatorCombiningStateWithContext read null accum bug [tgroh] Visit a Transform Hierarchy in Topological Order [tgroh] Update Apex Overrides [tgroh] Roll-forward Include Additional PTransform inputs in Transform Nodes [klk] Mark CombineFnWithContext StateSpecs internal [klk] Allow translation to throw IOException [klk] Flesh out TimerSpec and StateSpec in Runner API [klk] Add case dispatch to StateSpec [klk] Make Java serialized CombineFn URN public [klk] Implement TimerSpec and StateSpec translation [tgroh] Revert "Roll-forward Include Additional PTransform inputs in Transform [tgroh] Revert "Visit a Transform Hierarchy in Topological Order" [dhalperi] [BEAM-1542] SpannerIO sink updates [robertwb] [BEAM-2366] Don't try to pickle gen_protos in tests. [tgroh] Add Missing Space in DataflowMetrics [dhalperi] [BEAM-2372] Only run Apache RAT at root pom.xml [lcwik] [BEAM-2369] HadoopFileSystem: prevent NPE on match of non existing file [robertwb] [BEAM-2365] Use the highest pickle protocol available. [chamikara] Fix Python Dataflow execution errors due to #3223 ------------------------------------------ [...truncated 3.20 MB...] cm.exception.message, ok test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok test_simple (apache_beam.pipeline_test.RunnerApiTest) Tests serializing, deserializing, and running a simple pipeline. ... ok test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok test_file_checksum_matchcer_invalid_sleep_time (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... <https://builds.apache.org/job/beam_Release_NightlySnapshot/ws/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:129: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6 self.assertEqual(cm.exception.message, ok test_file_checksum_matcher_read_failed (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_file_checksum_matcher_service_error (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_file_checksum_matcher_sleep_before_verify (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_file_checksum_matcher_success (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok test_pipeline_state_matcher_fails (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) Test PipelineStateMatcher fails when using default expected state ... ok test_pipeline_state_matcher_given_state (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) Test PipelineStateMatcher successes when matches given state ... ok test_pipeline_state_matcher_success (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) Test PipelineStateMatcher successes when using default expected state ... ok test_append_extra_options (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok test_append_verifier_in_extra_opt (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok test_create_test_pipeline_options (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok test_empty_option_args_parsing (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok test_get_option (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok test_option_args_parsing (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok test_skip_IT (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... SKIP: IT is skipped because --test-pipeline-options is not specified test_basic_test_stream (apache_beam.testing.test_stream_test.TestStreamTest) ... ok test_test_stream_errors (apache_beam.testing.test_stream_test.TestStreamTest) ... ok test_assert_that_fails (apache_beam.testing.util_test.UtilTest) ... ok test_assert_that_fails_on_empty_expected (apache_beam.testing.util_test.UtilTest) ... ok test_assert_that_fails_on_empty_input (apache_beam.testing.util_test.UtilTest) ... ok test_assert_that_passes (apache_beam.testing.util_test.UtilTest) ... ok ---------------------------------------------------------------------- Ran 1184 tests in 133.376s OK (skipped=17) ___________________________________ summary ____________________________________ ERROR: docs: commands failed lint: commands succeeded py27: commands succeeded py27cython: commands succeeded py27gcp: commands succeeded 2017-05-27T07:52:50.082 [ERROR] Command execution failed. org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:764) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:711) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:289) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.jvnet.hudson.maven3.launcher.Maven33Launcher.main(Maven33Launcher.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238) at jenkins.maven3.agent.Maven33Main.launch(Maven33Main.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at hudson.maven.Maven3Builder.call(Maven3Builder.java:139) at hudson.maven.Maven3Builder.call(Maven3Builder.java:70) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled [JENKINS] Archiving disabled2017-05-27T07:53:11.678 [INFO] ------------------------------------------------------------------------ 2017-05-27T07:53:11.678 [INFO] Reactor Summary: 2017-05-27T07:53:11.678 [INFO] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: Parent .............................. SUCCESS [ 40.703 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 13.325 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 6.170 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Common ...................... SUCCESS [ 3.287 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Common :: Fn API ............ SUCCESS [ 22.175 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Common :: Runner API ........ SUCCESS [ 17.521 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 3.392 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [02:20 min] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 3.517 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 9.621 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: Runners ............................. SUCCESS [ 3.438 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 30.582 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 47.928 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [03:05 min] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 40.848 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 4.115 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 37.793 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 22.125 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [01:10 min] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 25.239 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 35.080 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop ........ SUCCESS [ 5.940 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop :: input-format SUCCESS [ 23.461 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [05:24 min] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop :: jdk1.8-tests SUCCESS [01:10 min] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [01:07 min] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 31.088 s] 2017-05-27T07:53:11.678 [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 24.493 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 26.282 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 25.562 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 33.108 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 23.511 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 26.704 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 3.033 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 17.507 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: Examples ............................ SUCCESS [ 3.868 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: Examples :: Java .................... SUCCESS [06:18 min] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 30.800 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: Examples :: Java 8 .................. SUCCESS [ 22.771 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples - Java 8 SUCCESS [ 28.988 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 18.760 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 19.454 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 33.866 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 37.557 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Java 8 Tests ........ SUCCESS [ 14.710 s] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [16:19 min] 2017-05-27T07:53:11.679 [INFO] Apache Beam :: Runners :: Flink .................... SKIPPED 2017-05-27T07:53:11.679 [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED 2017-05-27T07:53:11.679 [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED 2017-05-27T07:53:11.679 [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED 2017-05-27T07:53:11.679 [INFO] ------------------------------------------------------------------------ 2017-05-27T07:53:11.679 [INFO] BUILD FAILURE 2017-05-27T07:53:11.679 [INFO] ------------------------------------------------------------------------ 2017-05-27T07:53:11.679 [INFO] Total time: 51:36 min 2017-05-27T07:53:11.679 [INFO] Finished at: 2017-05-27T07:53:11+00:00 2017-05-27T07:53:12.406 [INFO] Final Memory: 271M/2108M 2017-05-27T07:53:12.407 [INFO] ------------------------------------------------------------------------ Waiting for Jenkins to finish collecting data 2017-05-27T07:53:51.513 [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-test) on project beam-sdks-python: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-test) on project beam-sdks-python: Command execution failed. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.jvnet.hudson.maven3.launcher.Maven33Launcher.main(Maven33Launcher.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238) at jenkins.maven3.agent.Maven33Main.launch(Maven33Main.java:176) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at hudson.maven.Maven3Builder.call(Maven3Builder.java:139) at hudson.maven.Maven3Builder.call(Maven3Builder.java:70) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed. at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:302) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) ... 31 more Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:764) at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:711) at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:289) ... 33 more 2017-05-27T07:53:51.514 [ERROR] 2017-05-27T07:53:51.514 [ERROR] Re-run Maven using the -X switch to enable full debug logging. 2017-05-27T07:53:51.514 [ERROR] 2017-05-27T07:53:51.514 [ERROR] For more information about the errors and possible solutions, please read the following articles: 2017-05-27T07:53:51.514 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException 2017-05-27T07:53:51.514 [ERROR] 2017-05-27T07:53:51.514 [ERROR] After correcting the problems, you can resume the build with the command 2017-05-27T07:53:51.514 [ERROR] mvn <goals> -rf :beam-sdks-python channel stopped Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
