See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/1718/display/redirect?page=changes>
Changes: [robertwb] [BEAM-8882] Implement Impulse() for BundleBasedRunner. [robertwb] [BEAM-8882] Make Create fn-api agnostic. [robertwb] [BEAM-8882] Fully specify types for Create composite. [robertwb] [BEAM-8882] Make Read fn-api agnostic. [robertwb] [BEAM-8882] Cleanup always-on use_sdf_bounded_source option. [robertwb] [BEAM-8882] Annotate ParDo and CombineValues operations with proto [robertwb] [BEAM-8882] Unconditionally populate pipeline_proto_coder_id. [robertwb] [BEAM-8882] Fix overly-sensitive tests. [robertwb] Fix sdf tests from create. [robertwb] [BEAM-8882] Avoid attaching unrecognized properties. [robertwb] [BEAM-8882] Accommodations for JRH. [robertwb] Minor cleanup. ------------------------------------------ [...truncated 1.55 MB...] 19/12/06 21:10:26 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:88: Status HTTP server running at localhost:38201 19/12/06 21:10:26 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:132: semi_persistent_directory: /tmp 19/12/06 21:10:26 WARN <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:213: No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail. 19/12/06 21:10:26 WARN apache_beam/options/pipeline_options.py:268: Discarding unparseable args: [u'--app_name=test_windowing_1575666623.37_559df4e3-7cea-4b5d-b314-dd2017c85472', u'--job_server_timeout=60', u'--pipeline_type_check', u'--direct_runner_use_stacked_bundle', u'--spark_master=local', u'--options_id=30', u'--enable_spark_metric_sinks'] 19/12/06 21:10:26 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:144: Python sdk harness started with pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 'environment_cache_millis': u'0', 'artifact_port': u'0', 'environment_type': u'PROCESS', 'sdk_location': u'container', 'job_name': u'test_windowing_1575666623.37', 'environment_config': u'{"command": "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',> 'expansion_port': u'0', 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:51251', 'job_port': u'0'} 19/12/06 21:10:26 INFO apache_beam/runners/worker/statecache.py:137: Creating state cache with size 0 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:71: Creating insecure control channel for localhost:33141. 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:79: Control channel established. 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:96: Initializing SDKHarness with unbounded number of workers. 19/12/06 21:10:26 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 259-1 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:449: Creating insecure state channel for localhost:34331. 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:456: State channel established. 19/12/06 21:10:26 INFO apache_beam/runners/worker/data_plane.py:354: Creating client data channel for localhost:41267 19/12/06 21:10:26 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected. 19/12/06 21:10:26 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:process:v1" payload: "\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";> 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:122: No more requests from control plane 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:123: SDK Harness waiting for in-flight requests to complete 19/12/06 21:10:26 INFO apache_beam/runners/worker/data_plane.py:376: Closing all cached grpc data channels. 19/12/06 21:10:26 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:467: Closing all cached gRPC state handlers. 19/12/06 21:10:26 INFO apache_beam/runners/worker/sdk_worker.py:133: Done consuming work. 19/12/06 21:10:26 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:157: Python sdk harness exiting. 19/12/06 21:10:26 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client hanged up. 19/12/06 21:10:26 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:26 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: GetManifest for __no_artifacts_staged__ 19/12/06 21:10:27 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected. 19/12/06 21:10:27 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:106: Logging handler created. 19/12/06 21:10:27 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:88: Status HTTP server running at localhost:35965 19/12/06 21:10:27 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:132: semi_persistent_directory: /tmp 19/12/06 21:10:27 WARN <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:213: No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail. 19/12/06 21:10:27 WARN apache_beam/options/pipeline_options.py:268: Discarding unparseable args: [u'--app_name=test_windowing_1575666623.37_559df4e3-7cea-4b5d-b314-dd2017c85472', u'--job_server_timeout=60', u'--pipeline_type_check', u'--direct_runner_use_stacked_bundle', u'--spark_master=local', u'--options_id=30', u'--enable_spark_metric_sinks'] 19/12/06 21:10:27 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:144: Python sdk harness started with pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 'environment_cache_millis': u'0', 'artifact_port': u'0', 'environment_type': u'PROCESS', 'sdk_location': u'container', 'job_name': u'test_windowing_1575666623.37', 'environment_config': u'{"command": "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',> 'expansion_port': u'0', 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:51251', 'job_port': u'0'} 19/12/06 21:10:27 INFO apache_beam/runners/worker/statecache.py:137: Creating state cache with size 0 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:71: Creating insecure control channel for localhost:42357. 19/12/06 21:10:27 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 260-1 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:79: Control channel established. 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:96: Initializing SDKHarness with unbounded number of workers. 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:449: Creating insecure state channel for localhost:40239. 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:456: State channel established. 19/12/06 21:10:27 INFO apache_beam/runners/worker/data_plane.py:354: Creating client data channel for localhost:36575 19/12/06 21:10:27 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected. 19/12/06 21:10:27 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:process:v1" payload: "\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";> 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:122: No more requests from control plane 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:123: SDK Harness waiting for in-flight requests to complete 19/12/06 21:10:27 INFO apache_beam/runners/worker/data_plane.py:376: Closing all cached grpc data channels. 19/12/06 21:10:27 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:467: Closing all cached gRPC state handlers. 19/12/06 21:10:27 INFO apache_beam/runners/worker/sdk_worker.py:133: Done consuming work. 19/12/06 21:10:27 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:157: Python sdk harness exiting. 19/12/06 21:10:27 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client hanged up. 19/12/06 21:10:27 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:27 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: GetManifest for __no_artifacts_staged__ 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected. 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:106: Logging handler created. 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:88: Status HTTP server running at localhost:40563 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:132: semi_persistent_directory: /tmp 19/12/06 21:10:28 WARN <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:213: No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail. 19/12/06 21:10:28 WARN apache_beam/options/pipeline_options.py:268: Discarding unparseable args: [u'--app_name=test_windowing_1575666623.37_559df4e3-7cea-4b5d-b314-dd2017c85472', u'--job_server_timeout=60', u'--pipeline_type_check', u'--direct_runner_use_stacked_bundle', u'--spark_master=local', u'--options_id=30', u'--enable_spark_metric_sinks'] 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:144: Python sdk harness started with pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 'environment_cache_millis': u'0', 'artifact_port': u'0', 'environment_type': u'PROCESS', 'sdk_location': u'container', 'job_name': u'test_windowing_1575666623.37', 'environment_config': u'{"command": "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',> 'expansion_port': u'0', 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:51251', 'job_port': u'0'} 19/12/06 21:10:28 INFO apache_beam/runners/worker/statecache.py:137: Creating state cache with size 0 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:71: Creating insecure control channel for localhost:34415. 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:79: Control channel established. 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 261-1 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:96: Initializing SDKHarness with unbounded number of workers. 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:449: Creating insecure state channel for localhost:43715. 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:456: State channel established. 19/12/06 21:10:28 INFO apache_beam/runners/worker/data_plane.py:354: Creating client data channel for localhost:37109 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected. 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:process:v1" payload: "\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";> 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:122: No more requests from control plane 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:123: SDK Harness waiting for in-flight requests to complete 19/12/06 21:10:28 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:28 INFO apache_beam/runners/worker/data_plane.py:376: Closing all cached grpc data channels. 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:467: Closing all cached gRPC state handlers. 19/12/06 21:10:28 INFO apache_beam/runners/worker/sdk_worker.py:133: Done consuming work. 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:157: Python sdk harness exiting. 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client hanged up. 19/12/06 21:10:28 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: GetManifest for __no_artifacts_staged__ 19/12/06 21:10:28 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected. 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:106: Logging handler created. 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:88: Status HTTP server running at localhost:34271 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:132: semi_persistent_directory: /tmp 19/12/06 21:10:28 WARN <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:213: No session file found: /tmp/staged/pickled_main_session. Functions defined in __main__ (interactive session) may fail. 19/12/06 21:10:28 WARN apache_beam/options/pipeline_options.py:268: Discarding unparseable args: [u'--app_name=test_windowing_1575666623.37_559df4e3-7cea-4b5d-b314-dd2017c85472', u'--job_server_timeout=60', u'--pipeline_type_check', u'--direct_runner_use_stacked_bundle', u'--spark_master=local', u'--options_id=30', u'--enable_spark_metric_sinks'] 19/12/06 21:10:28 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:144: Python sdk harness started with pipeline_options: {'runner': u'None', 'experiments': [u'beam_fn_api'], 'environment_cache_millis': u'0', 'artifact_port': u'0', 'environment_type': u'PROCESS', 'sdk_location': u'container', 'job_name': u'test_windowing_1575666623.37', 'environment_config': u'{"command": "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh"}',> 'expansion_port': u'0', 'sdk_worker_parallelism': u'1', 'job_endpoint': u'localhost:51251', 'job_port': u'0'} 19/12/06 21:10:29 INFO apache_beam/runners/worker/statecache.py:137: Creating state cache with size 0 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:71: Creating insecure control channel for localhost:41027. 19/12/06 21:10:29 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 262-1 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:79: Control channel established. 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:96: Initializing SDKHarness with unbounded number of workers. 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:449: Creating insecure state channel for localhost:32887. 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:456: State channel established. 19/12/06 21:10:29 INFO apache_beam/runners/worker/data_plane.py:354: Creating client data channel for localhost:34709 19/12/06 21:10:29 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected. 19/12/06 21:10:29 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:process:v1" payload: "\032\202\001<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build/sdk_worker.sh";> 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:122: No more requests from control plane 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:123: SDK Harness waiting for in-flight requests to complete 19/12/06 21:10:29 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:29 INFO apache_beam/runners/worker/data_plane.py:376: Closing all cached grpc data channels. 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:467: Closing all cached gRPC state handlers. 19/12/06 21:10:29 INFO apache_beam/runners/worker/sdk_worker.py:133: Done consuming work. 19/12/06 21:10:29 INFO <https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main.py>:157: Python sdk harness exiting. 19/12/06 21:10:29 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Logging client hanged up. 19/12/06 21:10:29 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint. 19/12/06 21:10:29 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job test_windowing_1575666623.37_559df4e3-7cea-4b5d-b314-dd2017c85472 finished. 19/12/06 21:10:29 WARN org.apache.beam.runners.spark.SparkPipelineResult$BatchMode: Collecting monitoring infos is not implemented yet in Spark portable runner. 19/12/06 21:10:29 WARN org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token {"sessionId":"job_6c5c5016-73d5-4c41-b5ca-6e456a6be577","basePath":"/tmp/sparktest9RLLdl"}: {} java.io.FileNotFoundException: /tmp/sparktest9RLLdl/job_6c5c5016-73d5-4c41-b5ca-6e456a6be577/MANIFEST (No such file or directory) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.<init>(FileInputStream.java:138) at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118) at org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82) at org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252) at org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88) at org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92) at org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63) at org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:201) at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:241) at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48) at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:110) at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:96) at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE . ====================================================================== ERROR: test_pardo_state_with_custom_key_coder (__main__.SparkRunnerTest) Tests that state requests work correctly when the key coder is an ---------------------------------------------------------------------- Traceback (most recent call last): File "apache_beam/runners/portability/portable_runner_test.py", line 231, in test_pardo_state_with_custom_key_coder equal_to(expected)) File "apache_beam/pipeline.py", line 436, in __exit__ self.run().wait_until_finish() File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish for state_response in self._state_stream: File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 395, in next return self._next() File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 552, in _next _common.wait(self._state.condition.wait, _response_ready) File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,> line 140, in wait _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb) File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,> line 105, in _wait_once wait_fn(timeout=timeout) File "/usr/lib/python2.7/threading.py", line 359, in wait _sleep(delay) File "apache_beam/runners/portability/portable_runner_test.py", line 75, in handler raise BaseException(msg) BaseException: Timed out after 60 seconds. ====================================================================== ERROR: test_pardo_timers (__main__.SparkRunnerTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "apache_beam/runners/portability/fn_api_runner_test.py", line 330, in test_pardo_timers assert_that(actual, equal_to(expected)) File "apache_beam/pipeline.py", line 436, in __exit__ self.run().wait_until_finish() File "apache_beam/runners/portability/portable_runner.py", line 428, in wait_until_finish for state_response in self._state_stream: ==================== Timed out after 60 seconds. ==================== File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 395, in next return self._next() File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 552, in _next _common.wait(self._state.condition.wait, _response_ready) # Thread: <Thread(wait_until_finish_read, started daemon 139621433284352)> File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,> line 140, in wait _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb) # Thread: <Thread(Thread-120, started daemon 139621156341504)> File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_common.py";,> line 105, in _wait_once wait_fn(timeout=timeout) File "/usr/lib/python2.7/threading.py", line 359, in wait _sleep(delay) # Thread: <_MainThread(MainThread, started 139621951805184)> ==================== Timed out after 60 seconds. ==================== File "apache_beam/runners/portability/portable_runner_test.py", line 75, in handler raise BaseException(msg) BaseException: Timed out after 60 seconds. # Thread: <Thread(wait_until_finish_read, started daemon 139620528420608)> ====================================================================== ERROR: test_sdf_with_watermark_tracking (__main__.SparkRunnerTest) ---------------------------------------------------------------------- Traceback (most recent call last): # Thread: <Thread(Thread-126, started daemon 139621146113792)> File "apache_beam/runners/portability/fn_api_runner_test.py", line 502, in test_sdf_with_watermark_tracking assert_that(actual, equal_to(list(''.join(data)))) # Thread: <Thread(Thread-120, started daemon 139621156341504)> File "apache_beam/pipeline.py",# Thread: <_MainThread(MainThread, started 139621951805184)> # Thread: <Thread(wait_until_finish_read, started daemon 139621433284352)> line 436, in __exit__ self.run().wait_until_finish() File "apache_beam/runners/portability/portable_runner.py", line 438, in wait_until_finish self._job_id, self._state, self._last_error_message())) RuntimeError: Pipeline test_sdf_with_watermark_tracking_1575666614.49_8ad695cc-bbcd-4006-97ac-8582fc2befb5 failed in state FAILED: java.lang.UnsupportedOperationException: The ActiveBundle does not have a registered bundle checkpoint handler. ---------------------------------------------------------------------- Ran 38 tests in 317.889s FAILED (errors=3, skipped=9) > Task :sdks:python:test-suites:portable:py2:sparkValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 196 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py2:sparkValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 47s 60 actionable tasks: 47 executed, 13 from cache Publishing build scan... https://scans.gradle.com/s/3zjrh3xuz3wdg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org
