See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/125/display/redirect?page=changes>
Changes: [klk] Add test for a trigger with windowed SQL query [klk] Increase whitelist of false detections in SdkCoreApiSurfaceTest [klk] Eliminate beam-model-fn-execution test-jar deps [klk] Eliminate beam-sdks-java-fn-execution test-jar deps [klk] Eliminate incorrect sdks-java-core test-jar deps [klk] Notate uses of beam-runners-core-java test-jar [aljoscha.krettek] Annotate ParDoTest.duplicateTimerSetting with UsesTestStream ------------------------------------------ [...truncated 2.51 MB...] INFO: Finished task 3.0 in stage 2.0 (TID 11) in 97 ms on localhost (executor driver) (4/8) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Running task 7.0 in stage 2.0 (TID 15) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Getting 0 non-empty blocks out of 4 blocks Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Started 0 remote fetches in 1 ms Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Getting 0 non-empty blocks out of 4 blocks Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Started 0 remote fetches in 0 ms Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Getting 0 non-empty blocks out of 4 blocks Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Started 0 remote fetches in 0 ms Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Getting 0 non-empty blocks out of 4 blocks Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Started 0 remote fetches in 0 ms Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Block rdd_41_5 stored as values in memory (estimated size 16.0 B, free 1825.1 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Block rdd_41_6 stored as values in memory (estimated size 16.0 B, free 1825.1 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Block rdd_41_4 stored as values in memory (estimated size 16.0 B, free 1825.1 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Added rdd_41_5 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Added rdd_41_6 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Added rdd_41_4 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 6.0 in stage 2.0 (TID 14). 11942 bytes result sent to driver Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Block rdd_41_7 stored as values in memory (estimated size 16.0 B, free 1825.1 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Added rdd_41_7 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 6.0 in stage 2.0 (TID 14) in 119 ms on localhost (executor driver) (5/8) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 7.0 in stage 2.0 (TID 15). 11942 bytes result sent to driver Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 5.0 in stage 2.0 (TID 13). 11942 bytes result sent to driver Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 4.0 in stage 2.0 (TID 12). 11942 bytes result sent to driver Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 7.0 in stage 2.0 (TID 15) in 116 ms on localhost (executor driver) (6/8) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 5.0 in stage 2.0 (TID 13) in 139 ms on localhost (executor driver) (7/8) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 4.0 in stage 2.0 (TID 12) in 140 ms on localhost (executor driver) (8/8) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Removed TaskSet 2.0, whose tasks have all completed, from pool Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: ResultStage 2 (collect at BoundedDataset.java:87) finished in 0.213 s Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Job 0 finished: collect at BoundedDataset.java:87, took 3.736539 s Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator enterCompositeTransform INFO: Entering directly-translatable composite transform: 'WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values' Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform INFO: Evaluating Create.Values Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform INFO: Evaluating org.apache.beam.sdk.transforms.Reify$ReifyView$1@61d37daf Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Block broadcast_3 stored as values in memory (estimated size 672.0 B, free 1825.1 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 361.0 B, free 1825.1 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Added broadcast_3_piece0 in memory on 127.0.0.1:43056 (size: 361.0 B, free: 1825.4 MB) Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo INFO: Created broadcast 3 from broadcast at SideInputBroadcast.java:59 Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform INFO: Evaluating org.apache.beam.sdk.transforms.MapElements$1@5d576d2c Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform INFO: Evaluating org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn@1370d37 Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Starting job: foreach at BoundedDataset.java:117 Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Got job 1 (foreach at BoundedDataset.java:117) with 4 output partitions Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Final stage: ResultStage 3 (foreach at BoundedDataset.java:117) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Parents of final stage: List() Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Missing parents: List() Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Submitting ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400), which has no missing parents Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Block broadcast_4 stored as values in memory (estimated size 84.1 KB, free 1825.0 MB) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 22.4 KB, free 1825.0 MB) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Added broadcast_4_piece0 in memory on 127.0.0.1:43056 (size: 22.4 KB, free: 1825.3 MB) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1006 Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Submitting 4 missing tasks from ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400) (first 15 tasks are for partitions Vector(0, 1, 2, 3)) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Adding task set 3.0 with 4 tasks Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Starting task 0.0 in stage 3.0 (TID 16, localhost, executor driver, partition 0, PROCESS_LOCAL, 4827 bytes) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Starting task 1.0 in stage 3.0 (TID 17, localhost, executor driver, partition 1, PROCESS_LOCAL, 4827 bytes) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver, partition 2, PROCESS_LOCAL, 4827 bytes) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver, partition 3, PROCESS_LOCAL, 4837 bytes) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Running task 0.0 in stage 3.0 (TID 16) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Running task 2.0 in stage 3.0 (TID 18) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Running task 3.0 in stage 3.0 (TID 19) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Running task 1.0 in stage 3.0 (TID 17) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 0.0 in stage 3.0 (TID 16). 12141 bytes result sent to driver Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 2.0 in stage 3.0 (TID 18). 12141 bytes result sent to driver Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 1.0 in stage 3.0 (TID 17). 12141 bytes result sent to driver Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 1.0 in stage 3.0 (TID 17) in 69 ms on localhost (executor driver) (1/4) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 0.0 in stage 3.0 (TID 16) in 74 ms on localhost (executor driver) (2/4) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 2.0 in stage 3.0 (TID 18) in 71 ms on localhost (executor driver) (3/4) Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process INFO: Finalizing 4 file results Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation createMissingEmptyShards INFO: Finalizing for destination null num shards 4. Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0ec0e93d-ebf8-4f4c-99d7-9671fca91dac, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00000-of-00004 Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0270a536-27ac-415c-9369-36a9e198a353, shard=1, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00001-of-00004 Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f3d519be-0eca-4c79-8c19-0b77ce2e796a, shard=2, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00002-of-00004 Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f08d3712-3c45-405f-aa28-48506fefe473, shard=3, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00003-of-00004 Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0270a536-27ac-415c-9369-36a9e198a353 Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0ec0e93d-ebf8-4f4c-99d7-9671fca91dac Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f3d519be-0eca-4c79-8c19-0b77ce2e796a Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles INFO: Will remove known temporary file /tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f08d3712-3c45-405f-aa28-48506fefe473 Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 3.0 in stage 3.0 (TID 19). 15889 bytes result sent to driver Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Finished task 3.0 in stage 3.0 (TID 19) in 126 ms on localhost (executor driver) (4/4) Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Removed TaskSet 3.0, whose tasks have all completed, from pool Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.131 s Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Job 1 finished: foreach at BoundedDataset.java:117, took 0.162042 s Mar 13, 2018 11:05:15 AM org.apache.beam.runners.spark.SparkRunner lambda$run$1 INFO: Batch pipeline execution complete. Mar 13, 2018 11:05:15 AM org.spark_project.jetty.server.AbstractConnector doStop INFO: Stopped Spark@286b159{HTTP/1.1,[http/1.1]}{127.0.0.1:4040} Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Stopped Spark web UI at http://127.0.0.1:4040 Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: MapOutputTrackerMasterEndpoint stopped! Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: MemoryStore cleared Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: BlockManager stopped Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: BlockManagerMaster stopped Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: OutputCommitCoordinator stopped! Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo INFO: Successfully stopped SparkContext [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:43 min [INFO] Finished at: 2018-03-13T11:05:15Z [INFO] Final Memory: 97M/1279M [INFO] ------------------------------------------------------------------------ grep Foundation counts* counts-00000-of-00004:Foundation: 1 Verified Foundation: 1 [SUCCESS] Mar 13, 2018 11:05:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:19.869Z: (b39923b0aea5cf7f): Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close Mar 13, 2018 11:05:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:19.939Z: (b39923b0aea5c957): Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create Mar 13, 2018 11:05:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:20.081Z: (b39923b0aea5c8e0): Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+MapElements/Map+WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write Mar 13, 2018 11:05:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:30.987Z: (50b9103aebfec0d2): Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close Mar 13, 2018 11:05:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:31.045Z: (b39923b0aea5c7f2): Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow) Mar 13, 2018 11:05:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:33.503Z: Executing operation s12-u31 Mar 13, 2018 11:05:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:33.794Z: Executing operation WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView Mar 13, 2018 11:05:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:33.976Z: Executing operation WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize Mar 13, 2018 11:05:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:36.187Z: (e8ec32395c826f3f): Cleaning up. Mar 13, 2018 11:05:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:05:36.271Z: (e8ec32395c82624d): Stopping worker pool... Mar 13, 2018 11:08:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:07:59.824Z: (caf4e46451e0aa7c): Autoscaling: Resized worker pool from 1 to 0. Mar 13, 2018 11:08:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-03-13T11:07:59.845Z: (caf4e46451e0a862): Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. Mar 13, 2018 11:08:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-03-13_04_03_11-14329802875283228269 finished with status DONE. [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 06:13 min [INFO] Finished at: 2018-03-13T11:08:07Z [INFO] Final Memory: 53M/914M [INFO] ------------------------------------------------------------------------ gsutil cat gs://temp-storage-for-release-validation-tests/quickstart/count* | grep Montague: Montague: 47 Verified Montague: 47 gsutil rm gs://temp-storage-for-release-validation-tests/quickstart/count* Removing gs://temp-storage-for-release-validation-tests/quickstart/counts-00000-of-00003... / [1 objects] Removing gs://temp-storage-for-release-validation-tests/quickstart/counts-00001-of-00003... / [2 objects] Removing gs://temp-storage-for-release-validation-tests/quickstart/counts-00002-of-00003... / [3 objects] Operation completed over 3 objects. [SUCCESS] FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:apex:runQuickstartJavaApex'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 7m 8s 6 actionable tasks: 6 executed Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure Not sending mail to unregistered user aljoscha.kret...@gmail.com Not sending mail to unregistered user k...@google.com