See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/1122/display/redirect?page=changes>
Changes: [ehudm] Make with_attributes kwarg optional. [ehudm] Add decode and encode steps to streaming_wordcount [qinyeli] Interactive Beam -- display update [ehudm] Fix PubSubMessageMatcher not acking messages. [pablo] Add GitScm poll trigger for post-commit tests. ------------------------------------------ [...truncated 20.86 MB...] Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.391Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Flatten.Iterables/FlattenIterables/FlatMap into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Values/Values/Map Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.469Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Values/Values/Map into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Extract Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.511Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForKey) into SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Read Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.609Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Extract into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.651Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/WithKeys/AddKeys/Map into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/ParDo(CollectWindows) Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.738Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Read Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.785Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Write mutations to Spanner into SpannerIO.Write/Write mutations to Cloud Spanner/Batch mutations together Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.884Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Reify into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Partial Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:44.953Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Partial into SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/WithKeys/AddKeys/Map Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.022Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Reify into SpannerIO.Write/Write mutations to Cloud Spanner/Partition input Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.065Z: Fusing consumer SpannerIO.Write/To mutation group into ParDo(GenerateMutations) Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.148Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/GroupByWindow into SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Read Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.196Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Write into SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Reify Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.288Z: Fusing consumer SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForSize) into SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Read Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.928Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:45.964Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.002Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.039Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.076Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.115Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.148Z: Starting 1 workers in us-central1-b... Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.148Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.176Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Create Jul 31, 2018 12:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:46.612Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(GenerateMutations)+SpannerIO.Write/To mutation group+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/ParDo(CollectWindows)+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/WithKeys/AddKeys/Map+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Partial+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Reify+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Write Jul 31, 2018 12:49:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:48:59.729Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). Jul 31, 2018 12:49:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:10.295Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). Jul 31, 2018 12:49:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:10.346Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. Jul 31, 2018 12:49:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:25.674Z: Workers have started successfully. Jul 31, 2018 12:49:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:48.135Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Close Jul 31, 2018 12:49:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:48.226Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/GroupByKey/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Combine.perKey(SampleAny)/Combine.GroupedValues/Extract+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Combine.globally(SampleAny)/Values/Values/Map+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/Sample.Any/Flatten.Iterables/FlattenIterables/FlatMap+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/View.AsList/ParDo(ToIsmRecordForGlobalWindow) Jul 31, 2018 12:49:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:57.173Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/To wait view 0/View.AsList/CreateDataflowView Jul 31, 2018 12:49:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:49:57.374Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Create seed/Read(CreateSource)+SpannerIO.Write/Write mutations to Cloud Spanner/Wait.OnSignal/Wait/Map+SpannerIO.Write/Write mutations to Cloud Spanner/Read information schema+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write Jul 31, 2018 12:50:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:05.419Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close Jul 31, 2018 12:50:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:05.523Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write Jul 31, 2018 12:50:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:11.897Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close Jul 31, 2018 12:50:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:11.976Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) Jul 31, 2018 12:50:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:20.558Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Schema View/Combine.GloballyAsSingletonView/CreateDataflowView Jul 31, 2018 12:50:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:20.802Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Serialize mutations+SpannerIO.Write/Write mutations to Cloud Spanner/Extract keys+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Partial+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Reify+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Write Jul 31, 2018 12:50:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:31.761Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Close Jul 31, 2018 12:50:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:31.880Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/GroupByKey/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues+SpannerIO.Write/Write mutations to Cloud Spanner/Sample keys/Combine.GroupedValues/Extract+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow)+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write Jul 31, 2018 12:50:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:36.385Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close Jul 31, 2018 12:50:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:36.497Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParMultiDo(ToIsmRecordForMapLike)+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Write+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Write Jul 31, 2018 12:50:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:44.780Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Close Jul 31, 2018 12:50:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:44.818Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Close Jul 31, 2018 12:50:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:44.880Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForSize) Jul 31, 2018 12:50:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:44.919Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/ParDo(ToIsmMetadataRecordForKey) Jul 31, 2018 12:51:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:59.273Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/Flatten.PCollections Jul 31, 2018 12:51:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:59.503Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample as view/CreateDataflowView Jul 31, 2018 12:51:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:50:59.690Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Partition input+SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Reify+SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Write Jul 31, 2018 12:51:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:51:08.978Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Close Jul 31, 2018 12:51:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:51:09.089Z: Executing operation SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Group by partition/GroupByWindow+SpannerIO.Write/Write mutations to Cloud Spanner/Batch mutations together+SpannerIO.Write/Write mutations to Cloud Spanner/Write mutations to Spanner Jul 31, 2018 12:51:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:51:16.568Z: Cleaning up. Jul 31, 2018 12:51:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:51:16.772Z: Stopping worker pool... Jul 31, 2018 12:53:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:53:09.749Z: Autoscaling: Resized worker pool from 1 to 0. Jul 31, 2018 12:53:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process INFO: 2018-07-31T00:53:09.801Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. Jul 31, 2018 12:53:19 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-07-30_17_48_34-5719402541507531825 finished with status DONE. Jul 31, 2018 12:53:19 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess INFO: Success result for Dataflow job 2018-07-30_17_48_34-5719402541507531825. Found 0 success, 0 failures out of 0 expected assertions. Jul 31, 2018 12:53:19 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish INFO: Job 2018-07-30_17_48_34-5719402541507531825 finished with status DONE. Gradle Test Executor 143 finished executing tests. > Task > :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest Finished generating test XML results (0.024 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest> Generating HTML test report... Finished generating test html results (0.024 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest> Packing task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest' :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 34 mins 5.193 secs. :beam-runners-google-cloud-dataflow-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java:buildDependents Caching disabled for task ':beam-runners-google-cloud-dataflow-java:buildDependents': Caching has not been enabled for the task Task ':beam-runners-google-cloud-dataflow-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-google-cloud-dataflow-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.001 secs. :beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started. :beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':' Thread 9,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java:postCommit Skipping task ':beam-runners-google-cloud-dataflow-java:postCommit' as it has no actions. > Task :beam-sdks-java-io-google-cloud-platform:buildDependents Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-google-cloud-dataflow-java:postCommit (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs. :beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs. :beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started. :beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started. > Task :beam-sdks-java-extensions-protobuf:buildDependents Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs. > Task :beam-runners-direct-java:buildDependents Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task Task ':beam-runners-direct-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.001 secs. :beam-runners-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started. :beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started. > Task :beam-runners-java-fn-execution:buildDependents Caching disabled for task ':beam-runners-java-fn-execution:buildDependents': Caching has not been enabled for the task Task ':beam-runners-java-fn-execution:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs. :beam-sdks-java-harness:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started. :beam-vendor-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started. > Task :beam-runners-local-java-core:buildDependents Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs. > Task :beam-sdks-java-harness:buildDependents Caching disabled for task ':beam-sdks-java-harness:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-harness:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-harness:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs. > Task :beam-vendor-sdks-java-extensions-protobuf:buildDependents Caching disabled for task ':beam-vendor-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task Task ':beam-vendor-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-vendor-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs. :beam-runners-core-java:buildDependents (Thread[Task worker for ':',5,main]) started. :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started. :beam-sdks-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-runners-core-java:buildDependents Caching disabled for task ':beam-runners-core-java:buildDependents': Caching has not been enabled for the task Task ':beam-runners-core-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-core-java:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs. > Task :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs. > Task :beam-sdks-java-fn-execution:buildDependents Caching disabled for task ':beam-sdks-java-fn-execution:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-fn-execution:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs. :beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':',5,main]) started. > Task :beam-runners-core-construction-java:buildDependents Caching disabled for task ':beam-runners-core-construction-java:buildDependents': Caching has not been enabled for the task Task ':beam-runners-core-construction-java:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs. :beam-sdks-java-core:buildDependents (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-java-core:buildDependents Caching disabled for task ':beam-sdks-java-core:buildDependents': Caching has not been enabled for the task Task ':beam-sdks-java-core:buildDependents' is not up-to-date because: Task has not declared any outputs despite executing actions. :beam-sdks-java-core:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs. :javaPreCommit (Thread[Task worker for ':',5,main]) started. > Task :javaPreCommit Skipping task ':javaPreCommit' as it has no actions. :javaPreCommit (Thread[Task worker for ':',5,main]) completed. Took 0.002 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':beam-sdks-java-extensions-sql:integrationTest'. > There were failing tests. See the report at: > file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/extensions/sql/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. See https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 53m 11s 753 actionable tasks: 735 executed, 18 from cache Publishing build scan... https://gradle.com/s/j7tpfp2fmmpgi Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure