See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/111/display/redirect>
------------------------------------------ [...truncated 580.85 KB...] Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run INFO: Started container container-6 Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-5 msg: [container-5] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-1 msg: [container-1] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-2 msg: [container-2] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-3 msg: [container-3] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-4 msg: [container-4] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-6 msg: [container-6] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run INFO: Started container container-7 Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-7 msg: [container-7] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run INFO: Started container container-8 Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run INFO: Started container container-9 Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-8 msg: [container-8] Entering heartbeat loop.. Mar 08, 2018 1:00:52 AM com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log INFO: container-9 msg: [container-9] Entering heartbeat loop.. Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer heartbeatLoop INFO: Waiting for pending request. Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer heartbeatLoop INFO: Waiting for pending request. Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer heartbeatLoop INFO: Waiting for pending request. Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=1,name=PubsubIO.Read/PubsubUnboundedSource/Read(PubsubSource),type=INPUT,checkpoint={ffffffffffffffff, 0, 0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream9,bufferServer=localhost]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=7,name=CalculateUserScores/ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream6,sourceNodeId=6,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream29,bufferServer=localhost]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=19,name=CalculateTeamScores/LeaderboardTeamFixedWindows/Window.Assign,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream18,sourceNodeId=4,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream15,bufferServer=<null>]]], OperatorDeployInfo[id=6,name=CalculateUserScores/ExtractUserScore/MapElements/Map/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream23,sourceNodeId=5,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream6,bufferServer=localhost]]], OperatorDeployInfo[id=20,name=CalculateTeamScores/ExtractTeamScore/MapElements/Map/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream15,sourceNodeId=19,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream8,bufferServer=localhost]]], OperatorDeployInfo[id=2,name=PubsubIO.Read/PubsubUnboundedSource/PubsubUnboundedSource.Stats/ParMultiDo(Stats),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream9,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream0,bufferServer=<null>]]], OperatorDeployInfo[id=4,name=ParseGameEvent/ParMultiDo(ParseEvent),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream5,sourceNodeId=3,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream18,bufferServer=<null>]]], OperatorDeployInfo[id=3,name=PubsubIO.Read/MapElements/Map/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream0,sourceNodeId=2,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream5,bufferServer=<null>]]], OperatorDeployInfo[id=5,name=CalculateUserScores/LeaderboardUserGlobalWindow/Window.Assign,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream18,sourceNodeId=4,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream23,bufferServer=<null>]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=38,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/StreamingWrite,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream10,sourceNodeId=37,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[]], OperatorDeployInfo[id=33,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream24,sourceNodeId=18,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream32,bufferServer=<null>]]], OperatorDeployInfo[id=18,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream16,sourceNodeId=17,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream24,bufferServer=<null>]]], OperatorDeployInfo[id=37,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/GlobalWindow/Window.Assign,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream32,sourceNodeId=33,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream10,bufferServer=<null>]]], OperatorDeployInfo[id=17,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ExpandIterable/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream7,sourceNodeId=16,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream16,bufferServer=<null>]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=29,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream33,sourceNodeId=28,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream31,bufferServer=localhost]]], OperatorDeployInfo[id=27,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/TagWithUniqueIds/ParMultiDo(TagWithUniqueIds),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream3,sourceNodeId=26,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream21,bufferServer=<null>]]], OperatorDeployInfo[id=26,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/ShardTableWrites/ParMultiDo(GenerateShardedTable),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream35,sourceNodeId=25,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream3,bufferServer=<null>]]], OperatorDeployInfo[id=25,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/CreateTables/ParDo(CreateTables)/ParMultiDo(CreateTables),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream4,sourceNodeId=24,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream35,bufferServer=<null>]]], OperatorDeployInfo[id=24,name=WriteTeamScoreSums/BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream19,sourceNodeId=23,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream4,bufferServer=<null>]]], OperatorDeployInfo[id=22,name=CalculateTeamScores/ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream25,sourceNodeId=21,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream26,bufferServer=<null>]]], OperatorDeployInfo[id=28,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/Window.Into()/Window.Assign,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream21,sourceNodeId=27,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream33,bufferServer=<null>]]], OperatorDeployInfo[id=23,name=WriteTeamScoreSums/ConvertToRow/ParMultiDo(BuildRow),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream26,sourceNodeId=22,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream19,bufferServer=<null>]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=30,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream31,sourceNodeId=29,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream17,bufferServer=localhost]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=21,name=CalculateTeamScores/ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream8,sourceNodeId=20,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream25,bufferServer=localhost]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.WindowGenerator activate INFO: Catching up from 1520470851500 to 1520470853648 Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=30.output.30, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=21.output.21, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=1.output.1, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/29.output.29, windowId=ffffffffffffffff, type=stream31/30.input, upstreamIdentifier=29.output.29, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/6.output.7, windowId=ffffffffffffffff, type=stream6/7.input, upstreamIdentifier=6.output.7, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=7.output.8, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/20.output.20, windowId=ffffffffffffffff, type=stream8/21.input, upstreamIdentifier=20.output.20, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/16.output.17, windowId=ffffffffffffffff, type=stream7/17.input, upstreamIdentifier=16.output.17, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=20.output.20, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=6.output.7, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/1.output.1, windowId=ffffffffffffffff, type=stream9/2.input, upstreamIdentifier=1.output.1, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/21.output.21, windowId=ffffffffffffffff, type=stream25/22.input, upstreamIdentifier=21.output.21, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=29.output.29, windowId=ffffffffffffffff} Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=34,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream22,sourceNodeId=32,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream34,bufferServer=<null>]]], OperatorDeployInfo[id=32,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream11,sourceNodeId=31,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream22,bufferServer=<null>]]], OperatorDeployInfo[id=35,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/GlobalWindow/Window.Assign,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream34,sourceNodeId=34,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream12,bufferServer=<null>]]], OperatorDeployInfo[id=31,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ExpandIterable/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream17,sourceNodeId=30,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream11,bufferServer=<null>]]], OperatorDeployInfo[id=36,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/StreamingWrite,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream12,sourceNodeId=35,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=16,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream30,sourceNodeId=15,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream7,bufferServer=localhost]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer processHeartbeatResponse INFO: Deploy request: [OperatorDeployInfo[id=9,name=WriteUserScoreSums/ConvertToRow/ParMultiDo(BuildRow),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream14,sourceNodeId=8,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream20,bufferServer=<null>]]], OperatorDeployInfo[id=13,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/TagWithUniqueIds/ParMultiDo(TagWithUniqueIds),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream2,sourceNodeId=12,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream1,bufferServer=<null>]]], OperatorDeployInfo[id=14,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/Window.Into()/Window.Assign,type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream1,sourceNodeId=13,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream28,bufferServer=<null>]]], OperatorDeployInfo[id=10,name=WriteUserScoreSums/BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream20,sourceNodeId=9,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream27,bufferServer=<null>]]], OperatorDeployInfo[id=12,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/ShardTableWrites/ParMultiDo(GenerateShardedTable),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream13,sourceNodeId=11,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream2,bufferServer=<null>]]], OperatorDeployInfo[id=11,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/CreateTables/ParDo(CreateTables)/ParMultiDo(CreateTables),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream27,sourceNodeId=10,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream13,bufferServer=<null>]]], OperatorDeployInfo[id=8,name=CalculateUserScores/ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream29,sourceNodeId=7,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream14,bufferServer=<null>]]], OperatorDeployInfo[id=15,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff, 0, 0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream28,sourceNodeId=14,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream30,bufferServer=localhost]]]] Mar 08, 2018 1:00:53 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=16.output.17, windowId=ffffffffffffffff} Mar 08, 2018 1:00:54 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/15.output.16, windowId=ffffffffffffffff, type=stream30/16.input, upstreamIdentifier=15.output.16, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:54 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/30.output.30, windowId=ffffffffffffffff, type=stream17/31.input, upstreamIdentifier=30.output.30, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:54 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received subscriber request: SubscribeRequestTuple{version=1.0, identifier=tcp://localhost:45403/7.output.8, windowId=ffffffffffffffff, type=stream29/8.input, upstreamIdentifier=7.output.8, mask=0, partitions=null, bufferSize=1024} Mar 08, 2018 1:00:54 AM com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage INFO: Received publisher request: PublishRequestTuple{version=1.0, identifier=15.output.16, windowId=ffffffffffffffff} Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write WARNING: Journal output stream is null. Skipping write to the WAL. Mar 08, 2018 1:00:56 AM org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource createRandomSubscription WARNING: Created subscription projects/apache-beam-testing/subscriptions/java_mobile_gaming_topic_beam_-3999549547719927286 to topic projects/apache-beam-testing/topics/java_mobile_gaming_topic. Note this subscription WILL NOT be deleted when the pipeline terminates Mar 08, 2018 1:00:58 AM org.apache.beam.sdk.metrics.MetricsEnvironment getCurrentContainer WARNING: Reporting metrics are not supported in the current execution environment. ...........................................................................................................................Introducing a parse error. ............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(512685, 1) {timestamp_ms=1520470634000} late data for: user5_AuburnKangaroo,AuburnKangaroo,10,1520470634000,2018-03-07 17:05:47.019 Mar 08, 2018 1:05:59 AM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl createTable INFO: Trying to create BigQuery table: apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_ApexRunner_team .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(331029, 1) {timestamp_ms=1520471116000} late data for: Robot-19,AmethystCaneToad,16,1520471116000,2018-03-07 17:10:47.217 bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__ Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status: RUNNING Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | gamestats_DataflowRunner_sessions | | gamestats_DataflowRunner_team | | leaderboard_ApexRunner_team | | leaderboard_DataflowRunner_team | | leaderboard_DataflowRunner_user | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ Cannot find leaderboard_ApexRunner_user in Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status: RUNNING Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status: DONE +-----------------------------------+ | table_id | +-----------------------------------+ | gamestats_DataflowRunner_sessions | | gamestats_DataflowRunner_team | | leaderboard_ApexRunner_team | | leaderboard_DataflowRunner_team | | leaderboard_DataflowRunner_user | | leaderboard_DirectRunner_team | | leaderboard_DirectRunner_user | +-----------------------------------+ [ERROR] Cannot find expected text :runners:apex:runMobileGamingJavaApex FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:flink:runMobileGamingJavaFlinkLocal'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:apex:runMobileGamingJavaApex'. > Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' > finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org BUILD FAILED in 17m 42s 3 actionable tasks: 3 executed Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure Not sending mail to unregistered user yifan...@yifanzou-linuxworkstation.sea.corp.google.com