See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/111/display/redirect>
------------------------------------------
[...truncated 580.85 KB...]
Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-6
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-5 msg: [container-5] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-2 msg: [container-2] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-3 msg: [container-3] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-4 msg: [container-4] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-6 msg: [container-6] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-7
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-7 msg: [container-7] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-8
Mar 08, 2018 1:00:52 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Started container container-9
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-8 msg: [container-8] Entering heartbeat loop..
Mar 08, 2018 1:00:52 AM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-9 msg: [container-9] Entering heartbeat loop..
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
heartbeatLoop
INFO: Waiting for pending request.
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
heartbeatLoop
INFO: Waiting for pending request.
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
heartbeatLoop
INFO: Waiting for pending request.
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=1,name=PubsubIO.Read/PubsubUnboundedSource/Read(PubsubSource),type=INPUT,checkpoint={ffffffffffffffff,
0,
0},inputs=[],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream9,bufferServer=localhost]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=7,name=CalculateUserScores/ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream6,sourceNodeId=6,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream29,bufferServer=localhost]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=19,name=CalculateTeamScores/LeaderboardTeamFixedWindows/Window.Assign,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream18,sourceNodeId=4,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream15,bufferServer=<null>]]],
OperatorDeployInfo[id=6,name=CalculateUserScores/ExtractUserScore/MapElements/Map/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream23,sourceNodeId=5,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream6,bufferServer=localhost]]],
OperatorDeployInfo[id=20,name=CalculateTeamScores/ExtractTeamScore/MapElements/Map/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream15,sourceNodeId=19,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream8,bufferServer=localhost]]],
OperatorDeployInfo[id=2,name=PubsubIO.Read/PubsubUnboundedSource/PubsubUnboundedSource.Stats/ParMultiDo(Stats),type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream9,sourceNodeId=1,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream0,bufferServer=<null>]]],
OperatorDeployInfo[id=4,name=ParseGameEvent/ParMultiDo(ParseEvent),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream5,sourceNodeId=3,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream18,bufferServer=<null>]]],
OperatorDeployInfo[id=3,name=PubsubIO.Read/MapElements/Map/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream0,sourceNodeId=2,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream5,bufferServer=<null>]]],
OperatorDeployInfo[id=5,name=CalculateUserScores/LeaderboardUserGlobalWindow/Window.Assign,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream18,sourceNodeId=4,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream23,bufferServer=<null>]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=38,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/StreamingWrite,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream10,sourceNodeId=37,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[]],
OperatorDeployInfo[id=33,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream24,sourceNodeId=18,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream32,bufferServer=<null>]]],
OperatorDeployInfo[id=18,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream16,sourceNodeId=17,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream24,bufferServer=<null>]]],
OperatorDeployInfo[id=37,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/GlobalWindow/Window.Assign,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream32,sourceNodeId=33,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream10,bufferServer=<null>]]],
OperatorDeployInfo[id=17,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ExpandIterable/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream7,sourceNodeId=16,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream16,bufferServer=<null>]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=29,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream33,sourceNodeId=28,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream31,bufferServer=localhost]]],
OperatorDeployInfo[id=27,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/TagWithUniqueIds/ParMultiDo(TagWithUniqueIds),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream3,sourceNodeId=26,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream21,bufferServer=<null>]]],
OperatorDeployInfo[id=26,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/ShardTableWrites/ParMultiDo(GenerateShardedTable),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream35,sourceNodeId=25,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream3,bufferServer=<null>]]],
OperatorDeployInfo[id=25,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/CreateTables/ParDo(CreateTables)/ParMultiDo(CreateTables),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream4,sourceNodeId=24,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream35,bufferServer=<null>]]],
OperatorDeployInfo[id=24,name=WriteTeamScoreSums/BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream19,sourceNodeId=23,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream4,bufferServer=<null>]]],
OperatorDeployInfo[id=22,name=CalculateTeamScores/ExtractTeamScore/Combine.perKey(SumInteger)/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream25,sourceNodeId=21,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream26,bufferServer=<null>]]],
OperatorDeployInfo[id=28,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/Window.Into()/Window.Assign,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream21,sourceNodeId=27,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream33,bufferServer=<null>]]],
OperatorDeployInfo[id=23,name=WriteTeamScoreSums/ConvertToRow/ParMultiDo(BuildRow),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream26,sourceNodeId=22,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream19,bufferServer=<null>]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=30,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream31,sourceNodeId=29,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream17,bufferServer=localhost]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=21,name=CalculateTeamScores/ExtractTeamScore/Combine.perKey(SumInteger)/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream8,sourceNodeId=20,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream25,bufferServer=localhost]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.WindowGenerator activate
INFO: Catching up from 1520470851500 to 1520470853648
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=30.output.30, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=21.output.21, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=1.output.1, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/29.output.29, windowId=ffffffffffffffff,
type=stream31/30.input, upstreamIdentifier=29.output.29, mask=0,
partitions=null, bufferSize=1024}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/6.output.7, windowId=ffffffffffffffff,
type=stream6/7.input, upstreamIdentifier=6.output.7, mask=0, partitions=null,
bufferSize=1024}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=7.output.8, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/20.output.20, windowId=ffffffffffffffff,
type=stream8/21.input, upstreamIdentifier=20.output.20, mask=0,
partitions=null, bufferSize=1024}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/16.output.17, windowId=ffffffffffffffff,
type=stream7/17.input, upstreamIdentifier=16.output.17, mask=0,
partitions=null, bufferSize=1024}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=20.output.20, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=6.output.7, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/1.output.1, windowId=ffffffffffffffff,
type=stream9/2.input, upstreamIdentifier=1.output.1, mask=0, partitions=null,
bufferSize=1024}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/21.output.21, windowId=ffffffffffffffff,
type=stream25/22.input, upstreamIdentifier=21.output.21, mask=0,
partitions=null, bufferSize=1024}
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=29.output.29, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=34,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/Reify.ExtractTimestampsFromValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream22,sourceNodeId=32,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream34,bufferServer=<null>]]],
OperatorDeployInfo[id=32,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/RestoreOriginalTimestamps/ReifyTimestamps.RemoveWildcard/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream11,sourceNodeId=31,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream22,bufferServer=<null>]]],
OperatorDeployInfo[id=35,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/GlobalWindow/Window.Assign,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream34,sourceNodeId=34,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream12,bufferServer=<null>]]],
OperatorDeployInfo[id=31,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ExpandIterable/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream17,sourceNodeId=30,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream11,bufferServer=<null>]]],
OperatorDeployInfo[id=36,name=WriteTeamScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/StreamingWrite,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream12,sourceNodeId=35,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=16,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/GroupByKey,type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream30,sourceNodeId=15,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream7,bufferServer=localhost]]]]
Mar 08, 2018 1:00:53 AM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Deploy request:
[OperatorDeployInfo[id=9,name=WriteUserScoreSums/ConvertToRow/ParMultiDo(BuildRow),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream14,sourceNodeId=8,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream20,bufferServer=<null>]]],
OperatorDeployInfo[id=13,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/TagWithUniqueIds/ParMultiDo(TagWithUniqueIds),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream2,sourceNodeId=12,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream1,bufferServer=<null>]]],
OperatorDeployInfo[id=14,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/Window.Into()/Window.Assign,type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=inputPort,streamId=stream1,sourceNodeId=13,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=outputPort,streamId=stream28,bufferServer=<null>]]],
OperatorDeployInfo[id=10,name=WriteUserScoreSums/BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream20,sourceNodeId=9,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream27,bufferServer=<null>]]],
OperatorDeployInfo[id=12,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/ShardTableWrites/ParMultiDo(GenerateShardedTable),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream13,sourceNodeId=11,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream2,bufferServer=<null>]]],
OperatorDeployInfo[id=11,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/CreateTables/ParDo(CreateTables)/ParMultiDo(CreateTables),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream27,sourceNodeId=10,sourcePortName=output,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream13,bufferServer=<null>]]],
OperatorDeployInfo[id=8,name=CalculateUserScores/ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous),type=GENERIC,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream29,sourceNodeId=7,sourcePortName=output,locality=<null>,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream14,bufferServer=<null>]]],
OperatorDeployInfo[id=15,name=WriteUserScoreSums/BigQueryIO.Write/StreamingInserts/StreamingWriteTables/Reshuffle/ReifyOriginalTimestamps/ParDo(Anonymous)/ParMultiDo(Anonymous),type=OIO,checkpoint={ffffffffffffffff,
0,
0},inputs=[OperatorDeployInfo.InputDeployInfo[portName=input,streamId=stream28,sourceNodeId=14,sourcePortName=outputPort,locality=THREAD_LOCAL,partitionMask=0,partitionKeys=<null>]],outputs=[OperatorDeployInfo.OutputDeployInfo[portName=output,streamId=stream30,bufferServer=localhost]]]]
Mar 08, 2018 1:00:53 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=16.output.17, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:54 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/15.output.16, windowId=ffffffffffffffff,
type=stream30/16.input, upstreamIdentifier=15.output.16, mask=0,
partitions=null, bufferSize=1024}
Mar 08, 2018 1:00:54 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/30.output.30, windowId=ffffffffffffffff,
type=stream17/31.input, upstreamIdentifier=30.output.30, mask=0,
partitions=null, bufferSize=1024}
Mar 08, 2018 1:00:54 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received subscriber request: SubscribeRequestTuple{version=1.0,
identifier=tcp://localhost:45403/7.output.8, windowId=ffffffffffffffff,
type=stream29/8.input, upstreamIdentifier=7.output.8, mask=0, partitions=null,
bufferSize=1024}
Mar 08, 2018 1:00:54 AM
com.datatorrent.bufferserver.server.Server$UnidentifiedClient onMessage
INFO: Received publisher request: PublishRequestTuple{version=1.0,
identifier=15.output.16, windowId=ffffffffffffffff}
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:54 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:55 AM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Mar 08, 2018 1:00:56 AM org.apache.beam.sdk.io.gcp.pubsub.PubsubUnboundedSource
createRandomSubscription
WARNING: Created subscription
projects/apache-beam-testing/subscriptions/java_mobile_gaming_topic_beam_-3999549547719927286
to topic projects/apache-beam-testing/topics/java_mobile_gaming_topic. Note
this subscription WILL NOT be deleted when the pipeline terminates
Mar 08, 2018 1:00:58 AM org.apache.beam.sdk.metrics.MetricsEnvironment
getCurrentContainer
WARNING: Reporting metrics are not supported in the current execution
environment.
...........................................................................................................................Introducing
a parse error.
............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(512685,
1)
{timestamp_ms=1520470634000}
late data for: user5_AuburnKangaroo,AuburnKangaroo,10,1520470634000,2018-03-07
17:05:47.019
Mar 08, 2018 1:05:59 AM
org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$DatasetServiceImpl
createTable
INFO: Trying to create BigQuery table:
apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_ApexRunner_team
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(331029,
1)
{timestamp_ms=1520471116000}
late data for: Robot-19,AmethystCaneToad,16,1520471116000,2018-03-07
17:10:47.217
bq query SELECT table_id FROM beam_postrelease_mobile_gaming.__TABLES_SUMMARY__
Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status:
RUNNING
Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| gamestats_DataflowRunner_sessions |
| gamestats_DataflowRunner_team |
| leaderboard_ApexRunner_team |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
Cannot find leaderboard_ApexRunner_user in Waiting on
bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status: RUNNING
Waiting on bqjob_r73edc787e3cec324_00000162032d8047_1 ... (0s) Current status:
DONE
+-----------------------------------+
| table_id |
+-----------------------------------+
| gamestats_DataflowRunner_sessions |
| gamestats_DataflowRunner_team |
| leaderboard_ApexRunner_team |
| leaderboard_DataflowRunner_team |
| leaderboard_DataflowRunner_user |
| leaderboard_DirectRunner_team |
| leaderboard_DirectRunner_user |
+-----------------------------------+
[ERROR] Cannot find expected text
:runners:apex:runMobileGamingJavaApex FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:flink:runMobileGamingJavaFlinkLocal'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:apex:runMobileGamingJavaApex'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 17m 42s
3 actionable tasks: 3 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user
yifan...@yifanzou-linuxworkstation.sea.corp.google.com
