See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/928/display/redirect?page=changes>
Changes:
[sidhom] [BEAM-4615] Flink job server wrapper and shadow jar
------------------------------------------
[...truncated 67.41 MB...]
INFO: Loading JAR files for task
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) [DEPLOYING].
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
submitTask
INFO: Received task ToKeyedWorkItem (1/1).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Registering task at network:
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) [DEPLOYING].
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: ToKeyedWorkItem (1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) switched
from CREATED to DEPLOYING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Creating FileSystem stream leak safety net for task ToKeyedWorkItem
(1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) [DEPLOYING]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Loading JAR files for task ToKeyedWorkItem (1/1)
(087bcf753bbd12b67d7f9f9cf7a508f0) [DEPLOYING].
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Registering task at network: ToKeyedWorkItem (1/1)
(087bcf753bbd12b67d7f9f9cf7a508f0) [DEPLOYING].
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
submitTask
INFO: Received task PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) switched from CREATED to DEPLOYING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Creating FileSystem stream leak safety net for task
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) [DEPLOYING]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Loading JAR files for task
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) [DEPLOYING].
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: ToKeyedWorkItem (1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) switched
from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Registering task at network:
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) [DEPLOYING].
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: ToKeyedWorkItem (1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) switched
from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(44a3d0b59a59a53021b94855e5f42bb9) switched from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) switched from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (475ea1e34999ed7631149dcc488c9963) switched from
DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(44a3d0b59a59a53021b94855e5f42bb9) switched from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) switched from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) switched from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (475ea1e34999ed7631149dcc488c9963) switched from
DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.state.StateBackendLoader
fromApplicationOrConfigOrDefault
INFO: No state backend has been configured, using default (Memory /
JobManager) MemoryStateBackend (data in heap memory / checkpoints to
JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE,
maxStateSize: 5242880)
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) switched from DEPLOYING to RUNNING.
Jun 26, 2018 12:41:47 AM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
initializeState
INFO: No restore state for UnbounedSourceWrapper.
Jun 26, 2018 12:41:47 AM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
open
INFO: Unbounded Flink Source 0/1 is reading from sources:
[org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter@27056337]
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
exceeded the 80 characters length limit and was truncated.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
exceeded the 80 characters length limit and was truncated.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
exceeded the 80 characters length limit and was truncated.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend <init>
INFO: Initializing heap keyed state backend with stream factory.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.metrics.groups.TaskMetricGroup addOperator
WARNING: The operator name Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
exceeded the 80 characters length limit and was truncated.
Jun 26, 2018 12:41:47 AM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
initializeState
INFO: No restore state for UnbounedSourceWrapper.
Jun 26, 2018 12:41:47 AM
org.apache.beam.runners.flink.translation.wrappers.streaming.io.UnboundedSourceWrapper
open
INFO: Unbounded Flink Source 0/1 is reading from sources:
[org.apache.beam.runners.core.construction.UnboundedReadFromBoundedSource$BoundedToUnboundedSourceAdapter@73bdb103]
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend <init>
INFO: Initializing heap keyed state backend with stream factory.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(44a3d0b59a59a53021b94855e5f42bb9) switched from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for Source:
PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(44a3d0b59a59a53021b94855e5f42bb9).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task Source:
PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(44a3d0b59a59a53021b94855e5f42bb9) [FINISHED]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task Source:
PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out
44a3d0b59a59a53021b94855e5f42bb9.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source: PAssert$157/GroupGlobally/Create.Values/Read(CreateSource) ->
PAssert$157/GroupGlobally/WindowIntoDummy/Window.Assign.out (1/1)
(44a3d0b59a59a53021b94855e5f42bb9) switched from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (475ea1e34999ed7631149dcc488c9963) switched from
RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (475ea1e34999ed7631149dcc488c9963).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (475ea1e34999ed7631149dcc488c9963) [FINISHED]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem 475ea1e34999ed7631149dcc488c9963.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) switched from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: Source:
Read(TestCountingSource)/Read(AutoValue_BoundedReadFromUnboundedSource_UnboundedToBoundedSourceAdapter)
-> Read(TestCountingSource)/StripIds/ParMultiDo(StripIds) ->
PAssert$157/GroupGlobally/Window.Into()/Window.Assign.out ->
PAssert$157/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
->
PAssert$157/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out
-> ToKeyedWorkItem (1/1) (475ea1e34999ed7631149dcc488c9963) switched from
RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task
PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) [FINISHED]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: ToKeyedWorkItem (1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) switched
from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous)
669b9851ca28d486125b288902f1e065.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for ToKeyedWorkItem (1/1)
(087bcf753bbd12b67d7f9f9cf7a508f0).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task ToKeyedWorkItem
(1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) [FINISHED]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task ToKeyedWorkItem 087bcf753bbd12b67d7f9f9cf7a508f0.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GatherAllOutputs/GroupByKey ->
PAssert$157/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
-> PAssert$157/GroupGlobally/RewindowActuals/Window.Assign.out ->
PAssert$157/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1)
(669b9851ca28d486125b288902f1e065) switched from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: ToKeyedWorkItem (1/1) (087bcf753bbd12b67d7f9f9cf7a508f0) switched
from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) switched from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task
PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) [FINISHED]
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to
JobManager for task PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
4836e15e9450bfa5cb3da6e1dc3224e0.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.executiongraph.Execution
transitionState
INFO: PAssert$157/GroupGlobally/GroupDummyAndContents ->
PAssert$157/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) ->
PAssert$157/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) ->
PAssert$157/GetPane/Map/ParMultiDo(Anonymous) ->
PAssert$157/RunChecks/ParMultiDo(GroupedValuesChecker) ->
PAssert$157/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude)
(1/1) (4836e15e9450bfa5cb3da6e1dc3224e0) switched from RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job
boundedreadfromunboundedsourcetest0testnodedup-jenkins-0626004147-3ba2fb26
(f6af73e3c0ee439237ecd7bfa1c0efa0) switched from state RUNNING to FINISHED.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.checkpoint.CheckpointCoordinator shutdown
INFO: Stopping checkpoint coordinator for job
f6af73e3c0ee439237ecd7bfa1c0efa0.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore shutdown
INFO: Shutting down
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.dispatcher.Dispatcher
jobReachedGloballyTerminalState
INFO: Job f6af73e3c0ee439237ecd7bfa1c0efa0 reached globally terminal state
FINISHED.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.jobmaster.JobMaster
postStop
INFO: Stopping the JobMaster for job
boundedreadfromunboundedsourcetest0testnodedup-jenkins-0626004147-3ba2fb26(f6af73e3c0ee439237ecd7bfa1c0efa0).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeJobManagerConnection
INFO: Close JobManager connection for job f6af73e3c0ee439237ecd7bfa1c0efa0.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.jobmaster.JobMaster
dissolveResourceManagerConnection
INFO: Close ResourceManager connection dcf48e0acaa5ad4328acd7d86dc1cbee:
JobManager is shutting down..
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.jobmaster.slotpool.SlotPool suspend
INFO: Suspending SlotPool.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.resourcemanager.ResourceManager
closeJobManagerConnection
INFO: Disconnect job manager
ab48fc1d5305097305b56929e5204b81@akka://flink/user/jobmanager_271 for job
f6af73e3c0ee439237ecd7bfa1c0efa0 from the resource manager.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.jobmaster.slotpool.SlotPool postStop
INFO: Stopping SlotPool.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership
INFO: JobManager for job f6af73e3c0ee439237ecd7bfa1c0efa0 with leader id
ab48fc1d5305097305b56929e5204b81 lost leadership.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable freeSlot
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0,
nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId:
3b3baa16d891b34394484cb6783a710b, jobId: f6af73e3c0ee439237ecd7bfa1c0efa0).
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.minicluster.MiniCluster
closeAsync
INFO: Shutting down Flink Mini Cluster
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.taskexecutor.JobLeaderService removeJob
INFO: Remove job f6af73e3c0ee439237ecd7bfa1c0efa0 from job leader
monitoring.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeJobManagerConnection
INFO: Close JobManager connection for job f6af73e3c0ee439237ecd7bfa1c0efa0.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.dispatcher.Dispatcher
postStop
INFO: Stopping dispatcher
akka://flink/user/dispatcherc88745e4-0d5f-41bd-b805-4a21e67ee1ff.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.rest.RestServerEndpoint
closeAsync
INFO: Shutting down rest endpoint.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateJobManagerRunners
INFO: Stopping all currently running jobs of dispatcher
akka://flink/user/dispatcherc88745e4-0d5f-41bd-b805-4a21e67ee1ff.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeJobManagerConnection
INFO: Close JobManager connection for job f6af73e3c0ee439237ecd7bfa1c0efa0.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager close
INFO: Closing the SlotManager.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
postStop
INFO: Stopping TaskExecutor akka://flink/user/taskmanager_270.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager suspend
INFO: Suspending the SlotManager.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager
unregisterTaskManager
INFO: Unregister TaskManager 49b05dcc94da4e1bffa539ae249adf57 from the
SlotManager.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.io.disk.iomanager.IOManager shutdown
INFO: I/O manager removed spill file directory
/tmp/flink-io-f90f328c-1ac6-4076-8356-61d7ee67e9be
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.io.network.NetworkEnvironment shutdown
INFO: Shutting down the network environment and its components.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator
shutDown
INFO: Shutting down stack trace sample coordinator.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$4
INFO: Removing cache directory /tmp/flink-web-ui
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.dispatcher.Dispatcher
lambda$postStop$0
INFO: Stopped dispatcher
akka://flink/user/dispatcherc88745e4-0d5f-41bd-b805-4a21e67ee1ff.
Jun 26, 2018 12:41:47 AM
org.apache.flink.runtime.taskexecutor.JobLeaderService stop
INFO: Stop job leader service.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
postStop
INFO: Stopped TaskExecutor akka://flink/user/taskmanager_270.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.blob.AbstractBlobCache
close
INFO: Shutting down BLOB cache
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.blob.AbstractBlobCache
close
INFO: Shutting down BLOB cache
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:44747
Jun 26, 2018 12:41:47 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$4
INFO: Stopped Akka RPC service.
Jun 26, 2018 12:41:47 AM org.apache.beam.runners.flink.FlinkRunner
createPipelineResult
INFO: Execution finished in 226 msecs
Jun 26, 2018 12:41:47 AM org.apache.beam.runners.flink.FlinkRunner
createPipelineResult
INFO: Final accumulator values:
Jun 26, 2018 12:41:47 AM org.apache.beam.runners.flink.FlinkRunner
createPipelineResult
INFO: __metricscontainers :
org.apache.beam.runners.core.metrics.MetricsContainerStepMap@aeb5329
org.apache.beam.sdk.io.ReadTest > testBoundedPrimitiveDisplayData STANDARD_ERROR
Jun 26, 2018 12:41:47 AM org.apache.beam.runners.flink.FlinkRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 96 files. Enable logging at DEBUG level to see
which files will be staged.
org.apache.beam.sdk.io.ReadTest > testStreamingPrimitiveDisplayData
STANDARD_ERROR
Jun 26, 2018 12:41:47 AM org.apache.beam.runners.flink.FlinkRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 96 files. Enable logging at DEBUG level to see
which files will be staged.
org.apache.beam.sdk.io.AvroIOTest > testPrimitiveReadDisplayData STANDARD_ERROR
Jun 26, 2018 12:41:47 AM org.apache.beam.runners.flink.FlinkRunner
fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files
from the classpath: will stage 96 files. Enable logging at DEBUG level to see
which files will be staged.
Gradle Test Executor 4 finished executing tests.
> Task :beam-runners-flink_2.11:validatesRunnerStreaming FAILED
230 tests completed, 8 failed, 2 skipped
Finished generating test XML results (0.094 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/ws/src/runners/flink/build/test-results/validatesRunnerStreaming>
Generating HTML test report...
Finished generating test html results (0.079 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/ws/src/runners/flink/build/reports/tests/validatesRunnerStreaming>
:beam-runners-flink_2.11:validatesRunnerStreaming (Thread[Task worker for ':'
Thread 10,5,main]) completed. Took 2 mins 1.679 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-flink_2.11:validatesRunnerStreaming'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/ws/src/runners/flink/build/reports/tests/validatesRunnerStreaming/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16m 31s
44 actionable tasks: 40 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/7kh66vnyerjms
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user ekirpic...@gmail.com
Not sending mail to unregistered user kirpic...@google.com
Not sending mail to unregistered user sid...@google.com
