This is an automated email from the ASF dual-hosted git repository.
gaoyunhaii pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink-ml.git.
from a0331de [FLINK-24729][iteration] Support iteration with mixed
operator life-cycle
add a2294e6 [FLINK-24807][iteration] Support snapshot the ReplayOperator
add 7a05cf8 [FLINK-24807][iteration] Stores the state for per-round
wrapper
add 68c5945 [hotfix][iteration] Rename the all-round checkpoint test to
be it case
add 0b033df [FLINK-24807][iteration] Add per-round checkpoint IT case
add f06a818 [FLINK-24807][iteration] not emit CoordinatorCheckpointEvent
after terminating
add 8d3f2ad [FLINK-24807][iteration] Support raw operator state
new acbf4b9 [FLINK-24807][iteration] Not start logging at the head
operator if the barrier feed back first
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../flink/iteration/checkpoint/Checkpoints.java | 22 ++
.../datacache/nonkeyed/DataCacheReader.java | 35 ++-
.../datacache/nonkeyed/DataCacheSnapshot.java | 2 +-
.../datacache/nonkeyed/DataCacheWriter.java | 12 +-
.../flink/iteration/operator/HeadOperator.java | 25 +-
.../operator/HeadOperatorCheckpointAligner.java | 16 +-
.../flink/iteration/operator/ReplayOperator.java | 226 +++++++++++-----
.../coordinator/HeadOperatorCoordinator.java | 3 +
.../coordinator/SharedProgressAligner.java | 20 +-
.../event/TerminatingOnInitializeEvent.java | 25 +-
.../headprocessor/HeadOperatorRecordProcessor.java | 2 +
.../operator/headprocessor/HeadOperatorState.java | 4 +
.../TerminatingHeadOperatorRecordProcessor.java | 13 +-
.../perround/AbstractPerRoundWrapperOperator.java | 184 ++++++++++++-
.../proxy/state/ProxyStateSnapshotContext.java | 3 +-
.../state/ProxyStreamOperatorStateContext.java | 47 +++-
.../flink/iteration/operator/HeadOperatorTest.java | 35 ++-
.../iteration/operator/ReplayOperatorTest.java | 295 ++++++++++++++++++---
.../coordinator/SharedProgressAlignerTest.java | 66 +++--
.../OneInputPerRoundWrapperOperatorTest.java | 172 ++++++++++++
...t.java => BoundedAllRoundCheckpointITCase.java} | 4 +-
...t.java => BoundedPerRoundCheckpointITCase.java} | 113 ++++----
.../BoundedPerRoundStreamIterationITCase.java | 2 +-
.../flink/test/iteration/operators/FailingMap.java | 4 +-
.../operators/TwoInputReducePerRoundOperator.java | 35 ++-
25 files changed, 1127 insertions(+), 238 deletions(-)
copy flink-ml-api/src/main/java/org/apache/flink/ml/param/ParamValidator.java
=>
flink-ml-iteration/src/main/java/org/apache/flink/iteration/operator/event/TerminatingOnInitializeEvent.java
(58%)
copy
flink-ml-tests/src/test/java/org/apache/flink/test/iteration/{BoundedAllRoundCheckpointTest.java
=> BoundedAllRoundCheckpointITCase.java} (99%)
rename
flink-ml-tests/src/test/java/org/apache/flink/test/iteration/{BoundedAllRoundCheckpointTest.java
=> BoundedPerRoundCheckpointITCase.java} (58%)
