Jingsong Lee created BEAM-1445:
----------------------------------
Summary: Use Flink broadcast state to store side-input data
Key: BEAM-1445
URL: https://issues.apache.org/jira/browse/BEAM-1445
Project: Beam
Issue Type: Improvement
Components: runner-flink
Reporter: Jingsong Lee
Assignee: Jingsong Lee
By using the broadcast state to store side-input data we make operators
rescalable. What BROADCAST does is collect all checkpointed states into one
"list" and then send out that list to all parallel subtasks when restoring.The
way we would use it is to only checkpoint anything from the operator with
subtask index 0 because we assume that the state is the same on all parallel
instances of the operator.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
