[
https://issues.apache.org/jira/browse/FLINK-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arvid Heise updated FLINK-19801:
--------------------------------
Release Note: (was: While recovering from unaligned checkpoints, users
can now change the parallelism of the job. This change allows users to quickly
upscale the job under backpressure.)
> Add support for virtual channels
> --------------------------------
>
> Key: FLINK-19801
> URL: https://issues.apache.org/jira/browse/FLINK-19801
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Checkpointing
> Affects Versions: 1.12.0
> Reporter: Arvid Heise
> Assignee: Arvid Heise
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.13.0
>
>
> During rescaling of unaligned checkpoints, if state from multiple former
> channels are read on input or output side to recover a specific channel, then
> these buffers are multiplexed on output side and demultiplexed on input side
> to guarantee a consistent recovery of spanning records:
> Assume two channels C1, C2 connect operator A and B and both have one buffer
> in the output and in the input part of the channel respectively, where a
> record spans. Assume that the buffers are named O1 for output buffer of C1
> and I2 for input buffer of C2 etc. Then after rescaling both channels become
> one channel C. Then, the buffers may be restored as I1, I2, O1, O2.
> Channels use the mapping of FLINK-19533 to infer the need for virtual
> channels and distribute the needed resources. Virtual channels are removed on
> the EndOfChannelRecovery epoch marker.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
