[ https://issues.apache.org/jira/browse/FLINK-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvid Heise updated FLINK-19801: -------------------------------- Release Note: (was: While recovering from unaligned checkpoints, users can now change the parallelism of the job. This change allows users to quickly upscale the job under backpressure.) > Add support for virtual channels > -------------------------------- > > Key: FLINK-19801 > URL: https://issues.apache.org/jira/browse/FLINK-19801 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing > Affects Versions: 1.12.0 > Reporter: Arvid Heise > Assignee: Arvid Heise > Priority: Major > Labels: pull-request-available > Fix For: 1.13.0 > > > During rescaling of unaligned checkpoints, if state from multiple former > channels are read on input or output side to recover a specific channel, then > these buffers are multiplexed on output side and demultiplexed on input side > to guarantee a consistent recovery of spanning records: > Assume two channels C1, C2 connect operator A and B and both have one buffer > in the output and in the input part of the channel respectively, where a > record spans. Assume that the buffers are named O1 for output buffer of C1 > and I2 for input buffer of C2 etc. Then after rescaling both channels become > one channel C. Then, the buffers may be restored as I1, I2, O1, O2. > Channels use the mapping of FLINK-19533 to infer the need for virtual > channels and distribute the needed resources. Virtual channels are removed on > the EndOfChannelRecovery epoch marker. -- This message was sent by Atlassian Jira (v8.3.4#803005)