fanrui created FLINK-27251:
------------------------------

             Summary: Solve the problem that upstream Task cannot be switched 
to Unaligned Checkpoint
                 Key: FLINK-27251
                 URL: https://issues.apache.org/jira/browse/FLINK-27251
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Checkpointing
    Affects Versions: 1.14.0, 1.15.0
            Reporter: fanrui
             Fix For: 1.16.0


After FLINK-23041, the downstream task can be switched UC when {_}currentTime - 
triggerTime > timeout{_}. But the downstream task still needs wait for all 
barriers of upstream. 

If the back pressure is serve, the downstream task cannot receive all barrier 
within CP timeout, causes CP to fail.

 

Can we support upstream Task switching from Aligned to UC? It means that when 
the barrier cannot be sent from the output buffer to the downstream task within 
the 
[execution.checkpointing.aligned-checkpoint-timeout|https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/#execution-checkpointing-aligned-checkpoint-timeout],
 the upstream task switches to UC and takes a snapshot of the data before the 
barrier in the output buffer.

 

Hi [~akalashnikov] , please help take a look in your free time, thanks a lot.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to