Shuai Xu created FLINK-38989:
--------------------------------
Summary: Support resetting backlog status
Key: FLINK-38989
URL: https://issues.apache.org/jira/browse/FLINK-38989
Project: Flink
Issue Type: New Feature
Reporter: Shuai Xu
The backlog flag currently flips from `true` to `false` only once. In certain
scenarios—e.g., when the source doesn’t use checkpointing—the source will
re-read the full dataset every time a TaskManager registers with the
JobManager. In such cases, the backlog state should be re-entrant, rather than
a one-time, state-driven transition.
And we have a concrete optimization for lookup joins that will rely on this
capability, and we’ll follow up with a FLIP to describe the optimization in
detail.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
