Hi, Dev I would like to start a discussion about FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table.
In FLIP-435[1], we proposed Materialized Table, which has two types of data refresh modes: Full Refresh & Continuous Refresh Mode. In Full Refresh mode, the Materialized Table relies on a workflow scheduler to perform periodic refresh operation to achieve the desired data freshness. There are numerous open-source workflow schedulers available, with popular ones including Airflow and DolphinScheduler. To enable Materialized Table to work with different workflow schedulers, we propose a pluggable workflow scheduler interface for Materialized Table in this FLIP. For more details, see FLIP-448 [2]. Looking forward to your feedback. [1] https://lists.apache.org/thread/c1gnn3bvbfs8v1trlf975t327s4rsffs [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table Best, Ron
