Yanquan Lv created FLINK-37786:
----------------------------------
Summary: Infer schema information from the state of Source and
emit it to avoid maintaining state in PreTransform
Key: FLINK-37786
URL: https://issues.apache.org/jira/browse/FLINK-37786
Project: Flink
Issue Type: Improvement
Components: Flink CDC
Affects Versions: cdc-3.5.0
Reporter: Yanquan Lv
At present, in order to maintain the schema information of the original table
before transform processing, we have maintained a state in the PreTransform
operator, which increases the complexity of the code and the difficulty of
maintenance.
In fact, such information has already been saved in Source. Taking MySQL Source
as an example, there is a map<TableId, TableChange>saved in
EmbeddedFlinkBaseHistory. We can derive the schema information corresponding to
the read site from here.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)