[jira] [Commented] (FLINK-34688) CDC framework split snapshot chunks asynchronously
[ https://issues.apache.org/jira/browse/FLINK-34688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849441#comment-17849441 ] ouyangwulin commented on FLINK-34688: - When the size of the data is relatively large, this feature is really needed. > CDC framework split snapshot chunks asynchronously > -- > > Key: FLINK-34688 > URL: https://issues.apache.org/jira/browse/FLINK-34688 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: Hongshun Wang >Priority: Major > Fix For: cdc-3.2.0 > > > In Mysql CDC, MysqlSnapshotSplitAssigner splits snapshot chunks > asynchronously([https://github.com/apache/flink-cdc/pull/931).] But CDC > framework lacks it. > If table is too big to split, the enumerator will be stuck, and checkpoint > will be influenced( sometime will checkpoint timeout occurs). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-34688) CDC framework split snapshot chunks asynchronously
[ https://issues.apache.org/jira/browse/FLINK-34688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827335#comment-17827335 ] Hongshun Wang commented on FLINK-34688: --- Please assign it to me. > CDC framework split snapshot chunks asynchronously > -- > > Key: FLINK-34688 > URL: https://issues.apache.org/jira/browse/FLINK-34688 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Reporter: Hongshun Wang >Priority: Major > Fix For: cdc-3.1.0 > > > In Mysql CDC, MysqlSnapshotSplitAssigner splits snapshot chunks > asynchronously([https://github.com/apache/flink-cdc/pull/931).] But CDC > framework lacks it. > If table is too big to split, the enumerator will be stuck, and checkpoint > will be influenced( sometime will checkpoint timeout occurs). -- This message was sent by Atlassian Jira (v8.20.10#820010)
