[jira] [Comment Edited] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825538#comment-17825538 ] LvYanquan edited comment on FLINK-34648 at 3/12/24 7:07 AM: Enumerator will not restart but add splits back. See the picture in the attachment. was (Author: JIRAUSER304414): Enumerator will not restart but add splits back. > Avoid RPC time when apply SchemaChangeEvent to external system > -- > > Key: FLINK-34648 > URL: https://issues.apache.org/jira/browse/FLINK-34648 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Major > Labels: pull-request-available > Fix For: cdc-3.1.0 > > Attachments: 截屏2024-03-12 14.55.09.png > > > When SchemaOperator receive SchemaChangeEvent, it will send request to > SchemaRegistry and wait for applying this SchemaChangeEvent to external > system synchronously. > However, if this process take too long time, it will cause RPC > TimeoutException, and During the process of task recovery, there may be other > errors like `AddColumnEvent is already existed`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825490#comment-17825490 ] Hongshun Wang edited comment on FLINK-34648 at 3/12/24 2:11 AM: During the process of task recovery, will the enumerator not restart? If enumerator restarts and restore from last checkpoint, the event will not exist. was (Author: JIRAUSER298968): During the process of task recovery, will the enumerator not restart? > Avoid RPC time when apply SchemaChangeEvent to external system > -- > > Key: FLINK-34648 > URL: https://issues.apache.org/jira/browse/FLINK-34648 > Project: Flink > Issue Type: Improvement > Components: Flink CDC >Affects Versions: cdc-3.1.0 >Reporter: LvYanquan >Priority: Major > Fix For: cdc-3.1.0 > > > When SchemaOperator receive SchemaChangeEvent, it will send request to > SchemaRegistry and wait for applying this SchemaChangeEvent to external > system synchronously. > However, if this process take too long time, it will cause RPC > TimeoutException, and During the process of task recovery, there may be other > errors like `AddColumnEvent is already existed`. -- This message was sent by Atlassian Jira (v8.20.10#820010)
