[jira] [Commented] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-05-23 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849161#comment-17849161 ] Hongshun Wang commented on FLINK-35067: --- [~walls.flink.m], I hope you’re doing well. I’ve been

[jira] [Commented] (FLINK-35385) upgrader flink dependency version to 1.19

2024-05-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848438#comment-17848438 ] Hongshun Wang commented on FLINK-35385: --- We can ensure multi-version compatibility for the

[jira] [Created] (FLINK-35387) PG CDC source support heart beat

2024-05-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35387: - Summary: PG CDC source support heart beat Key: FLINK-35387 URL: https://issues.apache.org/jira/browse/FLINK-35387 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35385) upgrader flink dependency version to 1.19

2024-05-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35385: - Summary: upgrader flink dependency version to 1.19 Key: FLINK-35385 URL: https://issues.apache.org/jira/browse/FLINK-35385 Project: Flink Issue Type:

[jira] [Commented] (FLINK-35349) Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect

2024-05-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846183#comment-17846183 ] Hongshun Wang commented on FLINK-35349: --- I'd like to do it. > Use connection in

[jira] [Created] (FLINK-35349) Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect

2024-05-14 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35349: - Summary: Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect Key: FLINK-35349 URL: https://issues.apache.org/jira/browse/FLINK-35349

[jira] [Commented] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2024-05-13 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846167#comment-17846167 ] Hongshun Wang commented on FLINK-35344: --- I'd like to do it. > Move same code from multiple

[jira] [Created] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2024-05-13 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35344: - Summary: Move same code from multiple subclasses to JdbcSourceChunkSplitter Key: FLINK-35344 URL: https://issues.apache.org/jira/browse/FLINK-35344 Project: Flink

[jira] [Updated] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35327: -- Issue Type: Improvement (was: Bug) > SQL Explain show push down condition >

[jira] [Commented] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845186#comment-17845186 ] Hongshun Wang commented on FLINK-35327: --- [~lincoln] , CC > SQL Explain show push down condition

[jira] [Created] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35327: - Summary: SQL Explain show push down condition Key: FLINK-35327 URL: https://issues.apache.org/jira/browse/FLINK-35327 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-35313) Add upsert changelog mode to avoid UPDATE_BEFORE records push down

2024-05-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844872#comment-17844872 ] Hongshun Wang commented on FLINK-35313: --- I don't understand whether we need to do it in sql? As

[jira] [Updated] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35143: -- Fix Version/s: cdc-3.2.0 Affects Version/s: cdc-3.1.0 > Expose newly added tables

[jira] [Updated] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35129: -- Fix Version/s: cdc-3.2.0 Affects Version/s: cdc-3.1.0 > Postgres source commits the

[jira] [Updated] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35067: -- Fix Version/s: cdc-3.2.0 > Support metadata 'op_type' virtual column for Postgres CDC

[jira] [Updated] (FLINK-34688) CDC framework split snapshot chunks asynchronously

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34688: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.1.0) Affects

[jira] [Updated] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35093: -- Affects Version/s: cdc-3.1.0 > Postgres source connector support SPECIFIC_OFFSETS start up

[jira] [Updated] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35067: -- Affects Version/s: cdc-3.1.0 > Support metadata 'op_type' virtual column for Postgres CDC

[jira] [Updated] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35121: -- Fix Version/s: cdc-3.2.0 > CDC pipeline connector should verify requiredOptions and

[jira] [Updated] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35121: -- Affects Version/s: cdc-3.1.0 > CDC pipeline connector should verify requiredOptions and

[jira] [Updated] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35093: -- Fix Version/s: cdc-3.2.0 > Postgres source connector support SPECIFIC_OFFSETS start up mode

[jira] [Commented] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844495#comment-17844495 ] Hongshun Wang commented on FLINK-34666: --- Have done it in FLINK-34634, please close it. [~renqs] 

[jira] [Created] (FLINK-35281) FlinkEnvironmentUtils#addJar add each jar only once

2024-05-02 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35281: - Summary: FlinkEnvironmentUtils#addJar add each jar only once Key: FLINK-35281 URL: https://issues.apache.org/jira/browse/FLINK-35281 Project: Flink Issue

[jira] [Created] (FLINK-35234) Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString

2024-04-24 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35234: - Summary: Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString Key: FLINK-35234 URL:

[jira] [Commented] (FLINK-35220) the error of mysql cdc

2024-04-24 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840656#comment-17840656 ] Hongshun Wang commented on FLINK-35220: --- See

[jira] [Commented] (FLINK-34869) [Bug][mysql] Remove all previous table and add new added table will throw Exception.

2024-04-23 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840280#comment-17840280 ] Hongshun Wang commented on FLINK-34869: --- It seems I haven't fixed it [~jmahonin]  > [Bug][mysql]

[jira] [Commented] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-04-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838428#comment-17838428 ] Hongshun Wang commented on FLINK-35143: --- I'd like to do it > Expose newly added tables capture in

[jira] [Created] (FLINK-35149) Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink

2024-04-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35149: - Summary: Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink Key: FLINK-35149 URL: https://issues.apache.org/jira/browse/FLINK-35149

[jira] [Commented] (FLINK-35144) Support various sources sync for FlinkCDC in one pipeline

2024-04-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838422#comment-17838422 ] Hongshun Wang commented on FLINK-35144: --- You mean that sync multiple sources to same sink? >

[jira] [Created] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-04-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35143: - Summary: Expose newly added tables capture in mysql pipeline connector Key: FLINK-35143 URL: https://issues.apache.org/jira/browse/FLINK-35143 Project: Flink

[jira] [Commented] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837942#comment-17837942 ] Hongshun Wang commented on FLINK-35129: --- [~m.orazow] , would you like to take it? > Postgres

[jira] [Created] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-04-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35129: - Summary: Postgres source commits the offset after every multiple checkpoint cycles. Key: FLINK-35129 URL: https://issues.apache.org/jira/browse/FLINK-35129

[jira] [Updated] (FLINK-35128) Re-calculate the starting change log offset after the new table added

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35128: -- Description: In mysql cdc, re-calculate the starting binlog offset after the new table added

[jira] [Updated] (FLINK-35128) Re-calculate the starting change log offset after the new table added

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35128: -- Summary: Re-calculate the starting change log offset after the new table added (was:

[jira] [Created] (FLINK-35128) Re-calculate the starting binlog offset after the new table added

2024-04-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35128: - Summary: Re-calculate the starting binlog offset after the new table added Key: FLINK-35128 URL: https://issues.apache.org/jira/browse/FLINK-35128 Project: Flink

[jira] [Commented] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837552#comment-17837552 ] Hongshun Wang commented on FLINK-35121: --- [~renqs] , CC > CDC pipeline connector should verify

[jira] [Created] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-04-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35121: - Summary: CDC pipeline connector should verify requiredOptions and optionalOptions Key: FLINK-35121 URL: https://issues.apache.org/jira/browse/FLINK-35121 Project:

[jira] [Updated] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-04-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35093: -- Description: Current, Postgres source connector  only support INITIAL and LATEST mode.

[jira] [Commented] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-04-11 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836403#comment-17836403 ] Hongshun Wang commented on FLINK-35093: --- I'd like to do it > Postgres source connector support

[jira] [Created] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-04-11 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35093: - Summary: Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot. Key: FLINK-35093 URL:

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35071: -- Component/s: Flink CDC > Remove dependency on flink-shaded from cdc source connector >

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35071: -- Fix Version/s: 3.1.0 > Remove dependency on flink-shaded from cdc source connector >

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35071: -- Affects Version/s: (was: cdc-3.1.0) > Remove dependency on flink-shaded from cdc source

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35071: -- Affects Version/s: cdc-3.1.0 > Remove dependency on flink-shaded from cdc source connector >

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35071: -- Description: Like what flink-connector-aws does in FLINK-32208, the flink cdc source

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35071: -- Description: The flink cdc source connectors depend on flink-shaded-guava. With the

[jira] [Commented] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835612#comment-17835612 ] Hongshun Wang commented on FLINK-35071: --- [~renqs] I would like to do it. > Remove dependency on

[jira] [Created] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-10 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35071: - Summary: Remove dependency on flink-shaded from cdc source connector Key: FLINK-35071 URL: https://issues.apache.org/jira/browse/FLINK-35071 Project: Flink

[jira] [Created] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-04-09 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35067: - Summary: Support metadata 'op_type' virtual column for Postgres CDC Connector. Key: FLINK-35067 URL: https://issues.apache.org/jira/browse/FLINK-35067 Project:

[jira] [Updated] (FLINK-34952) Flink CDC pipeline supports SinkFunction

2024-04-03 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34952: -- Summary: Flink CDC pipeline supports SinkFunction (was: Flink CDC pipeline supports

[jira] [Updated] (FLINK-34690) If data from upstream is decimal and primary key , starrocks sink will not support.

2024-04-02 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34690: -- Description: h3. What's the problem Flink only have bigint type, if mysql data is unsigned

[jira] [Commented] (FLINK-34948) CDC RowType can not convert to flink type

2024-03-27 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831301#comment-17831301 ] Hongshun Wang commented on FLINK-34948: --- Can you provide a case or other more detailed

[jira] [Updated] (FLINK-34952) Flink CDC pipeline supports SourceFunction

2024-03-27 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34952: -- Description: Though current Flink CDC pipeline define

[jira] [Created] (FLINK-34952) Flink CDC pipeline supports SourceFunction

2024-03-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34952: - Summary: Flink CDC pipeline supports SourceFunction Key: FLINK-34952 URL: https://issues.apache.org/jira/browse/FLINK-34952 Project: Flink Issue Type:

[jira] [Commented] (FLINK-34925) FlinkCDC 3.0 for extracting data from sqlserver, errors occur

2024-03-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830759#comment-17830759 ] Hongshun Wang commented on FLINK-34925: --- [~gongzhongqiang] , CC, I am not familiar with Sqlserver.

[jira] [Commented] (FLINK-34925) FlinkCDC 3.0 for extracting data from sqlserver, errors occur

2024-03-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830464#comment-17830464 ] Hongshun Wang commented on FLINK-34925: --- This  

[jira] [Commented] (FLINK-34925) FlinkCDC 3.0 for extracting data from sqlserver, errors occur

2024-03-24 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830310#comment-17830310 ] Hongshun Wang commented on FLINK-34925: --- Debezium 2.0 is a major version upgrade which does not

[jira] [Commented] (FLINK-34903) Add mysql-pipeline-connector with table.exclude.list option to exclude unnecessary tables

2024-03-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829715#comment-17829715 ] Hongshun Wang commented on FLINK-34903: --- [~fffy] , Please change PR titile by

[jira] [Commented] (FLINK-34739) "Connectors" Page for Flink CDC Chinese Documentation

2024-03-20 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828664#comment-17828664 ] Hongshun Wang commented on FLINK-34739: --- I am willing to do it > "Connectors" Page for Flink CDC

[jira] [Commented] (FLINK-34750) "legacy-flink-cdc-sources" Page of Postgresql for Flink CDC Chinese Documentation.

2024-03-20 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828658#comment-17828658 ] Hongshun Wang commented on FLINK-34750: --- I am willing to do this. > "legacy-flink-cdc-sources"

[jira] (FLINK-34740) "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation

2024-03-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34740 ] Hongshun Wang deleted comment on FLINK-34740: --- was (Author: JIRAUSER298968): I am willing to do this. > "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation >

[jira] [Commented] (FLINK-34740) "legacy-flink-cdc-sources" Pages for Flink CDC Chinese Documentation

2024-03-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828570#comment-17828570 ] Hongshun Wang commented on FLINK-34740: --- I am willing to do this. > "legacy-flink-cdc-sources"

[jira] [Commented] (FLINK-34741) "get-started" Page for Flink CDC Chinese Documentation

2024-03-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828569#comment-17828569 ] Hongshun Wang commented on FLINK-34741: --- I am willing to do this. > "get-started" Page for Flink

[jira] [Commented] (FLINK-34742) Translate "FAQ" Page for Flink CDC Chinese Documentation

2024-03-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828568#comment-17828568 ] Hongshun Wang commented on FLINK-34742: --- I am willing to do this. > Translate "FAQ" Page for

[jira] [Created] (FLINK-34724) Fix broken web link in document of legacy Flink CDC Sources

2024-03-18 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34724: - Summary: Fix broken web link in document of legacy Flink CDC Sources Key: FLINK-34724 URL: https://issues.apache.org/jira/browse/FLINK-34724 Project: Flink

[jira] [Commented] (FLINK-34685) "Deployment - Kubernetes" Page for Flink CDC Documentation

2024-03-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827775#comment-17827775 ] Hongshun Wang commented on FLINK-34685: --- It seem this should wait for

[jira] [Commented] (FLINK-34685) "Deployment - Kubernetes" Page for Flink CDC Documentation

2024-03-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827438#comment-17827438 ] Hongshun Wang commented on FLINK-34685: --- I am willing to take this. > "Deployment - Kubernetes"

[jira] [Updated] (FLINK-34690) If data from upstream is decimal and primary key , starrocks sink will not support.

2024-03-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34690: -- Description: h3. What's the problem Flink only have bigint type, if mysql data is unsigned

[jira] [Commented] (FLINK-34690) If data from upstream is decimal and primary key , starrocks sink will not support.

2024-03-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827404#comment-17827404 ] Hongshun Wang commented on FLINK-34690: --- [~renqs] ,[~Leonard] , [~Lv Yanquan] , [~banmoy] , CC >

[jira] [Updated] (FLINK-34690) If data from upstream is decimal and primary key , starrocks sink will not support.

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34690: -- Description: Flink only have bigint type, if mysql data is unsigned bigint , maybe out of

[jira] [Created] (FLINK-34690) If data from upstream is decimal and primary key , starrocks sink will not support.

2024-03-14 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34690: - Summary: If data from upstream is decimal and primary key , starrocks sink will not support. Key: FLINK-34690 URL: https://issues.apache.org/jira/browse/FLINK-34690

[jira] [Commented] (FLINK-34688) CDC framework split snapshot chunks asynchronously

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827335#comment-17827335 ] Hongshun Wang commented on FLINK-34688: --- Please assign it to me. > CDC framework split snapshot

[jira] [Commented] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827333#comment-17827333 ] Hongshun Wang commented on FLINK-34666: --- Please assign it to me. > Keep assigned splits in order

[jira] [Commented] (FLINK-34634) Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827334#comment-17827334 ] Hongshun Wang commented on FLINK-34634: --- Please assign it to me. > Restarting the job will not

[jira] [Created] (FLINK-34688) CDC framework split snapshot chunks asynchronously

2024-03-14 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34688: - Summary: CDC framework split snapshot chunks asynchronously Key: FLINK-34688 URL: https://issues.apache.org/jira/browse/FLINK-34688 Project: Flink Issue

[jira] [Updated] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34666: -- Description: h3. Reason When added newly tables, and then restart job,

[jira] [Updated] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34666: -- Description: ## Reason When added newly tables, and then restart job,

[jira] [Updated] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34666: -- Fix Version/s: cdc-3.1.0 > Keep assigned splits in order to fix wrong meta group calculation

[jira] [Updated] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34666: -- Issue Type: Bug (was: Improvement) > Keep assigned splits in order to fix wrong meta group

[jira] [Updated] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34666: -- Component/s: Flink CDC > Keep assigned splits in order to fix wrong meta group calculation >

[jira] [Created] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-03-14 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34666: - Summary: Keep assigned splits in order to fix wrong meta group calculation Key: FLINK-34666 URL: https://issues.apache.org/jira/browse/FLINK-34666 Project: Flink

[jira] [Comment Edited] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system

2024-03-11 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825490#comment-17825490 ] Hongshun Wang edited comment on FLINK-34648 at 3/12/24 2:11 AM: During

[jira] [Commented] (FLINK-34648) Avoid RPC time when apply SchemaChangeEvent to external system

2024-03-11 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825490#comment-17825490 ] Hongshun Wang commented on FLINK-34648: --- During the process of task recovery,  will the enumerator

[jira] [Commented] (FLINK-34634) Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed

2024-03-10 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825132#comment-17825132 ] Hongshun Wang commented on FLINK-34634: --- [~ruanhang1993] , [~renqs] , [~Leonard] , CC >

[jira] [Updated] (FLINK-34634) Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed

2024-03-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34634: -- Description: h3. What's the problem Once, I removed a table from the option and then

[jira] [Updated] (FLINK-34634) Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed

2024-03-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34634: -- Issue Type: Bug (was: Improvement) > Restarting the job will not read the changelog anymore

[jira] [Updated] (FLINK-34634) Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed

2024-03-08 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34634: -- Description: Once, I removed a table from the option and then restarted the job from the

[jira] [Created] (FLINK-34634) Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed

2024-03-08 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34634: - Summary: Restarting the job will not read the changelog anymore if it stops before the synchronization of meta information is complete and some table is removed Key: FLINK-34634

[jira] [Updated] (FLINK-34196) FLIP-389 Annotate SingleThreadFetcherManager as PublicEvolving.

2024-01-22 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34196: -- Description: This improvement implements

[jira] [Commented] (FLINK-34196) FLIP-389 Annotate SingleThreadFetcherManager as PublicEvolving.

2024-01-22 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809400#comment-17809400 ] Hongshun Wang commented on FLINK-34196: --- [~renqs] , [~Leonard] , CC, WDYT? > FLIP-389 Annotate

[jira] [Created] (FLINK-34196) FLIP-389 Annotate SingleThreadFetcherManager as PublicEvolving.

2024-01-22 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34196: - Summary: FLIP-389 Annotate SingleThreadFetcherManager as PublicEvolving. Key: FLINK-34196 URL: https://issues.apache.org/jira/browse/FLINK-34196 Project: Flink

[jira] [Commented] (FLINK-34129) MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired

2024-01-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17808018#comment-17808018 ] Hongshun Wang commented on FLINK-34129: --- [~fsk119] ,[~lsy] , [~andrewlinc...@gmail.com] , CC >

[jira] [Updated] (FLINK-34129) MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired

2024-01-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34129: -- Description: Take sum for example: When state is expired, then an update operation from

[jira] [Updated] (FLINK-34129) MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired

2024-01-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34129: -- Description: Take sum for example: When state is expired, then an update operation from

[jira] [Updated] (FLINK-34129) MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired

2024-01-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34129: -- Issue Type: Bug (was: Improvement) > MiniBatchGlobalGroupAggFunction will make -D as +I then

[jira] [Updated] (FLINK-34129) MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired

2024-01-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34129: -- Summary: MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state

[jira] [Created] (FLINK-34129) correct writing: MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired

2024-01-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-34129: - Summary: correct writing: MiniBatchGlobalGroupAggFunction will make -D as +I then make +I as -U when state expired Key: FLINK-34129 URL:

[jira] [Updated] (FLINK-33465) Make SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving.

2023-11-06 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-33465: -- Description: As discussed in FLINK-31324, though the {{SingleThreadFetcherManager}} is

[jira] [Updated] (FLINK-33465) Make SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving.

2023-11-06 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-33465: -- Description: As discussed in FLINK-31324, though the {{SingleThreadFetcherManager}} is

[jira] [Updated] (FLINK-33465) Make SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving.

2023-11-06 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-33465: -- Description: As discussed in FLINK-31324, though the {{SingleThreadFetcherManager}} is

  1   2   >