[jira] [Commented] (FLINK-36630) kafka-connector random WakeupException after enabling watermark alignment

2024-11-08 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17896592#comment-17896592 ] Hongshun Wang commented on FLINK-36630: --- [~alago] Be free to make a PR. > kafka-c

[jira] [Commented] (FLINK-36630) kafka-connector random WakeupException after enabling watermark alignment

2024-10-30 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894431#comment-17894431 ] Hongshun Wang commented on FLINK-36630: --- [~alago] Just wrapped it is not enough, w

[jira] [Comment Edited] (FLINK-36630) kafka-connector random WakeupException after enabling watermark alignment

2024-10-30 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894413#comment-17894413 ] Hongshun Wang edited comment on FLINK-36630 at 10/31/24 4:08 AM: -

[jira] [Comment Edited] (FLINK-36630) kafka-connector random WakeupException after enabling watermark alignment

2024-10-30 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894413#comment-17894413 ] Hongshun Wang edited comment on FLINK-36630 at 10/31/24 4:09 AM: -

[jira] [Comment Edited] (FLINK-36630) kafka-connector random WakeupException after enabling watermark alignment

2024-10-30 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894413#comment-17894413 ] Hongshun Wang edited comment on FLINK-36630 at 10/31/24 4:03 AM: -

[jira] [Commented] (FLINK-36630) kafka-connector random WakeupException after enabling watermark alignment

2024-10-30 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894413#comment-17894413 ] Hongshun Wang commented on FLINK-36630: --- It seems that https://issues.apache.org/j

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893683#comment-17893683 ] Hongshun Wang commented on FLINK-36584: --- [~dasarianil] , Maybe slack of flink cdc

[jira] [Commented] (FLINK-36609) Protobuf Format not support proto3

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893680#comment-17893680 ] Hongshun Wang commented on FLINK-36609: --- I'd like to do it. > Protobuf Format not

[jira] [Created] (FLINK-36618) Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC

2024-10-28 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36618: - Summary: Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC Key: FLINK-36618 URL: https://issues.apache.org/jira/browse/FLINK-36618

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893670#comment-17893670 ] Hongshun Wang commented on FLINK-36584: --- Yes, when skip backfill, the snapshot spo

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893676#comment-17893676 ] Hongshun Wang commented on FLINK-36584: --- [~dasarianil] ,  > Is there a reason for

[jira] [Updated] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36584: -- Attachment: image-2024-10-29-10-44-23-005.png > PostgresIncrementalSource is not exiting the f

[jira] [Updated] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36584: -- Attachment: image-2024-10-29-10-00-44-321.png > PostgresIncrementalSource is not exiting the f

[jira] (FLINK-36609) Protobuf Format not support proto3

2024-10-28 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36609 ] Hongshun Wang deleted comment on FLINK-36609: --- was (Author: JIRAUSER298968): I'd like to fix it, getDescriptor should return GenericDescriptor rather than Descriptor > Protobuf Format not

[jira] [Created] (FLINK-36609) Protobuf Format not support proto3

2024-10-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36609: - Summary: Protobuf Format not support proto3 Key: FLINK-36609 URL: https://issues.apache.org/jira/browse/FLINK-36609 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-36609) Protobuf Format not support proto3

2024-10-27 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893345#comment-17893345 ] Hongshun Wang commented on FLINK-36609: --- I'd like to fix it, getDescriptor should

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-26 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893043#comment-17893043 ] Hongshun Wang commented on FLINK-36584: --- [~dasarianil] , the design is like [http

[jira] [Commented] (FLINK-36584) PostgresIncrementalSource is not exiting the flink execution when StartupOptions is snapshot and create multiple replication slots

2024-10-24 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892678#comment-17892678 ] Hongshun Wang commented on FLINK-36584: --- # Issue-1: yes, you can see the argue of

[jira] [Commented] (FLINK-36569) flink kafka connector do not close kafka produer when it checkpoint success

2024-10-24 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892455#comment-17892455 ] Hongshun Wang commented on FLINK-36569: --- [~ft20082]  Thanks for your explain, it s

[jira] [Commented] (FLINK-36569) flink kafka connector do not close kafka produer when it checkpoint success

2024-10-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17891222#comment-17891222 ] Hongshun Wang commented on FLINK-36569: --- You mean that kafka sink with EXACTLY-ONC

[jira] [Commented] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-10-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889614#comment-17889614 ] Hongshun Wang commented on FLINK-35093: --- [~phamvinh1712] Sure, you can take it if

[jira] [Commented] (FLINK-32766) Support kafka catalog

2024-09-30 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885848#comment-17885848 ] Hongshun Wang commented on FLINK-32766: --- It's been a long time for this job. [~mel

[jira] [Commented] (FLINK-35387) PG CDC source support heart beat

2024-09-02 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878696#comment-17878696 ] Hongshun Wang commented on FLINK-35387: --- I'd like to do it. > PG CDC source suppo

[jira] [Created] (FLINK-36174) CDC yaml without pipeline will throw NullPointException

2024-08-29 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36174: - Summary: CDC yaml without pipeline will throw NullPointException Key: FLINK-36174 URL: https://issues.apache.org/jira/browse/FLINK-36174 Project: Flink Iss

[jira] [Created] (FLINK-36163) Kafka cdc pipeline source supports protobuf format.

2024-08-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36163: - Summary: Kafka cdc pipeline source supports protobuf format. Key: FLINK-36163 URL: https://issues.apache.org/jira/browse/FLINK-36163 Project: Flink Issue T

[jira] [Comment Edited] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-08-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876584#comment-17876584 ] Hongshun Wang edited comment on FLINK-35859 at 8/26/24 5:45 AM: --

[jira] [Comment Edited] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-08-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876584#comment-17876584 ] Hongshun Wang edited comment on FLINK-35859 at 8/26/24 5:45 AM: --

[jira] [Commented] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-08-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876584#comment-17876584 ] Hongshun Wang commented on FLINK-35859: --- [~pacinogong] the docs of AssignerStatus

[jira] [Commented] (FLINK-36150) tables.exclude is not valid if scan.binlog.newly-added-table.enabled is true.

2024-08-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876487#comment-17876487 ] Hongshun Wang commented on FLINK-36150: --- I'd like to do it. > tables.exclude is n

[jira] [Created] (FLINK-36150) tables.exclude is not valid if scan.binlog.newly-added-table.enabled is true.

2024-08-25 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36150: - Summary: tables.exclude is not valid if scan.binlog.newly-added-table.enabled is true. Key: FLINK-36150 URL: https://issues.apache.org/jira/browse/FLINK-36150 Proje

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.3.0) > Hotfix: Set isSchemaChangeA

[jira] [Updated] (FLINK-36094) CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36094: -- Priority: Blocker (was: Critical) > CDC SchemaRegistryRequestHandler should throw exception w

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Affects Version/s: cdc-3.1.1 (was: cdc-3.2.0) > Hotfix: Set isSchem

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Priority: Blocker (was: Major) > Hotfix: Set isSchemaChangeApplying as volatile for thread sa

[jira] [Commented] (FLINK-36094) CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException

2024-08-19 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874836#comment-17874836 ] Hongshun Wang commented on FLINK-36094: --- I'd like to do it > CDC SchemaRegistryRe

[jira] [Created] (FLINK-36094) CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException

2024-08-19 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36094: - Summary: CDC SchemaRegistryRequestHandler should throw exception which is not SchemaEvolveException Key: FLINK-36094 URL: https://issues.apache.org/jira/browse/FLINK-36094

[jira] [Updated] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as volatile for thread safe.

2024-08-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36076: -- Summary: Hotfix: Set isSchemaChangeApplying as volatile for thread safe. (was: Hotfix: Set is

[jira] [Commented] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as isSchemaChangeApplying for thread safe.

2024-08-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874174#comment-17874174 ] Hongshun Wang commented on FLINK-36076: --- I'd like to do it. > Hotfix: Set isSchem

[jira] [Created] (FLINK-36076) Hotfix: Set isSchemaChangeApplying as isSchemaChangeApplying for thread safe.

2024-08-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36076: - Summary: Hotfix: Set isSchemaChangeApplying as isSchemaChangeApplying for thread safe. Key: FLINK-36076 URL: https://issues.apache.org/jira/browse/FLINK-36076 Proje

[jira] [Created] (FLINK-36036) CDC remove unused dependency jar from calcite-core

2024-08-12 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36036: - Summary: CDC remove unused dependency jar from calcite-core Key: FLINK-36036 URL: https://issues.apache.org/jira/browse/FLINK-36036 Project: Flink Issue Ty

[jira] [Updated] (FLINK-36023) Flink CDC K8S Native Application Mode add wrong jar url.

2024-08-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36023: -- Description: In https://issues.apache.org/jira/browse/FLINK-34853 , a great job made to summi

[jira] [Commented] (FLINK-36023) Flink CDC K8S Native Application Mode add wrong jar url.

2024-08-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17872264#comment-17872264 ] Hongshun Wang commented on FLINK-36023: --- I'd like to do it. > Flink CDC K8S Nativ

[jira] [Updated] (FLINK-36023) Flink CDC K8S Native Application Mode add wrong jar url.

2024-08-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-36023: -- Component/s: Flink CDC Fix Version/s: cdc-3.2.0 Affects Version/s: cdc-3.1.1

[jira] [Created] (FLINK-36023) Flink K8S Native Application Mode add wrong jar url.

2024-08-09 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36023: - Summary: Flink K8S Native Application Mode add wrong jar url. Key: FLINK-36023 URL: https://issues.apache.org/jira/browse/FLINK-36023 Project: Flink Issue

[jira] [Commented] (FLINK-36007) cdc load and register factory in once search

2024-08-08 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871928#comment-17871928 ] Hongshun Wang commented on FLINK-36007: --- I'd like to do it. > cdc load and regist

[jira] [Created] (FLINK-36007) cdc load and register factory in once search

2024-08-08 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-36007: - Summary: cdc load and register factory in once search Key: FLINK-36007 URL: https://issues.apache.org/jira/browse/FLINK-36007 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-35994) CDC pipeline use SavepointRestoreSettings in flink config flile as a fallback strategy.

2024-08-07 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35994: - Summary: CDC pipeline use SavepointRestoreSettings in flink config flile as a fallback strategy. Key: FLINK-35994 URL: https://issues.apache.org/jira/browse/FLINK-35994

[jira] [Commented] (FLINK-35968) Remove flink-cdc-runtime depedency from connectors

2024-08-02 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870453#comment-17870453 ] Hongshun Wang commented on FLINK-35968: --- [~Leonard] , [~ruanhang1993] , [~jiabaosu

[jira] [Created] (FLINK-35968) Remove flink-cdc-runtime depedency from connectors

2024-08-02 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35968: - Summary: Remove flink-cdc-runtime depedency from connectors Key: FLINK-35968 URL: https://issues.apache.org/jira/browse/FLINK-35968 Project: Flink Issue Ty

[jira] [Commented] (FLINK-35861) The dependency of kafka sql connector seems wrong

2024-07-18 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867148#comment-17867148 ] Hongshun Wang commented on FLINK-35861: --- [~martijnvisser] ,[~xuyangzhong]  Maybe w

[jira] [Commented] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-07-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866677#comment-17866677 ] Hongshun Wang commented on FLINK-35859: --- I'd like to do it. > [flink-cdc] Fix: Th

[jira] [Created] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-07-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35859: - Summary: [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called Key: FLINK-35859 URL: https://issues.apache.org/jira/browse/FL

[jira] [Updated] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35849: -- Description: In current postgres cdc connector, we use incremental framework to read data[1],

[jira] [Updated] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35849: -- Summary: [flink-cdc] Use expose_snapshot to read snapshot splits of postgres cdc connector. (

[jira] [Commented] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866050#comment-17866050 ] Hongshun Wang commented on FLINK-35849: --- I'd like to do it. Please assign this for

[jira] [Created] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35849: - Summary: [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector. Key: FLINK-35849 URL: https://issues.apache.org/jira/browse/FLINK-35849 Project

[jira] [Commented] (FLINK-35760) [docs] Add scan.newly-added-table.enabled to docs.

2024-07-04 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863107#comment-17863107 ] Hongshun Wang commented on FLINK-35760: --- I'd like to do it. > [docs] Add scan.new

[jira] [Created] (FLINK-35760) [docs] Add scan.newly-added-table.enabled to docs.

2024-07-04 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35760: - Summary: [docs] Add scan.newly-added-table.enabled to docs. Key: FLINK-35760 URL: https://issues.apache.org/jira/browse/FLINK-35760 Project: Flink Issue Ty

[jira] [Commented] (FLINK-35759) [docs] Add 'scan.incremental.snapshot.backfill.skip' to docs.

2024-07-04 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863106#comment-17863106 ] Hongshun Wang commented on FLINK-35759: --- I'd like to do it. > [docs] Add 'scan.i

[jira] [Created] (FLINK-35759) [docs] Add 'scan.incremental.snapshot.backfill.skip' to docs.

2024-07-04 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35759: - Summary: [docs] Add 'scan.incremental.snapshot.backfill.skip' to docs. Key: FLINK-35759 URL: https://issues.apache.org/jira/browse/FLINK-35759 Project: Flink

[jira] [Created] (FLINK-35715) Mysql Source support schema cache to deserialize record

2024-06-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35715: - Summary: Mysql Source support schema cache to deserialize record Key: FLINK-35715 URL: https://issues.apache.org/jira/browse/FLINK-35715 Project: Flink Iss

[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-06-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860058#comment-17860058 ] Hongshun Wang commented on FLINK-34554: ---  Is there any update on this Jira ticket?

[jira] [Commented] (FLINK-35693) Change variable specificOffsetFile, specificOffsetPos and startupTimestampMillis to Offset in StartupOptions

2024-06-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859860#comment-17859860 ] Hongshun Wang commented on FLINK-35693: --- [~Leonard] , [~ruanhang1993] [~jiabaosun]

[jira] [Created] (FLINK-35693) Change variable specificOffsetFile, specificOffsetPos and startupTimestampMillis to Offset in StartupOptions

2024-06-25 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35693: - Summary: Change variable specificOffsetFile, specificOffsetPos and startupTimestampMillis to Offset in StartupOptions Key: FLINK-35693 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-06-11 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854253#comment-17854253 ] Hongshun Wang commented on FLINK-35121: --- [~kwafor] , Sorry, I have done it > CDC

[jira] [Updated] (FLINK-35567) CDC BinaryWriter cast NullableSerializerWrapper error

2024-06-11 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35567: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.1.1) > CDC BinaryWriter cast Nulla

[jira] [Created] (FLINK-35567) CDC BinaryWriter cast NullableSerializerWrapper error

2024-06-11 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35567: - Summary: CDC BinaryWriter cast NullableSerializerWrapper error Key: FLINK-35567 URL: https://issues.apache.org/jira/browse/FLINK-35567 Project: Flink Issu

[jira] [Updated] (FLINK-35567) CDC BinaryWriter cast NullableSerializerWrapper error

2024-06-11 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35567: -- Affects Version/s: cdc-3.1.1 (was: cdc-3.2.0) > CDC BinaryWriter ca

[jira] [Created] (FLINK-35524) Clear connections pools when reader exist.

2024-06-05 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35524: - Summary: Clear connections pools when reader exist. Key: FLINK-35524 URL: https://issues.apache.org/jira/browse/FLINK-35524 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-05-23 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849161#comment-17849161 ] Hongshun Wang commented on FLINK-35067: --- [~walls.flink.m], I hope you’re doing wel

[jira] [Commented] (FLINK-35385) upgrader flink dependency version to 1.19

2024-05-21 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848438#comment-17848438 ] Hongshun Wang commented on FLINK-35385: --- We can ensure multi-version compatibility

[jira] [Created] (FLINK-35387) PG CDC source support heart beat

2024-05-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35387: - Summary: PG CDC source support heart beat Key: FLINK-35387 URL: https://issues.apache.org/jira/browse/FLINK-35387 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35385) upgrader flink dependency version to 1.19

2024-05-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35385: - Summary: upgrader flink dependency version to 1.19 Key: FLINK-35385 URL: https://issues.apache.org/jira/browse/FLINK-35385 Project: Flink Issue Type: Impro

[jira] [Commented] (FLINK-35349) Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect

2024-05-13 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846183#comment-17846183 ] Hongshun Wang commented on FLINK-35349: --- I'd like to do it. > Use connection in o

[jira] [Created] (FLINK-35349) Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect

2024-05-13 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35349: - Summary: Use connection in openJdbcConnection of SqlServerDialect/Db2Dialect/OracleDialect Key: FLINK-35349 URL: https://issues.apache.org/jira/browse/FLINK-35349 P

[jira] [Commented] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2024-05-13 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846167#comment-17846167 ] Hongshun Wang commented on FLINK-35344: --- I'd like to do it. > Move same code from

[jira] [Created] (FLINK-35344) Move same code from multiple subclasses to JdbcSourceChunkSplitter

2024-05-13 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35344: - Summary: Move same code from multiple subclasses to JdbcSourceChunkSplitter Key: FLINK-35344 URL: https://issues.apache.org/jira/browse/FLINK-35344 Project: Flink

[jira] [Updated] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35327: -- Issue Type: Improvement (was: Bug) > SQL Explain show push down condition >

[jira] [Commented] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845186#comment-17845186 ] Hongshun Wang commented on FLINK-35327: --- [~lincoln] , CC > SQL Explain show push

[jira] [Created] (FLINK-35327) SQL Explain show push down condition

2024-05-09 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35327: - Summary: SQL Explain show push down condition Key: FLINK-35327 URL: https://issues.apache.org/jira/browse/FLINK-35327 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-35313) Add upsert changelog mode to avoid UPDATE_BEFORE records push down

2024-05-08 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844872#comment-17844872 ] Hongshun Wang commented on FLINK-35313: --- I don't understand whether we need to do

[jira] [Updated] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35143: -- Fix Version/s: cdc-3.2.0 Affects Version/s: cdc-3.1.0 > Expose newly added tables capt

[jira] [Updated] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35129: -- Fix Version/s: cdc-3.2.0 Affects Version/s: cdc-3.1.0 > Postgres source commits the of

[jira] [Updated] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35067: -- Fix Version/s: cdc-3.2.0 > Support metadata 'op_type' virtual column for Postgres CDC Connect

[jira] [Updated] (FLINK-34688) CDC framework split snapshot chunks asynchronously

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-34688: -- Fix Version/s: cdc-3.2.0 (was: cdc-3.1.0) Affects Version/s:

[jira] [Updated] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35093: -- Affects Version/s: cdc-3.1.0 > Postgres source connector support SPECIFIC_OFFSETS start up mod

[jira] [Updated] (FLINK-35067) Support metadata 'op_type' virtual column for Postgres CDC Connector.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35067: -- Affects Version/s: cdc-3.1.0 > Support metadata 'op_type' virtual column for Postgres CDC Con

[jira] [Updated] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35121: -- Fix Version/s: cdc-3.2.0 > CDC pipeline connector should verify requiredOptions and optionalOp

[jira] [Updated] (FLINK-35121) CDC pipeline connector should verify requiredOptions and optionalOptions

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35121: -- Affects Version/s: cdc-3.1.0 > CDC pipeline connector should verify requiredOptions and option

[jira] [Updated] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35093: -- Fix Version/s: cdc-3.2.0 > Postgres source connector support SPECIFIC_OFFSETS start up mode fr

[jira] [Commented] (FLINK-34666) Keep assigned splits in order to fix wrong meta group calculation

2024-05-07 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844495#comment-17844495 ] Hongshun Wang commented on FLINK-34666: --- Have done it in FLINK-34634, please close

[jira] [Created] (FLINK-35281) FlinkEnvironmentUtils#addJar add each jar only once

2024-05-01 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35281: - Summary: FlinkEnvironmentUtils#addJar add each jar only once Key: FLINK-35281 URL: https://issues.apache.org/jira/browse/FLINK-35281 Project: Flink Issue T

[jira] [Created] (FLINK-35234) Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString

2024-04-24 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35234: - Summary: Fix NullPointerException of org.apache.flink.cdc.common.configuration.ConfigurationUtils#convertToString Key: FLINK-35234 URL: https://issues.apache.org/jira/browse/FLI

[jira] [Commented] (FLINK-35220) the error of mysql cdc

2024-04-24 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17840656#comment-17840656 ] Hongshun Wang commented on FLINK-35220: --- See https://nightlies.apache.org/flink/f

[jira] [Commented] (FLINK-34869) [Bug][mysql] Remove all previous table and add new added table will throw Exception.

2024-04-23 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17840280#comment-17840280 ] Hongshun Wang commented on FLINK-34869: --- It seems I haven't fixed it [~jmahonin] 

[jira] [Commented] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-04-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838428#comment-17838428 ] Hongshun Wang commented on FLINK-35143: --- I'd like to do it > Expose newly added t

[jira] [Created] (FLINK-35149) Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink

2024-04-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35149: - Summary: Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink Key: FLINK-35149 URL: https://issues.apache.org/jira/browse/FLINK-35149

[jira] [Commented] (FLINK-35144) Support various sources sync for FlinkCDC in one pipeline

2024-04-17 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838422#comment-17838422 ] Hongshun Wang commented on FLINK-35144: --- You mean that sync multiple sources to sa

[jira] [Created] (FLINK-35143) Expose newly added tables capture in mysql pipeline connector

2024-04-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35143: - Summary: Expose newly added tables capture in mysql pipeline connector Key: FLINK-35143 URL: https://issues.apache.org/jira/browse/FLINK-35143 Project: Flink

[jira] [Commented] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837942#comment-17837942 ] Hongshun Wang commented on FLINK-35129: --- [~m.orazow] , would you like to take it?

  1   2   3   >