Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Zakelly Lan
Congratulations! Best, Zakelly On Thu, Mar 21, 2024 at 12:05 PM weijie guo wrote: > Congratulations! Well done. > > > Best regards, > > Weijie > > > Feng Jin 于2024年3月21日周四 11:40写道: > >> Congratulations! >> >> >> Best, >> Feng >> >> >> On Thu, Mar 21, 2024 at 11:37 AM Ron liu wrote: >> >> >

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread weijie guo
Congratulations! Well done. Best regards, Weijie Feng Jin 于2024年3月21日周四 11:40写道: > Congratulations! > > > Best, > Feng > > > On Thu, Mar 21, 2024 at 11:37 AM Ron liu wrote: > > > Congratulations! > > > > Best, > > Ron > > > > Jark Wu 于2024年3月21日周四 10:46写道: > > > > > Congratulations and

[jira] [Created] (FLINK-34900) Check compatibility for classes in flink-core-api that skip japicmp

2024-03-20 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-34900: -- Summary: Check compatibility for classes in flink-core-api that skip japicmp Key: FLINK-34900 URL: https://issues.apache.org/jira/browse/FLINK-34900 Project: Flink

[jira] [Created] (FLINK-34899) Remove all classes that skip the japicmp check for flink-core-api

2024-03-20 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-34899: -- Summary: Remove all classes that skip the japicmp check for flink-core-api Key: FLINK-34899 URL: https://issues.apache.org/jira/browse/FLINK-34899 Project: Flink

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Feng Jin
Congratulations! Best, Feng On Thu, Mar 21, 2024 at 11:37 AM Ron liu wrote: > Congratulations! > > Best, > Ron > > Jark Wu 于2024年3月21日周四 10:46写道: > > > Congratulations and welcome! > > > > Best, > > Jark > > > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > > >

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Ron liu
Congratulations! Best, Ron Jark Wu 于2024年3月21日周四 10:46写道: > Congratulations and welcome! > > Best, > Jark > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations! > > > > Best, > > Rui > > > > On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan > wrote: > > > > >

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-20 Thread Jacky Lau
Congratulations! Best, Jacky Lau Hongshun Wang 于2024年3月21日周四 10:32写道: > Congratulations! > > Best, > Hongshun > > On Tue, Mar 19, 2024 at 3:12 PM Shawn Huang wrote: > > > Congratulations! > > > > Best, > > Shawn Huang > > > > > > Xuannan Su 于2024年3月19日周二 14:40写道: > > > > > Congratulations!

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-20 Thread Feng Jin
Hi Ron and Lincoln Thanks for driving this discussion. I believe it will greatly improve the convenience of managing user real-time pipelines. I have some questions. *Regarding Limitations of Dynamic Table:* > Does not support modifying the select statement after the dynamic table is created.

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Jark Wu
Congratulations and welcome! Best, Jark On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > Congratulations! > > Best, > Rui > > On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan wrote: > > > Congrattulations! > > > > Best, > > Hang > > > > Lincoln Lee 于2024年3月21日周四 09:54写道: > > >

Re:Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Xuyang
Cheers! -- Best! Xuyang 在 2024-03-21 10:28:45,"Rui Fan" <1996fan...@gmail.com> 写道: >Congratulations! > >Best, >Rui > >On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan wrote: > >> Congrattulations! >> >> Best, >> Hang >> >> Lincoln Lee 于2024年3月21日周四 09:54写道: >> >>> >>> Congrats, thanks

Re: [NOTICE] Flink CDC is importing GitHub issues into Apache Jira

2024-03-20 Thread Hongshun Wang
Congratulations. Thanks to Qingsheng for driving this job forward. Best, Hongshun On Wed, Mar 20, 2024 at 9:08 PM Qingsheng Ren wrote: > FYI: The auto-import has completed. Totally 137 issues are migrated from > GitHub issue to Apache Jira. Sorry again for flushing your inbox! > > Best, >

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Rui Fan
Congratulations! Best, Rui On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan wrote: > Congrattulations! > > Best, > Hang > > Lincoln Lee 于2024年3月21日周四 09:54写道: > >> >> Congrats, thanks for the great work! >> >> >> Best, >> Lincoln Lee >> >> >> Peter Huang 于2024年3月20日周三 22:48写道: >> >>>

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-20 Thread Rui Fan
+1(binding) Thanks to Weijie for driving this proposal, which solves the problem that I raised in FLIP-359. Best, Rui On Thu, Mar 21, 2024 at 10:10 AM Hangxiang Yu wrote: > +1 (binding) > > On Thu, Mar 21, 2024 at 10:04 AM Xintong Song > wrote: > > > +1 (binding) > > > > Best, > > > >

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-20 Thread Hongshun Wang
Congratulations! Best, Hongshun On Tue, Mar 19, 2024 at 3:12 PM Shawn Huang wrote: > Congratulations! > > Best, > Shawn Huang > > > Xuannan Su 于2024年3月19日周二 14:40写道: > > > Congratulations! Thanks for all the great work! > > > > Best regards, > > Xuannan > > > > On Tue, Mar 19, 2024 at 1:31 PM

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-20 Thread Yanquan Lv
Congratulations! Thanks to all contributors. Best, Yanquan Shawn Huang 于2024年3月19日周二 15:12写道: > Congratulations! > > Best, > Shawn Huang > > > Xuannan Su 于2024年3月19日周二 14:40写道: > > > Congratulations! Thanks for all the great work! > > > > Best regards, > > Xuannan > > > > On Tue, Mar 19, 2024

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Hang Ruan
Congrattulations! Best, Hang Lincoln Lee 于2024年3月21日周四 09:54写道: > > Congrats, thanks for the great work! > > > Best, > Lincoln Lee > > > Peter Huang 于2024年3月20日周三 22:48写道: > >> Congratulations >> >> >> Best Regards >> Peter Huang >> >> On Wed, Mar 20, 2024 at 6:56 AM Huajie Wang wrote: >>

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-20 Thread Hangxiang Yu
+1 (binding) On Thu, Mar 21, 2024 at 10:04 AM Xintong Song wrote: > +1 (binding) > > Best, > > Xintong > > > > On Wed, Mar 20, 2024 at 8:30 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-433: State Access on > > DataStream API V2 [1]. The

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-20 Thread Xintong Song
+1 (binding) Best, Xintong On Wed, Mar 20, 2024 at 8:30 PM weijie guo wrote: > Hi everyone, > > > Thanks for all the feedback about the FLIP-433: State Access on > DataStream API V2 [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless there is an

[jira] [Created] (FLINK-34898) Cannot create named STRUCT with a single field

2024-03-20 Thread Chloe He (Jira)
Chloe He created FLINK-34898: Summary: Cannot create named STRUCT with a single field Key: FLINK-34898 URL: https://issues.apache.org/jira/browse/FLINK-34898 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Lincoln Lee
Congrats, thanks for the great work! Best, Lincoln Lee Peter Huang 于2024年3月20日周三 22:48写道: > Congratulations > > > Best Regards > Peter Huang > > On Wed, Mar 20, 2024 at 6:56 AM Huajie Wang wrote: > >> >> Congratulations >> >> >> >> Best, >> Huajie Wang >> >> >> >> Leonard Xu 于2024年3月20日周三

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.8.0, release candidate #1

2024-03-20 Thread Mate Czagany
Hi, +1 (non-binding) - Verified checksums - Verified signatures - Verified no binaries in source distribution - Verified Apache License and NOTICE files - Executed tests - Built container image - Verified chart version and appVersion matches - Verified Helm chart can be installed with default

Re: Flink Kubernetes Operator Failing Over FlinkDeployments to a New Cluster

2024-03-20 Thread Gyula Fóra
Sorry for the late reply Kevin. I think what you are suggesting makes sense, it would be basically a `last-state` startup mode. This would also help in cases where the current last-state mechanism fails to locate HA metadata (and the state). This is somewhat of a tricky feature to implement: 1.

Re: Proposal to modify Flink’s startup sequence for MINIMUM downtime across deployments

2024-03-20 Thread Sergio Chong Loo
Hi Asimansu, Thanks for chiming in! Yes, this is pretty much what we’re trying to accomplish, a few notes: - With 2 instances constantly running is hard to control who writes to the sink and when (only the active one should), we can only write to 1 sink and don’t want duplicates records going

Re: [DISCUSS] FLIP-437: Support ML Models in Flink SQL

2024-03-20 Thread Mingge Deng
Thanks Jark for all the insightful comments. We have updated the proposal per our offline discussions: 1. Model will be treated as a new relation in FlinkSQL. 2. Include the common ML predict and evaluate functions into the open source flink to complete the user journey. And we should be able

Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-20 Thread Őrhidi Mátyás
+1 (binding) On Wed, Mar 20, 2024 at 8:37 AM Gabor Somogyi wrote: > +1 (binding) > > G > > > On Wed, Mar 20, 2024 at 3:59 PM Gyula Fóra wrote: > > > +1 (binding) > > > > Thanks! > > Gyula > > > > On Wed, Mar 20, 2024 at 3:36 PM Mate Czagany wrote: > > > > > +1 (non-binding) > > > > > > Thank

Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-20 Thread Gabor Somogyi
+1 (binding) G On Wed, Mar 20, 2024 at 3:59 PM Gyula Fóra wrote: > +1 (binding) > > Thanks! > Gyula > > On Wed, Mar 20, 2024 at 3:36 PM Mate Czagany wrote: > > > +1 (non-binding) > > > > Thank you, > > Mate > > > > Ferenc Csaky ezt írta (időpont: 2024. márc. > > 20., Sze, 15:11): > > > > >

Re: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-03-20 Thread David Radley
Thank you very much for your feedback Mark. I have made the changes in the latest google document. On reflection I agree with you that the globalIdPlacement format configuration should apply to the deserialization as well, so it is declarative. I am also going to have a new configuration option

Re: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-03-20 Thread Mark Nuttall
+1 to this A few small comments: Currently, if users have Avro schemas in an Apicurio Registry (an open source Apache 2 licensed schema registry), then the natural way to work with those Avro flows is to use the schemas in the Apicurio Repository. 'those Avro flows' ... this is the first

Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-20 Thread Gyula Fóra
+1 (binding) Thanks! Gyula On Wed, Mar 20, 2024 at 3:36 PM Mate Czagany wrote: > +1 (non-binding) > > Thank you, > Mate > > Ferenc Csaky ezt írta (időpont: 2024. márc. > 20., Sze, 15:11): > > > Hello devs, > > > > I would like to start a vote about FLIP-439 [1]. The FLIP is about to > >

[jira] [Created] (FLINK-34897) JobMasterServiceLeadershipRunnerTest#testJobMasterServiceLeadershipRunnerCloseWhenElectionServiceGrantLeaderShip needs to be enabled again

2024-03-20 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34897: - Summary: JobMasterServiceLeadershipRunnerTest#testJobMasterServiceLeadershipRunnerCloseWhenElectionServiceGrantLeaderShip needs to be enabled again Key: FLINK-34897 URL:

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Peter Huang
Congratulations Best Regards Peter Huang On Wed, Mar 20, 2024 at 6:56 AM Huajie Wang wrote: > > Congratulations > > > > Best, > Huajie Wang > > > > Leonard Xu 于2024年3月20日周三 21:36写道: > >> Hi devs and users, >> >> We are thrilled to announce that the donation of Flink CDC as a >> sub-project

Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-20 Thread Mate Czagany
+1 (non-binding) Thank you, Mate Ferenc Csaky ezt írta (időpont: 2024. márc. 20., Sze, 15:11): > Hello devs, > > I would like to start a vote about FLIP-439 [1]. The FLIP is about to > externalize the Kudu > connector from the recently retired Apache Bahir project [2] to keep it > maintainable

[VOTE] FLIP-439: Externalize Kudu Connector from Bahir

2024-03-20 Thread Ferenc Csaky
Hello devs, I would like to start a vote about FLIP-439 [1]. The FLIP is about to externalize the Kudu connector from the recently retired Apache Bahir project [2] to keep it maintainable and make it up to date as well. Discussion thread [3]. The vote will be open for at least 72 hours (until

Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-20 Thread Piotr Nowojski
Hey Zakelly! Sorry for the late reply. I still have concerns about the proposed solution, with my main concerns coming from the implications of the asynchronous state access API on the checkpointing and responsiveness of Flink. >> What also worries me a lot in this fine grained model is the

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Huajie Wang
Congratulations Best, Huajie Wang Leonard Xu 于2024年3月20日周三 21:36写道: > Hi devs and users, > > We are thrilled to announce that the donation of Flink CDC as a > sub-project of Apache Flink has completed. We invite you to explore the new > resources available: > > - GitHub Repository:

[ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Leonard Xu
Hi devs and users, We are thrilled to announce that the donation of Flink CDC as a sub-project of Apache Flink has completed. We invite you to explore the new resources available: - GitHub Repository: https://github.com/apache/flink-cdc - Flink CDC Documentation:

Re: [VOTE] FLIP-402: Extend ZooKeeper Curator configurations

2024-03-20 Thread Ferenc Csaky
+1 (non-binding), thanks for driving this! Best, Ferenc On Wednesday, March 20th, 2024 at 10:57, Yang Wang wrote: > > > +1 (binding) since ZK HA is still widely used. > > > Best, > Yang > > On Thu, Mar 14, 2024 at 6:27 PM Matthias Pohl > matthias.p...@aiven.io.invalid wrote: > > >

[jira] [Created] (FLINK-34896) Mi

2024-03-20 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-34896: --- Summary: Mi Key: FLINK-34896 URL: https://issues.apache.org/jira/browse/FLINK-34896 Project: Flink Issue Type: Sub-task Reporter: Sergey

Re: [NOTICE] Flink CDC is importing GitHub issues into Apache Jira

2024-03-20 Thread Qingsheng Ren
FYI: The auto-import has completed. Totally 137 issues are migrated from GitHub issue to Apache Jira. Sorry again for flushing your inbox! Best, Qingsheng On Wed, Mar 20, 2024 at 3:47 PM Qingsheng Ren wrote: > Hi devs, > > We are in the process of finalizing the donation of Flink CDC as a >

[jira] [Created] (FLINK-34895) Migrate FlinkRewriteSubQueryRule

2024-03-20 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-34895: --- Summary: Migrate FlinkRewriteSubQueryRule Key: FLINK-34895 URL: https://issues.apache.org/jira/browse/FLINK-34895 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-426: Grouping Remote State Access

2024-03-20 Thread Jinzhong Li
Hi Yue, Thanks for your comments. I get your point.I think there are two possible ways we can support multiGet in synchronization models in future: 1) Implement the multiGet interface in the existing Rocksdb State interface, then integrate this interface to the synchronous Operators layer. 2)

Re: [DISCUSS] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-20 Thread Jinzhong Li
Hi Yue, Thanks for your feedback! > 1. If we choose Option-3 for ForSt , how would we handle Manifest File > ? Should we take a snapshot of the Manifest during the synchronization phase? IIUC, the GetLiveFiles() API in Option-3 can also catch the fileInfo of Manifest files, and this api also

[jira] [Created] (FLINK-34894) Migrate JoinDependentConditionDerivationRule

2024-03-20 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-34894: --- Summary: Migrate JoinDependentConditionDerivationRule Key: FLINK-34894 URL: https://issues.apache.org/jira/browse/FLINK-34894 Project: Flink Issue

[jira] [Created] (FLINK-34893) Bump Checkstyle to 9+

2024-03-20 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-34893: --- Summary: Bump Checkstyle to 9+ Key: FLINK-34893 URL: https://issues.apache.org/jira/browse/FLINK-34893 Project: Flink Issue Type: Bug

[VOTE] FLIP-433: State Access on DataStream API V2

2024-03-20 Thread weijie guo
Hi everyone, Thanks for all the feedback about the FLIP-433: State Access on DataStream API V2 [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. Best regards, Weijie [1]

Re: [DISCUSS] Manual savepoint triggering in flink-kubernetes-operator

2024-03-20 Thread Yang Wang
Using a separate CR for managing the savepoints is really a good idea. After then managing savepoints will be easier and we will not leak any unusable savepoints on the object storage. Best, Yang On Wed, Mar 13, 2024 at 4:40 AM Gyula Fóra wrote: > That would be great Mate! If you could draw

[jira] [Created] (FLINK-34890) io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource :.java.sql.SQLException: ORA-01291: missing log file

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34890: -- Summary: io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource :.java.sql.SQLException: ORA-01291: missing log file Key: FLINK-34890 URL:

[jira] [Created] (FLINK-34888) How to do MySQL to MySQL pipeline

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34888: -- Summary: How to do MySQL to MySQL pipeline Key: FLINK-34888 URL: https://issues.apache.org/jira/browse/FLINK-34888 Project: Flink Issue

[jira] [Created] (FLINK-34889) Flink CDC may occur binlog can't be find when dynamic added table repeatedly

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34889: -- Summary: Flink CDC may occur binlog can't be find when dynamic added table repeatedly Key: FLINK-34889 URL: https://issues.apache.org/jira/browse/FLINK-34889

[jira] [Created] (FLINK-34855) [Improve] When using miniCluster, don't check 'FLINK_HOME'.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34855: -- Summary: [Improve] When using miniCluster, don't check 'FLINK_HOME'. Key: FLINK-34855 URL: https://issues.apache.org/jira/browse/FLINK-34855

[jira] [Created] (FLINK-34883) Error on Postgres-CDC using incremental snapshot with UUID column as PK

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34883: -- Summary: Error on Postgres-CDC using incremental snapshot with UUID column as PK Key: FLINK-34883 URL: https://issues.apache.org/jira/browse/FLINK-34883

[jira] [Created] (FLINK-34871) Oracle add data has error

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34871: -- Summary: Oracle add data has error Key: FLINK-34871 URL: https://issues.apache.org/jira/browse/FLINK-34871 Project: Flink Issue Type:

[jira] [Created] (FLINK-34862) [Bug] oracle-cdc ORA-01371: Complete LogMiner dictionary not found

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34862: -- Summary: [Bug] oracle-cdc ORA-01371: Complete LogMiner dictionary not found Key: FLINK-34862 URL: https://issues.apache.org/jira/browse/FLINK-34862

[jira] [Created] (FLINK-34869) [Bug][mysql] Remove all previous table and add new added table will throw Exception.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34869: -- Summary: [Bug][mysql] Remove all previous table and add new added table will throw Exception. Key: FLINK-34869 URL:

[jira] [Created] (FLINK-34832) [Bug] BinlogOffset's comparative method may be cause incremental snapshot scan data lose

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34832: -- Summary: [Bug] BinlogOffset's comparative method may be cause incremental snapshot scan data lose Key: FLINK-34832 URL:

[DISCUSS] FLIP-XXX Apicurio-avro format

2024-03-20 Thread David Radley
Hi, As per the FLIP process I would like to raise a FLIP, but do not have authority, so have created a google doc for the Flip to introduce a new Apicurio Avro format. The document is https://docs.google.com/document/d/14LWZPVFQ7F9mryJPdKXb4l32n7B0iWYkcOdEd1xTC7w/edit?usp=sharing I have

[jira] [Created] (FLINK-34878) [Feature][Pipeline] Flink CDC pipeline transform supports CASE WHEN

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34878: -- Summary: [Feature][Pipeline] Flink CDC pipeline transform supports CASE WHEN Key: FLINK-34878 URL: https://issues.apache.org/jira/browse/FLINK-34878

[jira] [Created] (FLINK-34874) [MongoDB] Support initial.snapshotting.pipeline related configs in table api

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34874: -- Summary: [MongoDB] Support initial.snapshotting.pipeline related configs in table api Key: FLINK-34874 URL: https://issues.apache.org/jira/browse/FLINK-34874

[jira] [Created] (FLINK-34866) [Bug] Meet NoClassDefFoundError when add new table in mysql cdc source

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34866: -- Summary: [Bug] Meet NoClassDefFoundError when add new table in mysql cdc source Key: FLINK-34866 URL: https://issues.apache.org/jira/browse/FLINK-34866

[jira] [Created] (FLINK-34825) [flink-cdc-pipeline-connectors] Add Implementation of DataSource in MongoDB

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34825: -- Summary: [flink-cdc-pipeline-connectors] Add Implementation of DataSource in MongoDB Key: FLINK-34825 URL: https://issues.apache.org/jira/browse/FLINK-34825

[jira] [Created] (FLINK-34828) sql server Limited date synchronization

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34828: -- Summary: sql server Limited date synchronization Key: FLINK-34828 URL: https://issues.apache.org/jira/browse/FLINK-34828 Project: Flink

[jira] [Created] (FLINK-34850) [test] Support to execute the (mysql) test cases with custom database deployment

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34850: -- Summary: [test] Support to execute the (mysql) test cases with custom database deployment Key: FLINK-34850 URL:

[jira] [Created] (FLINK-34856) [Bug] timeout when Invocating Remote RPC.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34856: -- Summary: [Bug] timeout when Invocating Remote RPC. Key: FLINK-34856 URL: https://issues.apache.org/jira/browse/FLINK-34856 Project: Flink

[jira] [Created] (FLINK-34860) [Bug] Jackson version conflicts among MySQL/TiDB/MongoDB connectors

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34860: -- Summary: [Bug] Jackson version conflicts among MySQL/TiDB/MongoDB connectors Key: FLINK-34860 URL: https://issues.apache.org/jira/browse/FLINK-34860

[jira] [Created] (FLINK-34861) [Bug] Inconsistent Kafka shading among cdc connectors

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34861: -- Summary: [Bug] Inconsistent Kafka shading among cdc connectors Key: FLINK-34861 URL: https://issues.apache.org/jira/browse/FLINK-34861 Project:

[jira] [Created] (FLINK-34849) Flink CDC3.0 Demo Mysql binlog to Starrocks Exception amount of AddColumnEvent is already existed[Bug]

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34849: -- Summary: Flink CDC3.0 Demo Mysql binlog to Starrocks Exception amount of AddColumnEvent is already existed[Bug] Key: FLINK-34849 URL:

[jira] [Created] (FLINK-34875) [Feature] CDC Action supports update and delete record (logical deletion)

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34875: -- Summary: [Feature] CDC Action supports update and delete record (logical deletion) Key: FLINK-34875 URL: https://issues.apache.org/jira/browse/FLINK-34875

[jira] [Created] (FLINK-34844) [3.1][pipeline-connectors] Add pipeline Sink for Pulsar.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34844: -- Summary: [3.1][pipeline-connectors] Add pipeline Sink for Pulsar. Key: FLINK-34844 URL: https://issues.apache.org/jira/browse/FLINK-34844 Project:

[jira] [Created] (FLINK-34873) [Bug] After starting Streaming ELT from MySQL to StarRocks using Flink CDC 3.0, the newly created tables are not being synchronized.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34873: -- Summary: [Bug] After starting Streaming ELT from MySQL to StarRocks using Flink CDC 3.0, the newly created tables are not being synchronized. Key: FLINK-34873

[jira] [Created] (FLINK-34809) [mysql] Add notifications to Slack when the Snapshot phase ends or Binlog stream phase begins

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34809: -- Summary: [mysql] Add notifications to Slack when the Snapshot phase ends or Binlog stream phase begins Key: FLINK-34809 URL:

[jira] [Created] (FLINK-34812) [Bug] During the snapshot phase, projection is not being performed according to the user defined schema.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34812: -- Summary: [Bug] During the snapshot phase, projection is not being performed according to the user defined schema. Key: FLINK-34812 URL:

[jira] [Created] (FLINK-34830) [3.1][cdc-composer] verify the options of Context for Factory.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34830: -- Summary: [3.1][cdc-composer] verify the options of Context for Factory. Key: FLINK-34830 URL: https://issues.apache.org/jira/browse/FLINK-34830

[jira] [Created] (FLINK-34886) Support Sybase database

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34886: -- Summary: Support Sybase database Key: FLINK-34886 URL: https://issues.apache.org/jira/browse/FLINK-34886 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34868) [Bug] oracle-cdc cannot read oracle multitenant pdb binlog: ORA-00942: table or view does not exist (LOG_MINING_FLUSH)

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34868: -- Summary: [Bug] oracle-cdc cannot read oracle multitenant pdb binlog: ORA-00942: table or view does not exist (LOG_MINING_FLUSH) Key: FLINK-34868 URL:

[jira] [Created] (FLINK-34829) When will opengauss or gaussdb be supported?

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34829: -- Summary: When will opengauss or gaussdb be supported? Key: FLINK-34829 URL: https://issues.apache.org/jira/browse/FLINK-34829 Project: Flink

[jira] [Created] (FLINK-34843) [Bug] BinlogSplitReader#pollSplitRecords return finishedSplit when exception occurs

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34843: -- Summary: [Bug] BinlogSplitReader#pollSplitRecords return finishedSplit when exception occurs Key: FLINK-34843 URL:

[jira] [Created] (FLINK-34811) [Bug] [sqlserver cdc] the field "snapshot" is always "false"

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34811: -- Summary: [Bug] [sqlserver cdc] the field "snapshot" is always "false" Key: FLINK-34811 URL: https://issues.apache.org/jira/browse/FLINK-34811

[jira] [Created] (FLINK-34835) [cdc-common] Add default value of pipeline parallelism.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34835: -- Summary: [cdc-common] Add default value of pipeline parallelism. Key: FLINK-34835 URL: https://issues.apache.org/jira/browse/FLINK-34835 Project:

[jira] [Created] (FLINK-34822) [Bug] oracle clob

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34822: -- Summary: [Bug] oracle clob Key: FLINK-34822 URL: https://issues.apache.org/jira/browse/FLINK-34822 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-34806) [Feature][Postgres] Support automatically identify newly added tables

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34806: -- Summary: [Feature][Postgres] Support automatically identify newly added tables Key: FLINK-34806 URL: https://issues.apache.org/jira/browse/FLINK-34806

[jira] [Created] (FLINK-34877) [Feature][Pipeline] Flink CDC pipeline transform supports type conversion

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34877: -- Summary: [Feature][Pipeline] Flink CDC pipeline transform supports type conversion Key: FLINK-34877 URL: https://issues.apache.org/jira/browse/FLINK-34877

[jira] [Created] (FLINK-34839) Flink CDC 3.1.0 Plan

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34839: -- Summary: Flink CDC 3.1.0 Plan Key: FLINK-34839 URL: https://issues.apache.org/jira/browse/FLINK-34839 Project: Flink Issue Type:

[jira] [Created] (FLINK-34892) Nightly AWS connectors build fails on running python tests

2024-03-20 Thread Aleksandr Pilipenko (Jira)
Aleksandr Pilipenko created FLINK-34892: --- Summary: Nightly AWS connectors build fails on running python tests Key: FLINK-34892 URL: https://issues.apache.org/jira/browse/FLINK-34892 Project:

[jira] [Created] (FLINK-34880) [Feature][Pipeline] SchemeRegistry saves the routing rules used to restore the TransformDataOperator

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34880: -- Summary: [Feature][Pipeline] SchemeRegistry saves the routing rules used to restore the TransformDataOperator Key: FLINK-34880 URL:

[jira] [Created] (FLINK-34859) [Bug] Oracle cdc in table api does no support server-time-zone option

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34859: -- Summary: [Bug] Oracle cdc in table api does no support server-time-zone option Key: FLINK-34859 URL: https://issues.apache.org/jira/browse/FLINK-34859

[jira] [Created] (FLINK-34798) [Bug] flink cdc mysql, use datastream to synchronize multiple tables, read full amount of data in a loop

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34798: -- Summary: [Bug] flink cdc mysql, use datastream to synchronize multiple tables, read full amount of data in a loop Key: FLINK-34798 URL:

[jira] [Created] (FLINK-34876) [Feature][Pipeline] Flink CDC pipeline transform supports UDF

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34876: -- Summary: [Feature][Pipeline] Flink CDC pipeline transform supports UDF Key: FLINK-34876 URL: https://issues.apache.org/jira/browse/FLINK-34876

[jira] [Created] (FLINK-34848) refactor: some class in flink-connector-mysql-cdc do not inherit from the base class in flink-cdc-base

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34848: -- Summary: refactor: some class in flink-connector-mysql-cdc do not inherit from the base class in flink-cdc-base Key: FLINK-34848 URL:

[jira] [Created] (FLINK-34853) [Feature] submit Flink CDC pipeline job to k8s cluster.

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34853: -- Summary: [Feature] submit Flink CDC pipeline job to k8s cluster. Key: FLINK-34853 URL: https://issues.apache.org/jira/browse/FLINK-34853 Project:

[jira] [Created] (FLINK-34867) [Bug] [StarRocks] [cdc master branch] Unsupported CDC data type BYTES/VARBINARY

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34867: -- Summary: [Bug] [StarRocks] [cdc master branch] Unsupported CDC data type BYTES/VARBINARY Key: FLINK-34867 URL:

[jira] [Created] (FLINK-34864) [enhancement] [ cdc-connector] [ignore no primary key table] When using regular expressions to synchronize the entire database with Flink CDC, skip tables that do not ha

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34864: -- Summary: [enhancement] [ cdc-connector] [ignore no primary key table] When using regular expressions to synchronize the entire database with Flink CDC, skip tables that do not have a primary

[jira] [Created] (FLINK-34882) mysql cdc to doris: TIME type converting fail

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34882: -- Summary: mysql cdc to doris: TIME type converting fail Key: FLINK-34882 URL: https://issues.apache.org/jira/browse/FLINK-34882 Project: Flink

[jira] [Created] (FLINK-34885) mysql to sr pipeline, float value bug

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34885: -- Summary: mysql to sr pipeline, float value bug Key: FLINK-34885 URL: https://issues.apache.org/jira/browse/FLINK-34885 Project: Flink

[jira] [Created] (FLINK-34881) [Feature] Flink CDC Oracle support tables without primary keys and scan newly added tables

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34881: -- Summary: [Feature] Flink CDC Oracle support tables without primary keys and scan newly added tables Key: FLINK-34881 URL:

[jira] [Created] (FLINK-34879) [Feature][Pipeline] Flink CDC pipeline transform supports the strategy of schema evolution

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34879: -- Summary: [Feature][Pipeline] Flink CDC pipeline transform supports the strategy of schema evolution Key: FLINK-34879 URL:

RE: Additional metadata available for Kafka serdes

2024-03-20 Thread David Radley
Hi Balint, Excellent, I have just put up a discussion thread on the dev list for a new Fli top add this, please review and feedback and +1 if this is what you are looking for. At the moment, I have not got the topic name in there. I wonder where we would use the topic name during

[jira] [Created] (FLINK-34870) [Bug] MongoCDC checkpoint error

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34870: -- Summary: [Bug] MongoCDC checkpoint error Key: FLINK-34870 URL: https://issues.apache.org/jira/browse/FLINK-34870 Project: Flink Issue

[jira] [Created] (FLINK-34865) [enhancement] [StarRocks] When synchronizing tables using Flink CDC 3.x, is it possible to include the comments of the source table's fields when creating the target tab

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34865: -- Summary: [enhancement] [StarRocks] When synchronizing tables using Flink CDC 3.x, is it possible to include the comments of the source table's fields when creating the target table?

Re: [VOTE] FLIP-402: Extend ZooKeeper Curator configurations

2024-03-20 Thread Yang Wang
+1 (binding) since ZK HA is still widely used. Best, Yang On Thu, Mar 14, 2024 at 6:27 PM Matthias Pohl wrote: > Nothing to add from my side. Thanks, Alex. > > +1 (binding) > > On Thu, Mar 7, 2024 at 4:09 PM Alex Nitavsky > wrote: > > > Hi everyone, > > > > I'd like to start a vote on

[jira] [Created] (FLINK-34814) [Bug] java.lang.NoClassDefFoundError: Could not initialize class org.apache.kafka.connect.json.JsonConverterConfig

2024-03-20 Thread Flink CDC Issue Import (Jira)
Flink CDC Issue Import created FLINK-34814: -- Summary: [Bug] java.lang.NoClassDefFoundError: Could not initialize class org.apache.kafka.connect.json.JsonConverterConfig Key: FLINK-34814 URL:

  1   2   >