[VOTE] Apache Flink CDC Release 3.1.1, release candidate #0

2024-06-14 Thread Qingsheng Ren
Hi everyone, Please review and vote on the release candidate #0 for the version 3.1.1 of Apache Flink CDC, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) **Release Overview** As an overview, the release consists of the following: a)

[jira] [Created] (FLINK-35601) InitOutputPathTest.testErrorOccursUnSynchronized failed due to NoSuchFieldException

2024-06-14 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35601: -- Summary: InitOutputPathTest.testErrorOccursUnSynchronized failed due to NoSuchFieldException Key: FLINK-35601 URL: https://issues.apache.org/jira/browse/FLINK-35601 Proje

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-06-14 Thread Jerry
The content has been edited in FLIP format, but I don't have wiki permissions and can't create a wiki document. https://docs.google.com/document/d/1bgKV9Teq8ktHZOAJ7EKzgSqP11Q4ZT2EM8BndOtDgy0/edit Leonard Xu 于2024年5月21日周二 22:50写道: > Thanks Jerry for kicking off this thread, the idea makes sense

Re: Re: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-14 Thread weijie guo
Thanks Lincoln for the quick response. > Since we've decided to extend a new hint option 'shuffle' to the current `LOOKUP` join hint, do we support hash shuffle as well?(It seems like it shouldn't require a lot of extra work, right?) This will deliver a complete new feature to users, also because

Re: Re: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-14 Thread weijie guo
Hi all, Thanks for all the feedback and suggestions so far. If there is no further comment, we will open the voting thread next monday. Best regards, Weijie weijie guo 于2024年6月14日周五 15:49写道: > Thanks Lincoln for the quick response. > > > Since we've decided to extend a new hint option 'shuf

[jira] [Created] (FLINK-35602) [Umbrella] Test Flink Release 1.20

2024-06-14 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35602: -- Summary: [Umbrella] Test Flink Release 1.20 Key: FLINK-35602 URL: https://issues.apache.org/jira/browse/FLINK-35602 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35603) Release Testing Instructions: Verify FLINK-35533(FLIP-459): Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35603: --- Summary: Release Testing Instructions: Verify FLINK-35533(FLIP-459): Support Flink hybrid shuffle integration with Apache Celeborn Key: FLINK-35603 URL: https://issues.apache.org/jira/brow

[jira] [Created] (FLINK-35604) Release Testing Instructions: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35604: --- Summary: Release Testing Instructions: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs Key: FLINK-35604 URL: https://issues.apache.org/jira/browse/FLINK-35604

[jira] [Created] (FLINK-35605) Release Testing Instructions: Verify FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35605: --- Summary: Release Testing Instructions: Verify FLIP-306 Unified File Merging Mechanism for Checkpoints Key: FLINK-35605 URL: https://issues.apache.org/jira/browse/FLINK-35605 Pr

[jira] [Created] (FLINK-35606) Release Testing Instructions: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35606: --- Summary: Release Testing Instructions: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order Key: FLINK-35606 URL: https://

[jira] [Created] (FLINK-35607) Release Testing Instructions: Verify FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35607: --- Summary: Release Testing Instructions: Verify FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI Key: FLINK-35607 URL: https://issues.apache.org/jira/browse/FLINK-35607

[jira] [Created] (FLINK-35608) CLONE - Release Testing Instructions: Verify FLIP-376: Add DISTRIBUTED BY clause

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35608: --- Summary: CLONE - Release Testing Instructions: Verify FLIP-376: Add DISTRIBUTED BY clause Key: FLINK-35608 URL: https://issues.apache.org/jira/browse/FLINK-35608 Project: Flink

[jira] [Created] (FLINK-35609) Release Testing Instructions: Verify FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35609: --- Summary: Release Testing Instructions: Verify FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines Key: FLINK-35609 URL: https://issues.apache.org/jira/browse/FLINK-3

[jira] [Created] (FLINK-35610) Release Testing Instructions: Verify FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35610: --- Summary: Release Testing Instructions: Verify FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table Key: FLINK-35610 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-35611) Release Testing Instructions: Verify [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35611: --- Summary: Release Testing Instructions: Verify [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunction Key: FLINK-35611 URL: https://issues.apache.org/jira/browse/FLINK-3

[jira] [Created] (FLINK-35612) Release Testing Instructions: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35612: --- Summary: Release Testing Instructions: Verify FLIP-445: Support dynamic parallelism inference for HiveSource Key: FLINK-35612 URL: https://issues.apache.org/jira/browse/FLINK-35612

[jira] [Created] (FLINK-35613) Release Testing Instructions: Verify [FLIP-451] Introduce timeout configuration to AsyncSink

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35613: --- Summary: Release Testing Instructions: Verify [FLIP-451] Introduce timeout configuration to AsyncSink Key: FLINK-35613 URL: https://issues.apache.org/jira/browse/FLINK-35613 Pr

[jira] [Created] (FLINK-35614) Release Testing Instructions: Verify FLIP-443: Interruptible timers firing

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35614: --- Summary: Release Testing Instructions: Verify FLIP-443: Interruptible timers firing Key: FLINK-35614 URL: https://issues.apache.org/jira/browse/FLINK-35614 Project: Flink

[jira] [Created] (FLINK-35615) CDC3.0, the pipeline of mysql-doris , do not support the MySQL field type timestamp(6)

2024-06-14 Thread Dylan Zhao (Jira)
Dylan Zhao created FLINK-35615: -- Summary: CDC3.0, the pipeline of mysql-doris , do not support the MySQL field type timestamp(6) Key: FLINK-35615 URL: https://issues.apache.org/jira/browse/FLINK-35615 P

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-06-14 Thread David Radley
Hi everyone, I have talked with Chesnay and Danny offline. Danny and I were not very happy with the passing Maps around, and were looking for a neater design. Chesnay suggested that we could move the new format to the Kafka connector, then pass the Kafka record down to the deserialize logic so i

[jira] [Created] (FLINK-35616) Support upsert into sharded collections

2024-06-14 Thread Jiabao Sun (Jira)
Jiabao Sun created FLINK-35616: -- Summary: Support upsert into sharded collections Key: FLINK-35616 URL: https://issues.apache.org/jira/browse/FLINK-35616 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35617) Support object reuse in async state execution

2024-06-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35617: --- Summary: Support object reuse in async state execution Key: FLINK-35617 URL: https://issues.apache.org/jira/browse/FLINK-35617 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-35618) Flink CDC add MongoDB pipeline data sink connector

2024-06-14 Thread Jiabao Sun (Jira)
Jiabao Sun created FLINK-35618: -- Summary: Flink CDC add MongoDB pipeline data sink connector Key: FLINK-35618 URL: https://issues.apache.org/jira/browse/FLINK-35618 Project: Flink Issue Type: Ne

Re: [VOTE] Apache Flink CDC Release 3.1.1, release candidate #0

2024-06-14 Thread Xiqian YU
Thanks Qingsheng for driving this release! +1 (non-binding) * Verified tarball checksum * Compiled CDC from source * Confirmed jars were compiled with JDK 8 * Ran savepoint migration test from CDC 3.0.x * Ran Pipeline E2e tests with Flink 1.18.1 / 1.19.0 Regards, Xiqian De

[jira] [Created] (FLINK-35619) Window rank query fails with "must call validate first"

2024-06-14 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-35619: Summary: Window rank query fails with "must call validate first" Key: FLINK-35619 URL: https://issues.apache.org/jira/browse/FLINK-35619 Project: Flink

[jira] [Created] (FLINK-35620) Parquet writer creates wrong file for nested fields

2024-06-14 Thread Vicky Papavasileiou (Jira)
Vicky Papavasileiou created FLINK-35620: --- Summary: Parquet writer creates wrong file for nested fields Key: FLINK-35620 URL: https://issues.apache.org/jira/browse/FLINK-35620 Project: Flink

[jira] [Created] (FLINK-35621) Release Testing Instructions: Verify FLIP-436: Introduce Catalog-related Syntax

2024-06-14 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35621: -- Summary: Release Testing Instructions: Verify FLIP-436: Introduce Catalog-related Syntax Key: FLINK-35621 URL: https://issues.apache.org/jira/browse/FLINK-35621 Project:

[ANNOUNCE] Flink 1.20 feature freeze

2024-06-14 Thread weijie guo
Hi everyone, The feature freeze of 1.20 has started now. That means that no new features or improvements should now be merged into the master branch unless you ask the release managers first, which has already been done for PRs, or pending on CI to pass. Bug fixes and documentation PRs can sti