Re: [DISCUSS] Flink CDC 3.2 Release Planning

2024-05-27 Thread Muhammet Orazov
Hey Xiqian, +1 to the change of schedule Thanks and best, Muhammet On 2024-05-27 02:36, Xiqian YU wrote: Hi devs, Glad to see Flink CDC 3.1’s successful release! Also noticed that it’s a delayed release due to license compliance chores, which took more than half a month to process. In

Re: [VOTE] Release flink-connector-cassandra v3.2.0, release candidate #1

2024-05-21 Thread Muhammet Orazov
Hey all, Could we please get some more votes to proceed with the release? Thanks and best, Muhammet On 2024-04-22 13:04, Danny Cranmer wrote: Hi everyone, Please review and vote on release candidate #1 for flink-connector-cassandra v3.2.0, as follows: [ ] +1, Approve the release [ ] -1, Do

Re: [ANNOUNCE] Apache Flink CDC 3.1.0 released

2024-05-17 Thread Muhammet Orazov
Amazing, congrats! Thanks for your efforts! Best, Muhammet On 2024-05-17 09:32, Qingsheng Ren wrote: The Apache Flink community is very happy to announce the release of Apache Flink CDC 3.1.0. Apache Flink CDC is a distributed data integration tool for real time data and batch data, bringing

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Muhammet Orazov
Thanks Ahmed! I have reviewed your PubSub and RabbitMQ PRs, please have a look. Best, Muhammet

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Muhammet Orazov
Thanks Martijn driving this! +1 (non-binding) Best, Muhammet On 2024-05-14 06:43, Martijn Visser wrote: Hi everyone, With no more discussions being open in the thread [1] I would like to start a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction [2] The vote

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-14 Thread Muhammet Orazov
Hey Lorenzo, Thanks for driving this FLIP! +1 It will improve the user experience of using JDBC based connectors and help developers to build with different drivers. Best, Muhammet On 2024-05-13 10:20, lorenzo.affe...@ververica.com.INVALID wrote: Hello dev! I want to share a draft of my

Re: [VOTE] FLIP-451: Introduce timeout configuration to AsyncSink

2024-05-13 Thread Muhammet Orazov
Thanks Ahmed, +1 (non-binding) Best, Muhammet On 2024-05-13 09:50, Ahmed Hamdy wrote: Hi all, Thanks for the feedback on the discussion thread[1], I would like to start a vote on FLIP-451[2]: Introduce timeout configuration to AsyncSink The vote will be open for at least 72 hours unless

Re: [DISCUSS] FLIP-451: Refactor Async sink API

2024-05-13 Thread Muhammet Orazov
that the scope is defined around introducing the timeout configuration. Should we add a list of possible connectors that this FLIP would improve? Good call, I have added under migration plan. Best Regards Ahmed Hamdy On Mon, 6 May 2024 at 08:49, Muhammet Orazov wrote: Hey Ahmed, Thanks

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #2

2024-05-10 Thread Muhammet Orazov
Hey Qingsheng, Thanks, I have run the following steps: - Checked sha512sum hash - Checked GPG signature - Built the source with JDK 11 & 8 - Checked that src doesn't contain binary files GitHub web PR is as before with suggestions requested. Best, Muhammet On 2024-05-10 09:59, Qingsheng Ren

Re: [VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-10 Thread Muhammet Orazov
Thanks João for your efforts and driving this! +1 (non-binding) Best, Muhammet On 2024-05-09 12:01, Joao Boto wrote: Hi everyone, Thanks for all the feedback, I'd like to start a vote on the FLIP-449: Reorganization of flink-connector-jdbc [1]. The discussion thread is here [2]. The vote

Re: [DISCUSS] Flink CDC 3.2 Release Planning

2024-05-08 Thread Muhammet Orazov
Hey Qingsheng, Thanks for your efforts, agreed! I would be happy to help. Best, Muhammet On 2024-05-08 06:21, Qingsheng Ren wrote: Hi devs, As we are in the midst of the release voting process for Flink CDC 3.1.0, I think it's a good time to kick off the upcoming Flink CDC 3.2 release

Re: [DISCUSSION] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-07 Thread Muhammet Orazov
provides flexibility by enabling users to specify additional configuration parameters dynamically. [1] https://github.com/apache/flink-connector-jdbc/pull/115/files Best On 2024/05/06 07:34:06 Muhammet Orazov wrote: Morning João, Recently we had a case where the JDBC drivers authentication was dif

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-06 Thread Muhammet Orazov
Thanks for your efforts! +1 (non-binding) Best, Muhammet On 2024-05-06 02:53, yue ma wrote: Hi everyone, Thanks for all the feedback, I'd like to start a vote on the FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0 [1]. The discussion thread is here [2]. The vote will be open for at least

Re: [DISCUSS] FLIP-451: Refactor Async sink API

2024-05-06 Thread Muhammet Orazov
Hey Ahmed, Thanks for the FLIP! +1 (non-binding) Additionally the current interface for passing fatal exceptions and retrying records relies on java consumers which makes it harder to understand. Could you please add more here why it is harder? Would the `completeExceptionally` method be

Re: [DISCUSSION] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-06 Thread Muhammet Orazov
Muhammet Orazov wrote: Hey João, Thanks for FLIP proposal! Since proposal is to introduce modules, would it make sense to have another module for APIs (flink-jdbc-connector-api)? For this I would suggest to move all public interfaces (e.g, JdbcRowConverter, JdbcConnectionProvider). And even

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #1

2024-05-02 Thread Muhammet Orazov
Hey Qingsheng, Thanks a lot! +1 (non-binding) - Checked sha512sum hash - Checked GPG signature - Reviewed release notes - Reviewed GitHub web pr (added minor suggestions) - Built the source with JDK 11 & 8 - Checked that src doesn't contain binary files Best, Muhammet On 2024-04-30 05:11,

Re: [DISCUSS] FLIP-444: Native file copy support

2024-05-02 Thread Muhammet Orazov
Hey Piotr, Thanks for the proposal! It would be great improvement! Some questions from my side: In order to configure s5cmd Flink’s user would need to specify path to the s5cmd binary. Could you please also add the configuration property for this? An example showing how users would set this

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-02 Thread Muhammet Orazov
Got it, thanks! On 2024-05-02 06:53, Martijn Visser wrote: Hi Muhammet, Thanks for joining the discussion! The changes in this FLIP would be targeted for Flink 1.19, since it's only a matter of changing the annotation. Best regards, Martijn On Thu, May 2, 2024 at 7:26 AM Muhammet Orazov

Re: [Discuss] FLIP-452: Allow Skipping Invocation of Function Calls While Constant-folding

2024-05-02 Thread Muhammet Orazov
Hey Alan, Thanks for the proposal, +1! The `isDeterministic()`[1] function is mentioned in the documentation, I would suggest to add maybe a section for `supportsConstantFolding()`, with short description and examples use cases (similar to the motivation of the FLIP) where this could be useful

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-01 Thread Muhammet Orazov
Hello Martijn, Thanks for the FLIP and detailed history of changes, +1. Would FLIP changes target for 2.0? I think it would be good to have clear APIs on 2.0 release. Best, Muhammet On 2024-05-01 15:30, Martijn Visser wrote: Hi everyone, I would like to start a discussion on FLIP-453:

Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax

2024-04-26 Thread Muhammet Orazov
Hey Yubin, +1 (non-binding) Looks good, thanks! Best, Muhammet On 2024-04-24 08:56, Yubin Li wrote: Hi everyone, During the implementation of the "describe catalog" syntax, it was found that the original output style needed to be improved. ``` desc catalog extended cat2;

Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Muhammet Orazov
Hey Xia, +1 (non-binding) Thanks and best, Muhammet On 2024-04-26 02:21, Xia Sun wrote: Hi everyone, I'd like to start a vote on FLIP-445: Support dynamic parallelism inference for HiveSource[1] which has been discussed in this thread [2]. The vote will be open for at least 72 hours

Re: [DISCUSSION] FLIP-449: Reorganization of flink-connector-jdbc

2024-04-25 Thread Muhammet Orazov
Hey João, Thanks for FLIP proposal! Since proposal is to introduce modules, would it make sense to have another module for APIs (flink-jdbc-connector-api)? For this I would suggest to move all public interfaces (e.g, JdbcRowConverter, JdbcConnectionProvider). And even convert some classes into

Re: [SUMMARY] Flink 1.20 Release Sync 04/23/2024

2024-04-23 Thread Muhammet Orazov
Hey Rui, Thanks for the summary! Could you please write what time are you meeting on 5th May? Thanks and best, Muhammet On 2024-04-23 09:13, Rui Fan wrote: Dear devs, Today is the second meeting for Flink 1.20 release cycle. I'd like to share the information synced in the meeting. -

Re: [VOTE] Release flink-connector-cassandra v3.2.0, release candidate #1

2024-04-22 Thread Muhammet Orazov
Thanks! +1 (non-binding) - Checked 512 hash - Checked gpg signature - Reviewed web pr & release notes - Built the source with JDK 11 & 8 Best, Muhammet On 2024-04-22 13:04, Danny Cranmer wrote: Hi everyone, Please review and vote on release candidate #1 for flink-connector-cassandra v3.2.0,

Re: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-04-22 Thread Muhammet Orazov
Thanks Danny, +1 (non-binding) - Checked 512 hash - Checked gpg signature - Reviewed pr - Built the source with JDK 11 & 8 Best, Muhammet On 2024-04-22 13:55, Danny Cranmer wrote: Hi everyone, Please review and vote on release candidate #1 for flink-connector-kafka v3.2.0, as follows: [ ]

Re: [VOTE] FLIP-442: General Improvement to Configuration for Flink 2.0

2024-04-18 Thread Muhammet Orazov
Thanks Xuannan! +1 (non-binding) Best, Muhammet On 2024-04-17 05:00, Xuannan Su wrote: Hi everyone, Thanks for all the feedback about the FLIP-442: General Improvement to Configuration for Flink 2.0 [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-16 Thread Muhammet Orazov
Hello Xia, Thanks for the FLIP! Since we are introducing the mode as a configuration option, could it make sense to have `InferMode.NONE` option also? The `NONE` option would disable the inference. This way we deprecate the `table.exec.hive.infer-source-parallelism` and no additional

Re: [DISCUSS] Connector releases for Flink 1.19

2024-04-16 Thread Muhammet Orazov
on support of Opensearch v2 and I think it would make sense to have a release after it is done On Tue, Apr 16, 2024 at 4:29 AM Muhammet Orazov wrote: Hello Danny, I would like to work on this task, thanks for initiating it! I could update the versions on JDBC and Pulsar connectors. Are you going

Re: [DISCUSS] Connector releases for Flink 1.19

2024-04-15 Thread Muhammet Orazov
Hello Danny, I would like to work on this task, thanks for initiating it! I could update the versions on JDBC and Pulsar connectors. Are you going to create an umbrella issue for it? Best, Muhammet On 2024-04-15 13:44, Danny Cranmer wrote: Hello all, Flink 1.19 was released on 2024-03-18

Re: [Vote] FLIP-438: Amazon SQS Sink Connector

2024-04-15 Thread Muhammet Orazov
+1 (non-binding) Thanks Priya for the FLIP and driving it! Best, Muhammet On 2024-04-12 21:56, Dhingra, Priya wrote: Hi devs, Thank you to everyone for the feedback on FLIP-438: Amazon SQS Sink

Re: [DISCUSS] FLIP-438: Amazon SQS Sink Connector

2024-04-15 Thread Muhammet Orazov
ion there. Would it make sense to use here docker based integration testing using Testcontainer +1, we typically use localstack for the Integration tests and hit AWS in the e2e test packages. Having coverage of both will be great. Thanks, Danny On Mon, Apr 15, 2024 at 3:23 AM Muhammet O

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Muhammet Orazov
Congratulations Zakelly! Best, Muhammet On 2024-04-15 02:50, Yuan Mei wrote: Hi everyone, On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become a new Flink Committer! Zakelly has been continuously contributing to the Flink project since 2020, with a focus area on

Re: [DISCUSS] FLIP-438: Amazon SQS Sink Connector

2024-04-14 Thread Muhammet Orazov
Hey Priya, Thanks for the FLIP and driving it! One question from my side on test plan: End to end integration tests that hit the real Amazon SQS service. These tests will be enabled when credentials are defined. Would it make sense to use here docker based integration testing using

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Muhammet Orazov
Congratulations Lincoln! Well deserved! Best, Muhammet On 2024-04-12 07:59, Jark Wu wrote: Hi everyone, On behalf of the PMC, I'm very happy to announce that Lincoln Lee has joined the Flink PMC! Lincoln has been an active member of the Apache Flink community for many years. He mainly works

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Muhammet Orazov
Congratulations Jing! Well deserved! Best, Muhammet On 2024-04-12 08:02, Jark Wu wrote: Hi everyone, On behalf of the PMC, I'm very happy to announce that Jing Ge has joined the Flink PMC! Jing has been contributing to Apache Flink for a long time. He continuously works on SQL, connectors,

[jira] [Created] (FLINK-35078) Include Flink CDC pipeline connector sub-modules in the CI runs

2024-04-11 Thread Muhammet Orazov (Jira)
Muhammet Orazov created FLINK-35078: --- Summary: Include Flink CDC pipeline connector sub-modules in the CI runs Key: FLINK-35078 URL: https://issues.apache.org/jira/browse/FLINK-35078 Project: Flink

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-10 Thread Muhammet Orazov
Hey Rui, +1 (non-binding). Thanks for driving it! Best, Muhammet On 2024-04-10 04:36, Rui Fan wrote: Hi devs, Thank you to everyone for the feedback on FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI[1] which has been discussed in this thread [2]. I would like to start

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

2024-04-09 Thread Muhammet Orazov
Hey Xuannan, Thanks for the FLIP and your efforts! Minor clarification from my side: We will relocate these ConfigOptions to a class that is included in the documentation generation. Would it make sense to define also in the FLIP the options class for these variables? For example,

Re: Inquiry Regarding Azure Pipelines

2024-04-09 Thread Muhammet Orazov
Hey Robert, Thanks for fixing the flinkbot issue. Thanks for your efforts (including Mathias and Lorenzo)! Best, Muhammet p.s. Mandatory XKCD: https://xkcd.com/2347/ On 2024-04-03 16:52, Robert Metzger wrote: Hi Yisha, flinkbot is currently not active, so new PRs are not triggering any

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-09 Thread Muhammet Orazov
Hey Wudi, Thanks for your efforts. +1 (non-binding) Best, Muhammet On 2024-04-09 02:47, wudi wrote: Hi devs, I would like to start a vote about FLIP-399 [1]. The FLIP is about contributing the Flink Doris Connector[2] to the Flink community. Discussion thread [3]. The vote will be open

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-28 Thread Muhammet Orazov
dition to Flink UI. Thanks Rui for starting a FLIP for this improvement. Regards Venkata krishnan On Wed, Mar 27, 2024 at 4:49 AM Muhammet Orazov wrote: Hello Rui, Thanks for the proposal! It looks good! I have minor clarification from my side: The execution mode is also used for the DataStream

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-27 Thread Muhammet Orazov
Hello Rui, Thanks for the proposal! It looks good! I have minor clarification from my side: The execution mode is also used for the DataStream API [1], would that also affect/hide the DataStream execution mode if we remove it from the WebUI? Best, Muhammet [1]:

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.8.0 released

2024-03-25 Thread Muhammet Orazov
Great! Thanks Maximilian and everyone involved for the effort and release! Best, Muhammet On 2024-03-25 10:35, Maximilian Michels wrote: The Apache Flink community is very happy to announce the release of the Apache Flink Kubernetes Operator version 1.8.0. The Flink Kubernetes Operator

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-22 Thread Muhammet Orazov
Congratulations! Thanks for the great effort! Best, Muhammet Orazov On 2024-03-20 13:34, Leonard Xu wrote: Hi devs and users, We are thrilled to announce that the donation of Flink CDC as a sub-project of Apache Flink has completed. We invite you to explore the new resources available