[jira] [Created] (FLINK-35417) JobManager and TaskManager support merging and run in a single process

2024-05-21 Thread melin (Jira)
melin created FLINK-35417: - Summary: JobManager and TaskManager support merging and run in a single process Key: FLINK-35417 URL: https://issues.apache.org/jira/browse/FLINK-35417 Project: Flink

Re: [DISCUSS] The performance of serializerHeavyString starts regress since April 3

2024-05-21 Thread Zakelly Lan
Hi Rui and RMs of Flink 1.20, Thanks for driving this! Available information indicates this issue is environment- and JDK-specific, and I also failed to reproduce it in my Mac. Thus I guess it is caused by JIT behavior, which is unpredictable and vulnerable to disturbance of the codebase.

[jira] [Created] (FLINK-35416) Weekly CI for ElasticSearch connector failed to compile

2024-05-21 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35416: -- Summary: Weekly CI for ElasticSearch connector failed to compile Key: FLINK-35416 URL: https://issues.apache.org/jira/browse/FLINK-35416 Project: Flink Issue

Re: [DISCUSS] FLIP-451: Refactor Async sink API

2024-05-21 Thread Leonard Xu
Thanks for your reply, Ahmed. > (2) The FLIP-451 aims to introduce a timeout configuration, but I didn’t >> find the configuration in FLIP even I lookup some historical versions of >> the FLIP. Did I miss some key informations? >> > > Yes, I tried to implicitly point that it will be added to

Re: [VOTE] Release flink-connector-cassandra v3.2.0, release candidate #1

2024-05-21 Thread Hang Ruan
+1 (non-binding) - Validated checksum hash - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven and jdk8 - Verified web PR - Check that the jar is built by jdk8 Best, Hang Muhammet Orazov 于2024年5月22日周三 04:15写道: > Hey all, > > Could we

[jira] [Created] (FLINK-35415) CDC Fails to create sink with Flink 1.19

2024-05-21 Thread yux (Jira)
yux created FLINK-35415: --- Summary: CDC Fails to create sink with Flink 1.19 Key: FLINK-35415 URL: https://issues.apache.org/jira/browse/FLINK-35415 Project: Flink Issue Type: Bug Components:

Re: [VOTE] Release flink-connector-cassandra v3.2.0, release candidate #1

2024-05-21 Thread Muhammet Orazov
Hey all, Could we please get some more votes to proceed with the release? Thanks and best, Muhammet On 2024-04-22 13:04, Danny Cranmer wrote: Hi everyone, Please review and vote on release candidate #1 for flink-connector-cassandra v3.2.0, as follows: [ ] +1, Approve the release [ ] -1, Do

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

2024-05-21 Thread Piotr Nowojski
Hi Zakelly and others, > 1. I'd suggest also providing `isInterruptable()` in `Mail`, and the > continuation mail will return true. The FLIP-425 will leverage this queue > to execute some state requests, and when the cp arrives, the operator may > call `yield()` to drain. It may happen that the

Re: [DISCUSS] FLIP-451: Refactor Async sink API

2024-05-21 Thread Ahmed Hamdy
Hi Leonard, Thanks for joining the discussion. > (1)I’m confused about the discuss thread name ‘FLIP-451: Refactor Async > sink API’ and FLIP title/vote thread name ' > FLIP-451: Introduce timeout configuration to AsyncSink API < >

[jira] [Created] (FLINK-35414) Cancel jobs through rest api for last-state upgrades

2024-05-21 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-35414: -- Summary: Cancel jobs through rest api for last-state upgrades Key: FLINK-35414 URL: https://issues.apache.org/jira/browse/FLINK-35414 Project: Flink Issue Type:

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-21 Thread Leonard Xu
Thanks Jerry for kicking off this thread, the idea makes sense to me, JDBC Sink is users’ need and Flink CDC project should support it soon. Could you share your design docs(FLIP) firstly[1]? And then we can continue the design discussion. Please feel free to ping me if you have any concerns

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-21 Thread Keith Lee
Hi Lorenzo I have a couple of questions: 1. Can the FLIP include at least one implementation of JDBC based connector using proposed changes? Implementing a connector and solving challenges that arise using the proposed change will give good insight. 2. The example seems to restrict the connector

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-21 Thread Lincoln Lee
Hi Jane, Thanks for the updates! Just one small comment on the options in IncrementalAggregateRule & RelNodeBlock, should we also change the API level from Experimental to PublicEvolving? Best, Lincoln Lee Jane Chan 于2024年5月21日周二 16:41写道: > Hi all, > > Thanks for your valuable feedback! >

Re: [DISCUSS] FLIP-451: Refactor Async sink API

2024-05-21 Thread Leonard Xu
Thanks Ahmed for kicking off this discussion, sorry for jumping the discussion late. (1)I’m confused about the discuss thread name ‘FLIP-451: Refactor Async sink API’ and FLIP title/vote thread name ' FLIP-451: Introduce timeout configuration to AsyncSink API

Re: [DISCUSS] Flink upgrade compatibility page not updated for Flink 1.19

2024-05-21 Thread Lincoln Lee
Thanks Aleksandr for fixing this missing change! It was my oversight during the last release. I had gone offline to @Hangxiang Yu before rc1 to confirm the 1.19 compatibility changes and confirmed that there were no changes (so your pr should be correct), but finally I didn't make it into

[jira] [Created] (FLINK-35413) VertexFinishedStateCheckerTest causes exit 239

2024-05-21 Thread Ryan Skraba (Jira)
Ryan Skraba created FLINK-35413: --- Summary: VertexFinishedStateCheckerTest causes exit 239 Key: FLINK-35413 URL: https://issues.apache.org/jira/browse/FLINK-35413 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-21 Thread Leonard Xu
Thanks Lorenzo for kicking off this discussion. +1 for the motivation, and I left some comments as following: (1) Please add API annotation for all Proposed public interfaces (2) JdbcConnectionOptionsParser/JdbcReadOptionsParser/JdbcExecutionOptionsParser offer two methods validate and

Re: [VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-21 Thread Leonard Xu
+1(binding), thanks Joao Boto for driving this FLIP. Best, Leonard > 2024年5月17日 下午4:34,Ahmed Hamdy 写道: > > Hi all, > +1 (non-binding) > Best Regards > Ahmed Hamdy > > > On Fri, 17 May 2024 at 02:13, Jiabao Sun wrote: > >> Thanks for driving this proposal! >> >> +1 (binding) >> >> Best,

[DISCUSS] The performance of serializerHeavyString starts regress since April 3

2024-05-21 Thread Rui Fan
Hi devs: We(release managers of flink 1.20) wanna update one performance regresses to the flink dev mail list. # Background: The performance of serializerHeavyString starts regress since April 3, and we created FLINK-35040[1] to follow it. In brief: - The performance only regresses for jdk 11,

[DISCUSS] Flink upgrade compatibility page not updated for Flink 1.19

2024-05-21 Thread Aleksandr Pilipenko
Hi all, Current version of documentation missing savepoint compatibility data for Flink 1.19 [1]. I have created a ticket [2] and PRs to address this, but wanted to clarify if there any changes that make savepoint compatibility different from previous releases? I did not find any changes related

[jira] [Created] (FLINK-35412) Batch execution of async state request callback

2024-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35412: --- Summary: Batch execution of async state request callback Key: FLINK-35412 URL: https://issues.apache.org/jira/browse/FLINK-35412 Project: Flink Issue Type:

[jira] [Created] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35411: --- Summary: Optimize wait logic in draining of async state requests Key: FLINK-35411 URL: https://issues.apache.org/jira/browse/FLINK-35411 Project: Flink Issue

[jira] [Created] (FLINK-35410) Avoid sync waiting in coordinator thread of ForSt executor

2024-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35410: --- Summary: Avoid sync waiting in coordinator thread of ForSt executor Key: FLINK-35410 URL: https://issues.apache.org/jira/browse/FLINK-35410 Project: Flink

[jira] [Created] (FLINK-35409) Request more splits if all splits are filtered from addSplits method

2024-05-21 Thread Xiao Huang (Jira)
Xiao Huang created FLINK-35409: -- Summary: Request more splits if all splits are filtered from addSplits method Key: FLINK-35409 URL: https://issues.apache.org/jira/browse/FLINK-35409 Project: Flink

Re: [VOTE] FLIP-451: Introduce timeout configuration to AsyncSink

2024-05-21 Thread Hong Liang
+1 (binding) Thanks Ahmed On Tue, May 14, 2024 at 11:51 AM David Radley wrote: > Thanks for the clarification Ahmed > > +1 (non-binding) > > From: Ahmed Hamdy > Date: Monday, 13 May 2024 at 19:58 > To: dev@flink.apache.org > Subject: [EXTERNAL] Re: [VOTE] FLIP-451: Introduce timeout

[jira] [Created] (FLINK-35408) Add 30 min tolerance value when validating the time-zone setting

2024-05-21 Thread Xiao Huang (Jira)
Xiao Huang created FLINK-35408: -- Summary: Add 30 min tolerance value when validating the time-zone setting Key: FLINK-35408 URL: https://issues.apache.org/jira/browse/FLINK-35408 Project: Flink

Re: [DISCUSS] Proposing an LTS Release for the 1.x Line

2024-05-21 Thread Alexander Fedulov
Hi everyone, let's finalize this discussion. As Martijn suggested, I summarized this thread into a FLIP [1]. Please take a look and let me know if there’s anything important that I might have missed. Best, Alex [1] https://cwiki.apache.org/confluence/x/BApeEg On Tue, 23 Jan 2024 at 03:30, Rui

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-21 Thread Jane Chan
Hi all, Thanks for your valuable feedback! To @Xuannan For options to be moved to another module/package, I think we have to > mark the old option deprecated in 1.20 for it to be removed in 2.0, > according to the API compatibility guarantees[1]. We can introduce the > new option in 1.20 with

Re: [DISCUSS] FLIP-451: Refactor Async sink API

2024-05-21 Thread Ahmed Hamdy
Hi Hong, Thanks for pointing that out, no we are not deprecating getFatalExceptionCons(). I have updated the FLIP Best Regards Ahmed Hamdy On Mon, 20 May 2024 at 15:40, Hong Liang wrote: > Hi Ahmed, > Thanks for putting this together! Should we still be marking > getFatalExceptionCons() as

[jira] [Created] (FLINK-35407) ensure orderly transactions during the full consumption stage of MySQL CDC

2024-05-21 Thread xiaotouming (Jira)
xiaotouming created FLINK-35407: --- Summary: ensure orderly transactions during the full consumption stage of MySQL CDC Key: FLINK-35407 URL: https://issues.apache.org/jira/browse/FLINK-35407 Project:

[jira] [Created] (FLINK-35406) Use inner serializer when casting RAW type to BINARY or STRING in cast rules

2024-05-21 Thread Zhenghua Gao (Jira)
Zhenghua Gao created FLINK-35406: Summary: Use inner serializer when casting RAW type to BINARY or STRING in cast rules Key: FLINK-35406 URL: https://issues.apache.org/jira/browse/FLINK-35406