Re:[VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Feifan Wang
+1 (non binding) —— Best regards, Feifan Wang At 2024-06-25 16:58:22, "Piotr Nowojski" wrote: >Hi all, > >I would like to start a vote for the FLIP-444 [1]. The discussion thread is >here [2]. > >The vote will be open for at least 72. > >Best, >Piotrek > >[1] https://cwiki.ap

[jira] [Created] (FLINK-35719) [Source]NullPointerException cause by RecordsWithSplitIds.finishedSplits()

2024-06-27 Thread zyh (Jira)
zyh created FLINK-35719: --- Summary: [Source]NullPointerException cause by RecordsWithSplitIds.finishedSplits() Key: FLINK-35719 URL: https://issues.apache.org/jira/browse/FLINK-35719 Project: Flink I

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread yue ma
+1 (non-binding) Piotr Nowojski 于2024年6月25日周二 16:59写道: > Hi all, > > I would like to start a vote for the FLIP-444 [1]. The discussion thread is > here [2]. > > The vote will be open for at least 72. > > Best, > Piotrek > > [1] https://cwiki.apache.org/confluence/x/rAn9EQ > [2] https://lists.apa

[jira] [Created] (FLINK-35718) Cherrypick DBZ-5333 to fix frequently failover by EOFException.

2024-06-27 Thread LvYanquan (Jira)
LvYanquan created FLINK-35718: - Summary: Cherrypick DBZ-5333 to fix frequently failover by EOFException. Key: FLINK-35718 URL: https://issues.apache.org/jira/browse/FLINK-35718 Project: Flink Is

[jira] [Created] (FLINK-35717) Allow DISTRIBUTED BY in CREATE TABLE AS (CTAS)

2024-06-27 Thread Jira
Sergio Peña created FLINK-35717: --- Summary: Allow DISTRIBUTED BY in CREATE TABLE AS (CTAS) Key: FLINK-35717 URL: https://issues.apache.org/jira/browse/FLINK-35717 Project: Flink Issue Type: Sub-

Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-06-27 Thread Jeyhun Karimov
Hi Wencong, Thanks for the FLIP. +1 for it. Providing hints to users will enable more optimization potential for DSv2. I have a few questions. I think currently, DSv2 ExecutionEnvironment does not support getting execution plan (getExecutionPlan()). Do you plan to integrate these annotations wit

[jira] [Created] (FLINK-35716) Fix use of AsyncScalarFunction in join conditions

2024-06-27 Thread Alan Sheinberg (Jira)
Alan Sheinberg created FLINK-35716: -- Summary: Fix use of AsyncScalarFunction in join conditions Key: FLINK-35716 URL: https://issues.apache.org/jira/browse/FLINK-35716 Project: Flink Issue T

Re: Question about v2 committer guarantees

2024-06-27 Thread Scott Sandre
Thanks for the answers, Fabian! To follow up: *1.* SGTM, thanks! *2.* << If some of the RPCs are delayed or do not reach the manager, the Committer will accumulate committables from multiple checkpoints. >> So does that mean it's possible for the Commiter to commit Committables for checkpointIds=

Re: [ANNOUNCE] Apache Flink CDC 3.1.1 released

2024-06-27 Thread Ahmed Hamdy
Congratulations, Thanks for the efforts Best Regards Ahmed Hamdy On Thu, 20 Jun 2024 at 12:57, Muhammet Orazov wrote: > Great, thanks Qingsheng for your efforts! > > Best, > Muhammet > > On 2024-06-18 15:50, Qingsheng Ren wrote: > > The Apache Flink community is very happy to announce the relea

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Ahmed Hamdy
+1 (non-binding) Best Regards Ahmed Hamdy On Thu, 27 Jun 2024 at 17:29, Martijn Visser wrote: > +1 (binding) > > On Thu, Jun 27, 2024 at 3:32 AM Rui Fan <1996fan...@gmail.com> wrote: > > > +1(binding) > > > > Best, > > Rui > > > > On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter > > wrote: > >

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Martijn Visser
+1 (binding) On Thu, Jun 27, 2024 at 3:32 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter > wrote: > > > > > +1 (binding) > > > > Best, > > Stefan > > > > > > > > > On 26. Jun 2024, at 16:14, Hong wrote: > > > > > > +1 (

Re: [DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Dawid Wysakowicz
I’ve seen fixes for the blocker has been merged. Thank you! I’ll proceed with my original plan and prepare a release tomorrow if there are no further concerns. On Thu, 27 Jun 2024 at 15:06, Zakelly Lan wrote: > Hi Sergey, > > FYI we also meet the regression of stringRead or stringWrite when upgr

[jira] [Created] (FLINK-35715) Mysql Source support schema cache to deserialize record

2024-06-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35715: - Summary: Mysql Source support schema cache to deserialize record Key: FLINK-35715 URL: https://issues.apache.org/jira/browse/FLINK-35715 Project: Flink Iss

Re: [DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Zakelly Lan
Hi Sergey, FYI we also meet the regression of stringRead or stringWrite when upgrading the JMH[1]. I guess it is caused by JIT. I'd suggest accepting it if JIT is so sensitive to 'unrelated' change in codebase, since this probably won't be a problem in production environment. I recommend we do no

Re: [DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Sergey Nuyanzin
Thanks for starting this discussion Dawid In general I'm +1 for the release IIRC there is one blocker for flink-shaded[1] which was the reason of downgrading it from 18 to 17[2] I would suggest to resolve it first [1] https://issues.apache.org/jira/browse/FLINK-34234 [2] https://issues.apache.o

Re: Question about v2 committer guarantees

2024-06-27 Thread Fabian Paul
Hi Scott, It's great to see further adoption of the Sink V2 architecture. Happy to answer your questions. 1. The sink architecture should ensure that Committer:commit is always called with all committables from a subtask for a given subtaskId.There is an open issue where users have reported a pro

[DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Dawid Wysakowicz
Hi, I'd like to propose releasing flink-shaded 19.0. I suggest it has a very limited scope and include just shading of com.jayway.jsonpath:json-path[1] This would let us fix FLINK-35696[2] If there are no objections, I'd prepare a release. [1] https://github.com/apache/flink-shaded/commit/b23e1a

[DISCUSS]FLIP-XXX Add processing of unmatched events in Flink CEP

2024-06-27 Thread Anton Sidorov
Hello! Our team works with Flink CEP library for real time events processing. But we noticed that some non-matching events are lost. We propose some changes in the Flink CEP library that provide the ability to handle non-matching events. We propose adding a new interface UnmatchedEventsHandler s

[jira] [Created] (FLINK-35714) Flink CDC pipeline sink support Automatic create tag

2024-06-27 Thread melin (Jira)
melin created FLINK-35714: - Summary: Flink CDC pipeline sink support Automatic create tag Key: FLINK-35714 URL: https://issues.apache.org/jira/browse/FLINK-35714 Project: Flink Issue Type: Improvemen