[jira] [Created] (FLINK-35747) customer ‘rest.bind-address' config overwrite by code

2024-07-03 Thread dncba (Jira)
dncba created FLINK-35747: - Summary: customer ‘rest.bind-address' config overwrite by code Key: FLINK-35747 URL: https://issues.apache.org/jira/browse/FLINK-35747 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35746) Add logic to override observed config based on settings observed through REST API

2024-07-03 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-35746: -- Summary: Add logic to override observed config based on settings observed through REST API Key: FLINK-35746 URL: https://issues.apache.org/jira/browse/FLINK-35746

[jira] [Created] (FLINK-35745) Add namespace convention doc for Flink lineage

2024-07-02 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-35745: - Summary: Add namespace convention doc for Flink lineage Key: FLINK-35745 URL: https://issues.apache.org/jira/browse/FLINK-35745 Project: Flink Issue

[DISCUSS] FLIP-467: Introduce Generalized Watermarks

2024-07-02 Thread Jeyhun Karimov
Hi devs, I'd like to start a discussion about FLIP-467: Introduce Generalized Watermarks [1] . This is another sub-FLIP of DataStream API V2 [2]. After this FLIP one can declare generalized (custom) watermarks and define their custom propagation and alignment process. This FLIP opens new

Re: [VOTE] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-02 Thread Sergey Nuyanzin
Thanks for driving this +1 (binding) On Tue, Jul 2, 2024, 11:21 Martijn Visser wrote: > +1 (binding) > > On Mon, Jul 1, 2024 at 7:00 PM Jim Hughes > wrote: > > > Hi Alexey, > > > > +1 (non-binding) > > > > I'm looking forward to parity between streaming and batch bound for > > compiled plans!

Re: [DISCUSS] FLIP-456: Introduce DESCRIBE FUNCTION

2024-07-02 Thread Natea Eshetu Beshada
@Timo Walther @Yanquan Lv @Jim Hughes Thank you for saying that the FLIP looks good. @Feng Jin, +1 to what Timo already said above, does that address your concern? This FLIP seems to pretty uncontroversial so far so perhaps we can start a vote soon? Maybe tomorrow before the 4th of July

[jira] [Created] (FLINK-35744) Support flink 1.19 config.yaml format

2024-07-02 Thread Diljeet Singh (Jira)
Diljeet Singh created FLINK-35744: - Summary: Support flink 1.19 config.yaml format Key: FLINK-35744 URL: https://issues.apache.org/jira/browse/FLINK-35744 Project: Flink Issue Type:

[jira] [Created] (FLINK-35743) The time zone configuration for temporal functions is not effective

2024-07-02 Thread Wenkai Qi (Jira)
Wenkai Qi created FLINK-35743: - Summary: The time zone configuration for temporal functions is not effective Key: FLINK-35743 URL: https://issues.apache.org/jira/browse/FLINK-35743 Project: Flink

[jira] [Created] (FLINK-35742) Don't create RocksDB CF if task cancellation is in progress

2024-07-02 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-35742: - Summary: Don't create RocksDB CF if task cancellation is in progress Key: FLINK-35742 URL: https://issues.apache.org/jira/browse/FLINK-35742 Project: Flink

[SUMMARY] Flink 1.20 Release Sync 07/02/2024

2024-07-02 Thread Rui Fan
Dear devs, This is the third meeting after the feature freeze of Flink 1.20. I'd like to share the information synced in the meeting. - Timeline Flink 1.20 doesn't have any blocker for now, and we hope all Cross-team release testing can be finished next week. We plan to start creating

[jira] [Created] (FLINK-35741) It' tell me 'This is a bug. Please file an issue.' when I executing the Flink Table API

2024-07-02 Thread bear.xiong (Jira)
bear.xiong created FLINK-35741: -- Summary: It' tell me 'This is a bug. Please file an issue.' when I executing the Flink Table API Key: FLINK-35741 URL: https://issues.apache.org/jira/browse/FLINK-35741

[jira] [Created] (FLINK-35740) [mysql] Allow column as chunk key even if not in Primary Keys

2024-07-02 Thread Lee SeungMin (Jira)
Lee SeungMin created FLINK-35740: Summary: [mysql] Allow column as chunk key even if not in Primary Keys Key: FLINK-35740 URL: https://issues.apache.org/jira/browse/FLINK-35740 Project: Flink

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2024-07-02 Thread Ahmed Hamdy
Hi Martijn, yes, I agree, thanks for confirmation. Best Regards Ahmed Hamdy On Tue, 2 Jul 2024 at 12:30, Martijn Visser wrote: > Hi, > > Since PubSub Lite is deprecated, I think we can safely close this FLIP and > not proceed further [1] > > Best regards, > > Martijn > > [1]

Re: [DISCUSS] FLIP-299 Pub/Sub Lite Connector

2024-07-02 Thread Martijn Visser
Hi, Since PubSub Lite is deprecated, I think we can safely close this FLIP and not proceed further [1] Best regards, Martijn [1] https://cloud.google.com/pubsub/docs/choosing-pubsub-or-lite On Sun, Jun 9, 2024 at 12:23 AM Ahmed Hamdy wrote: > Hi all, > I wonder if we can revive the

Re: [VOTE] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-02 Thread Martijn Visser
+1 (binding) On Mon, Jul 1, 2024 at 7:00 PM Jim Hughes wrote: > Hi Alexey, > > +1 (non-binding) > > I'm looking forward to parity between streaming and batch bound for > compiled plans! > > Cheers, > > Jim > > On Mon, Jul 1, 2024 at 12:55 PM Alexey Leonov-Vendrovskiy < > vendrov...@gmail.com>

Re: [VOTE] Release flink-shaded 19.0, release candidate #1

2024-07-02 Thread Yuxin Tan
+1 (non-binding) - build from source - verified website pr - verified hash and signature Best, Yuxin weijie guo 于2024年7月2日周二 15:27写道: > +1 (binding) > > - Verified hash and signature > - Build from source > - Verified website PR > > Best regards, > > Weijie > > > Martijn Visser 于2024年7月1日周一

[jira] [Created] (FLINK-35739) FLIP-444: Native file copy support

2024-07-02 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35739: -- Summary: FLIP-444: Native file copy support Key: FLINK-35739 URL: https://issues.apache.org/jira/browse/FLINK-35739 Project: Flink Issue Type: New

[RESULT][VOTE] FLIP-444: Native file copy support

2024-07-02 Thread Piotr Nowojski
I would like to announce that FLIP-444 [1] has been accepted. There were 13 votes in favour: - Roman (binding) - Zakelly (binding) - Hong (binding) - Stefan (binding) - Rui Fan (binding) - Marijn (binding) - Piotr Nowojski (binding) - Yuepeng Pan - Keith - Ahmed Hamdy - Yue Ma - Fiefan Wang -

Re: [VOTE] FLIP-444: Native file copy support

2024-07-02 Thread Piotr Nowojski
Voting is closed, thank you for voting! I will post the results soon. Best, Piotrek pt., 28 cze 2024 o 10:02 Ferenc Csaky napisał(a): > +1 (non-binding) > > Best, > Ferenc > > > > > On Friday, 28 June 2024 at 06:27, Feifan Wang wrote: > > > > > > > +1 (non binding) > > > > > > > > > >

[jira] [Created] (FLINK-35738) Release Testing: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order

2024-07-02 Thread Rui Fan (Jira)
Rui Fan created FLINK-35738: --- Summary: Release Testing: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order Key: FLINK-35738 URL:

Re: [VOTE] Release flink-shaded 19.0, release candidate #1

2024-07-02 Thread weijie guo
+1 (binding) - Verified hash and signature - Build from source - Verified website PR Best regards, Weijie Martijn Visser 于2024年7月1日周一 21:30写道: > +1 (binding) > > - Validated hashes > - Verified signature > - Verified that no binaries exist in the source archive > - Build the source with

[jira] [Created] (FLINK-35737) Prevent Memory Leak by Closing MemoryExecutionGraphInfoStore on MiniCluster Shutdown

2024-07-01 Thread Feng Jiajie (Jira)
Feng Jiajie created FLINK-35737: --- Summary: Prevent Memory Leak by Closing MemoryExecutionGraphInfoStore on MiniCluster Shutdown Key: FLINK-35737 URL: https://issues.apache.org/jira/browse/FLINK-35737

Re: [VOTE] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-01 Thread Jim Hughes
Hi Alexey, +1 (non-binding) I'm looking forward to parity between streaming and batch bound for compiled plans! Cheers, Jim On Mon, Jul 1, 2024 at 12:55 PM Alexey Leonov-Vendrovskiy < vendrov...@gmail.com> wrote: > Hello everyone, > > We had a good discussion of FLIP-456: CompiledPlan

[VOTE] FLIP-456: CompiledPlan support for Batch Execution Mode

2024-07-01 Thread Alexey Leonov-Vendrovskiy
Hello everyone, We had a good discussion of FLIP-456: CompiledPlan support for Batch Execution Mode [1]. Discussion thread is here: [2]. Let's start voting on it. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. The FLIP will be considered accepted

Re: [VOTE] Release flink-shaded 19.0, release candidate #1

2024-07-01 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Fri, Jun 28, 2024 at 2:02 PM Timo Walther wrote: > +1 (binding) > > Thanks for fixing the JSON functions! > >

Re: [VOTE] Release flink-shaded 19.0, release candidate #1

2024-07-01 Thread Sergey Nuyanzin
+1 (non-binding) Thanks for driving this - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven, also built Flink with this version - Verified licenses - Verified web PRs On Fri, Jun 28, 2024 at 2:02 PM Timo Walther wrote:

[jira] [Created] (FLINK-35736) Add E2e migration scripts for Flink CDC

2024-07-01 Thread yux (Jira)
yux created FLINK-35736: --- Summary: Add E2e migration scripts for Flink CDC Key: FLINK-35736 URL: https://issues.apache.org/jira/browse/FLINK-35736 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35735) Don't list catalogs when closing session

2024-07-01 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-35735: - Summary: Don't list catalogs when closing session Key: FLINK-35735 URL: https://issues.apache.org/jira/browse/FLINK-35735 Project: Flink Issue Type:

Re:Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-01 Thread Wencong Liu
Hi, Jeyhun, Thanks for the reply. > Integrate these annotations with the execution plan. I believe DataStream is an Imperative API, which means that the actual execution plan is basically consistent with the computational logic expressed by the user with DataStream, and it is different from

Re: [DISCUSS] FLIP-456: Introduce DESCRIBE FUNCTION

2024-07-01 Thread Timo Walther
Hi Natea, the FLIPs looks good to me. Looking for forward to it. @Feng: TypeInferenceUtil#generateSignature considers parameter names if they have been specified. We can further evolve this function (e.g. improving the result type information), but this is not part of the FLIP. This requires

[RESULT] [VOTE] Apache Flink Kubernetes Operator Release 1.9.0, release candidate #1

2024-07-01 Thread Gyula Fóra
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 4 of which are binding: * Rui Fan (binding) * Gyula Fora (binding) * Robert Metzger (binding) * Thomas Weise (binding) * Mate Czagany (non-binding) There are no disapproving votes. Thanks

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.9.0, release candidate #1

2024-07-01 Thread Gyula Fóra
Thank you all! I am closing this vote now and will post the results in another thread. Thank you On Fri, Jun 28, 2024 at 7:10 PM Thomas Weise wrote: > +1 (binding) > > - verified source signatures/hashes > - build from source and tests pass > - install from packaged helm chart > > Thanks, >

[jira] [Created] (FLINK-35734) Not override the user-defined checkpoint interval in continuous mode.

2024-06-30 Thread Feng Jin (Jira)
Feng Jin created FLINK-35734: Summary: Not override the user-defined checkpoint interval in continuous mode. Key: FLINK-35734 URL: https://issues.apache.org/jira/browse/FLINK-35734 Project: Flink

[jira] [Created] (FLINK-35733) Change org.jetbrains.annotations.NotNull to javax.annotation.Nonnull

2024-06-30 Thread RocMarshal (Jira)
RocMarshal created FLINK-35733: -- Summary: Change org.jetbrains.annotations.NotNull to javax.annotation.Nonnull Key: FLINK-35733 URL: https://issues.apache.org/jira/browse/FLINK-35733 Project: Flink

[jira] [Created] (FLINK-35732) flink-sql-client.sh fails with ClassNotFoundException depending on it's location

2024-06-30 Thread Rob Young (Jira)
Rob Young created FLINK-35732: - Summary: flink-sql-client.sh fails with ClassNotFoundException depending on it's location Key: FLINK-35732 URL: https://issues.apache.org/jira/browse/FLINK-35732 Project:

[jira] [Created] (FLINK-35731) Sink V2 operator is mistakenly assumed always to be parallelism configured

2024-06-30 Thread Junrui Li (Jira)
Junrui Li created FLINK-35731: - Summary: Sink V2 operator is mistakenly assumed always to be parallelism configured Key: FLINK-35731 URL: https://issues.apache.org/jira/browse/FLINK-35731 Project: Flink

Re: [DISCUSS] FLIP-456: Introduce DESCRIBE FUNCTION

2024-06-30 Thread Feng Jin
Hi, Natea, Thank you for initiating this FLIP. Have you considered displaying parameter names? This would make it easier for users to use named parameters. Best, Feng On Sun, Jun 30, 2024 at 3:49 PM Yanquan Lv wrote: > Hi, Natea. This FLIP looks good from my side. > I also look forward to

Re: [DISCUSS] FLIP-456: Introduce DESCRIBE FUNCTION

2024-06-30 Thread Yanquan Lv
Hi, Natea. This FLIP looks good from my side. I also look forward to showing the return type, as well as auxiliary information such as comments or usage, although the current implementation does not include this part. Natea Eshetu Beshada 于2024年6月26日周三 03:01写道: > Oh no haha, yes thanks for

[jira] [Created] (FLINK-35730) PipelineDefinitionParser add parse string method

2024-06-29 Thread Wenkai Qi (Jira)
Wenkai Qi created FLINK-35730: - Summary: PipelineDefinitionParser add parse string method Key: FLINK-35730 URL: https://issues.apache.org/jira/browse/FLINK-35730 Project: Flink Issue Type: New

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.9.0, release candidate #1

2024-06-28 Thread Thomas Weise
+1 (binding) - verified source signatures/hashes - build from source and tests pass - install from packaged helm chart Thanks, Thomas On Fri, Jun 28, 2024 at 5:29 AM Robert Metzger wrote: > +1 (binding) > > - checked the docker file contents > - installed the operator from the helm chart > -

[ANNOUNCE] Release 1.20.0, release candidate #0

2024-06-28 Thread weijie guo
Hi everyone, The release candidate #0(i.e. RC0) for Apache Flink 1.20.0 has been created. This RC is currently for preview only to facilitate the integrated testing and we don't have to vote on it. RC1 is expected to be released a week later If we find no new blocker in RC0. The related

[jira] [Created] (FLINK-35729) HiveITCase.testReadWriteHive

2024-06-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-35729: - Summary: HiveITCase.testReadWriteHive Key: FLINK-35729 URL: https://issues.apache.org/jira/browse/FLINK-35729 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35728) PyFlink end-to-end test because miniconda couldn't be downloaded

2024-06-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-35728: - Summary: PyFlink end-to-end test because miniconda couldn't be downloaded Key: FLINK-35728 URL: https://issues.apache.org/jira/browse/FLINK-35728 Project: Flink

[jira] [Created] (FLINK-35727) "Run kubernetes pyflink application test" failed due to access denied issue

2024-06-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-35727: - Summary: "Run kubernetes pyflink application test" failed due to access denied issue Key: FLINK-35727 URL: https://issues.apache.org/jira/browse/FLINK-35727

[jira] [Created] (FLINK-35726) Data Stream to Table API converts Map to RAW 'java.util.Map'

2024-06-28 Thread David Perkins (Jira)
David Perkins created FLINK-35726: - Summary: Data Stream to Table API converts Map to RAW 'java.util.Map' Key: FLINK-35726 URL: https://issues.apache.org/jira/browse/FLINK-35726 Project: Flink

[jira] [Created] (FLINK-35725) Translate new DISTRIBUTED BY documentation into Chinese

2024-06-28 Thread Jim Hughes (Jira)
Jim Hughes created FLINK-35725: -- Summary: Translate new DISTRIBUTED BY documentation into Chinese Key: FLINK-35725 URL: https://issues.apache.org/jira/browse/FLINK-35725 Project: Flink Issue

Re: [VOTE] Release flink-shaded 19.0, release candidate #1

2024-06-28 Thread Timo Walther
+1 (binding) Thanks for fixing the JSON functions! Timo On 28.06.24 12:54, Dawid Wysakowicz wrote: Hi everyone, Please review and vote on the release candidate 1 for the version 19.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments)

[jira] [Created] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2024-06-28 Thread zhi.wang (Jira)
zhi.wang created FLINK-35724: Summary: javax.xml.bind.JAXBException not found with jdk11 while writing to oss Key: FLINK-35724 URL: https://issues.apache.org/jira/browse/FLINK-35724 Project: Flink

[VOTE] Release flink-shaded 19.0, release candidate #1

2024-06-28 Thread Dawid Wysakowicz
Hi everyone, Please review and vote on the release candidate 1 for the version 19.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

[jira] [Created] (FLINK-35723) Publish shaded jsonpath

2024-06-28 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-35723: Summary: Publish shaded jsonpath Key: FLINK-35723 URL: https://issues.apache.org/jira/browse/FLINK-35723 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35722) CoordinatorEventsToStreamOperatorRecipientExactlyOnceITCase.testCheckpoint fails because of missed operator event

2024-06-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-35722: - Summary: CoordinatorEventsToStreamOperatorRecipientExactlyOnceITCase.testCheckpoint fails because of missed operator event Key: FLINK-35722 URL:

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.9.0, release candidate #1

2024-06-28 Thread Robert Metzger
+1 (binding) - checked the docker file contents - installed the operator from the helm chart - checked if it can still talk to an existing Flink cluster, deployed from v1.8 On Tue, Jun 25, 2024 at 9:05 AM Gyula Fóra wrote: > +1 (binding) > > Verified: > - Sources/signates > - Install 1.9.0

[jira] [Created] (FLINK-35721) I found out that in the Flink SQL documentation it says that Double type cannot be converted to Boolean type, but in reality, it can.

2024-06-28 Thread jinzhuguang (Jira)
jinzhuguang created FLINK-35721: --- Summary: I found out that in the Flink SQL documentation it says that Double type cannot be converted to Boolean type, but in reality, it can. Key: FLINK-35721 URL:

[jira] [Created] (FLINK-35720) flink-connector-kafka fails to restore from checkpoint when using an EXACTLY_ONCE sink

2024-06-28 Thread Nicolas Ferrario (Jira)
Nicolas Ferrario created FLINK-35720: Summary: flink-connector-kafka fails to restore from checkpoint when using an EXACTLY_ONCE sink Key: FLINK-35720 URL: https://issues.apache.org/jira/browse/FLINK-35720

Re:[VOTE] FLIP-444: Native file copy support

2024-06-28 Thread Ferenc Csaky
+1 (non-binding) Best, Ferenc On Friday, 28 June 2024 at 06:27, Feifan Wang wrote: > > > +1 (non binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-06-25 16:58:22, "Piotr Nowojski" pnowoj...@apache.org wrote: > > > Hi all, > > > > I would

Re: [DISCUSS] Support to group rows by column ordinals

2024-06-28 Thread Muhammet Orazov
Hey Jeyhun, - No, it wont disable the grouping/ordering by the column names. One "disadvantage" is that once the flag is enabled, "GROUP BY 1" will have a different meaning and query result. Ahh I see. Thanks for explaining, it was not obvious for me from the PR and discussions. Best,

Re: [DISCUSS] CLI action deprecation process

2024-06-28 Thread Muhammet Orazov
Hey Ferenc, Thanks for starting the discussion! I agree that the CLI is user facing, but I think we don't have to treat it as other public APIs. I'd propose to throw user friendly exception for `run-application` with suggestion to use `run` case instead. This would make users aware of the

Re:[VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Feifan Wang
+1 (non binding) —— Best regards, Feifan Wang At 2024-06-25 16:58:22, "Piotr Nowojski" wrote: >Hi all, > >I would like to start a vote for the FLIP-444 [1]. The discussion thread is >here [2]. > >The vote will be open for at least 72. > >Best, >Piotrek > >[1]

[jira] [Created] (FLINK-35719) [Source]NullPointerException cause by RecordsWithSplitIds.finishedSplits()

2024-06-27 Thread zyh (Jira)
zyh created FLINK-35719: --- Summary: [Source]NullPointerException cause by RecordsWithSplitIds.finishedSplits() Key: FLINK-35719 URL: https://issues.apache.org/jira/browse/FLINK-35719 Project: Flink

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread yue ma
+1 (non-binding) Piotr Nowojski 于2024年6月25日周二 16:59写道: > Hi all, > > I would like to start a vote for the FLIP-444 [1]. The discussion thread is > here [2]. > > The vote will be open for at least 72. > > Best, > Piotrek > > [1] https://cwiki.apache.org/confluence/x/rAn9EQ > [2]

[jira] [Created] (FLINK-35718) Cherrypick DBZ-5333 to fix frequently failover by EOFException.

2024-06-27 Thread LvYanquan (Jira)
LvYanquan created FLINK-35718: - Summary: Cherrypick DBZ-5333 to fix frequently failover by EOFException. Key: FLINK-35718 URL: https://issues.apache.org/jira/browse/FLINK-35718 Project: Flink

[jira] [Created] (FLINK-35717) Allow DISTRIBUTED BY in CREATE TABLE AS (CTAS)

2024-06-27 Thread Jira
Sergio Peña created FLINK-35717: --- Summary: Allow DISTRIBUTED BY in CREATE TABLE AS (CTAS) Key: FLINK-35717 URL: https://issues.apache.org/jira/browse/FLINK-35717 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-06-27 Thread Jeyhun Karimov
Hi Wencong, Thanks for the FLIP. +1 for it. Providing hints to users will enable more optimization potential for DSv2. I have a few questions. I think currently, DSv2 ExecutionEnvironment does not support getting execution plan (getExecutionPlan()). Do you plan to integrate these annotations

[jira] [Created] (FLINK-35716) Fix use of AsyncScalarFunction in join conditions

2024-06-27 Thread Alan Sheinberg (Jira)
Alan Sheinberg created FLINK-35716: -- Summary: Fix use of AsyncScalarFunction in join conditions Key: FLINK-35716 URL: https://issues.apache.org/jira/browse/FLINK-35716 Project: Flink Issue

Re: Question about v2 committer guarantees

2024-06-27 Thread Scott Sandre
Thanks for the answers, Fabian! To follow up: *1.* SGTM, thanks! *2.* << If some of the RPCs are delayed or do not reach the manager, the Committer will accumulate committables from multiple checkpoints. >> So does that mean it's possible for the Commiter to commit Committables for

Re: [ANNOUNCE] Apache Flink CDC 3.1.1 released

2024-06-27 Thread Ahmed Hamdy
Congratulations, Thanks for the efforts Best Regards Ahmed Hamdy On Thu, 20 Jun 2024 at 12:57, Muhammet Orazov wrote: > Great, thanks Qingsheng for your efforts! > > Best, > Muhammet > > On 2024-06-18 15:50, Qingsheng Ren wrote: > > The Apache Flink community is very happy to announce the

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Ahmed Hamdy
+1 (non-binding) Best Regards Ahmed Hamdy On Thu, 27 Jun 2024 at 17:29, Martijn Visser wrote: > +1 (binding) > > On Thu, Jun 27, 2024 at 3:32 AM Rui Fan <1996fan...@gmail.com> wrote: > > > +1(binding) > > > > Best, > > Rui > > > > On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter > > wrote: >

Re: [VOTE] FLIP-444: Native file copy support

2024-06-27 Thread Martijn Visser
+1 (binding) On Thu, Jun 27, 2024 at 3:32 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter > wrote: > > > > > +1 (binding) > > > > Best, > > Stefan > > > > > > > > > On 26. Jun 2024, at 16:14, Hong wrote: > > > > > > +1

Re: [DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Dawid Wysakowicz
I’ve seen fixes for the blocker has been merged. Thank you! I’ll proceed with my original plan and prepare a release tomorrow if there are no further concerns. On Thu, 27 Jun 2024 at 15:06, Zakelly Lan wrote: > Hi Sergey, > > FYI we also meet the regression of stringRead or stringWrite when

[jira] [Created] (FLINK-35715) Mysql Source support schema cache to deserialize record

2024-06-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35715: - Summary: Mysql Source support schema cache to deserialize record Key: FLINK-35715 URL: https://issues.apache.org/jira/browse/FLINK-35715 Project: Flink

Re: [DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Zakelly Lan
Hi Sergey, FYI we also meet the regression of stringRead or stringWrite when upgrading the JMH[1]. I guess it is caused by JIT. I'd suggest accepting it if JIT is so sensitive to 'unrelated' change in codebase, since this probably won't be a problem in production environment. I recommend we do

Re: [DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Sergey Nuyanzin
Thanks for starting this discussion Dawid In general I'm +1 for the release IIRC there is one blocker for flink-shaded[1] which was the reason of downgrading it from 18 to 17[2] I would suggest to resolve it first [1] https://issues.apache.org/jira/browse/FLINK-34234 [2]

Re: Question about v2 committer guarantees

2024-06-27 Thread Fabian Paul
Hi Scott, It's great to see further adoption of the Sink V2 architecture. Happy to answer your questions. 1. The sink architecture should ensure that Committer:commit is always called with all committables from a subtask for a given subtaskId.There is an open issue where users have reported a

[DISCUSS] Release flink-shaded 19.0

2024-06-27 Thread Dawid Wysakowicz
Hi, I'd like to propose releasing flink-shaded 19.0. I suggest it has a very limited scope and include just shading of com.jayway.jsonpath:json-path[1] This would let us fix FLINK-35696[2] If there are no objections, I'd prepare a release. [1]

[DISCUSS]FLIP-XXX Add processing of unmatched events in Flink CEP

2024-06-27 Thread Anton Sidorov
Hello! Our team works with Flink CEP library for real time events processing. But we noticed that some non-matching events are lost. We propose some changes in the Flink CEP library that provide the ability to handle non-matching events. We propose adding a new interface UnmatchedEventsHandler

[jira] [Created] (FLINK-35714) Flink CDC pipeline sink support Automatic create tag

2024-06-27 Thread melin (Jira)
melin created FLINK-35714: - Summary: Flink CDC pipeline sink support Automatic create tag Key: FLINK-35714 URL: https://issues.apache.org/jira/browse/FLINK-35714 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-06-26 Thread Xintong Song
+1 for this FLIP. I think this is similar to SQL hints, where users can provide optional information to help the engine execute the workload more efficiently. Having a unified mechanism for such kind of hints should improve usability compared to introducing tons of configuration knobs. Best,

[jira] [Created] (FLINK-35713) add

2024-06-26 Thread wuzexian (Jira)
wuzexian created FLINK-35713: Summary: add Key: FLINK-35713 URL: https://issues.apache.org/jira/browse/FLINK-35713 Project: Flink Issue Type: Improvement Reporter: wuzexian --

[jira] [Created] (FLINK-35712) [Release-1.20] Prepare RC0 release

2024-06-26 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35712: -- Summary: [Release-1.20] Prepare RC0 release Key: FLINK-35712 URL: https://issues.apache.org/jira/browse/FLINK-35712 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35711) LocalRecoveryITCase failed on AZP due to exit code: 127

2024-06-26 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35711: -- Summary: LocalRecoveryITCase failed on AZP due to exit code: 127 Key: FLINK-35711 URL: https://issues.apache.org/jira/browse/FLINK-35711 Project: Flink Issue

[jira] [Created] (FLINK-35710) ClusterEntrypointTest failed on AZP due to exit code: 239

2024-06-26 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35710: -- Summary: ClusterEntrypointTest failed on AZP due to exit code: 239 Key: FLINK-35710 URL: https://issues.apache.org/jira/browse/FLINK-35710 Project: Flink Issue

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Rui Fan
+1(binding) Best, Rui On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter wrote: > > +1 (binding) > > Best, > Stefan > > > > > On 26. Jun 2024, at 16:14, Hong wrote: > > > > +1 (binding) > > > > Hong > > > >> On 26 Jun 2024, at 12:27, Keith Lee > wrote: > >> >

[jira] [Created] (FLINK-35709) Allow reordering source column names in CTAS / RTAS

2024-06-26 Thread Jira
Sergio Peña created FLINK-35709: --- Summary: Allow reordering source column names in CTAS / RTAS Key: FLINK-35709 URL: https://issues.apache.org/jira/browse/FLINK-35709 Project: Flink Issue

[jira] [Created] (FLINK-35708) Allow defining a schema in REPLACE TABLE AS (RTAS)

2024-06-26 Thread Jira
Sergio Peña created FLINK-35708: --- Summary: Allow defining a schema in REPLACE TABLE AS (RTAS) Key: FLINK-35708 URL: https://issues.apache.org/jira/browse/FLINK-35708 Project: Flink Issue Type:

[jira] [Created] (FLINK-35707) Allow column definition in CREATE TABLE AS (CTAS)

2024-06-26 Thread Jira
Sergio Peña created FLINK-35707: --- Summary: Allow column definition in CREATE TABLE AS (CTAS) Key: FLINK-35707 URL: https://issues.apache.org/jira/browse/FLINK-35707 Project: Flink Issue Type:

[jira] [Created] (FLINK-35706) FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-26 Thread Jira
Sergio Peña created FLINK-35706: --- Summary: FLIP-463: Schema Definition in CREATE TABLE AS Statement Key: FLINK-35706 URL: https://issues.apache.org/jira/browse/FLINK-35706 Project: Flink Issue

[RESULT][VOTE] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-26 Thread Sergio Pena
Hi everyone, the vote [1] for FLIP-463 [2] is over. The number of required binding votes (3) was reached (total: 8, binding: 3, non-binding: 5). Binding - Timo Walther - Sergey Nuyanzin - Martijn Visser Non-binding - Ferenc Csaky - Jeyhun Karimov - Jim Hughes - Yanquan Lv - Zhongqiang Gong

[DISCUSS] CLI action deprecation process

2024-06-26 Thread Ferenc Csaky
Hello devs, I would like to open a discussion about considerations regarding how to deprecate CLI actions, and what compatibility guarantees should apply to such cases. The topic came up in a previous discussion [1] about a current FLIP to merge the run and run-application behavior [2].

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Stefan Richter
+1 (binding) Best, Stefan > On 26. Jun 2024, at 16:14, Hong wrote: > > +1 (binding) > > Hong > >> On 26 Jun 2024, at 12:27, Keith Lee > > wrote: >> >> +1 (non binding) >> >> Best regards >> Keith Lee >> >> >>> On Wed, Jun 26, 2024 at 9:48 AM

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Hong
+1 (binding) Hong > On 26 Jun 2024, at 12:27, Keith Lee wrote: > > +1 (non binding) > > Best regards > Keith Lee > > >> On Wed, Jun 26, 2024 at 9:48 AM Zakelly Lan wrote: >> +1 (binding) >> Best, >> Zakelly >>> On Wed, Jun 26, 2024 at 3:54 PM Yuepeng Pan wrote: >>> +1 (non-binding) >>>

[jira] [Created] (FLINK-35705) Use region from stream ARN to construct SDK client

2024-06-26 Thread Aleksandr Pilipenko (Jira)
Aleksandr Pilipenko created FLINK-35705: --- Summary: Use region from stream ARN to construct SDK client Key: FLINK-35705 URL: https://issues.apache.org/jira/browse/FLINK-35705 Project: Flink

[jira] [Created] (FLINK-35704) ForkJoinPool introduction to NonSplittingRecursiveEnumerator to vastly improve enumeration performance

2024-06-26 Thread Grzegorz Liter (Jira)
Grzegorz Liter created FLINK-35704: -- Summary: ForkJoinPool introduction to NonSplittingRecursiveEnumerator to vastly improve enumeration performance Key: FLINK-35704 URL:

[DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-06-26 Thread Wencong Liu
Hi devs, I'm proposing a new FLIP[1] to introduce the ProcessFunction Attribute in the DataStream API V2. The goal is to optimize job execution by leveraging additional information about users' ProcessFunction logic. The proposal includes the following scenarios where the ProcessFunction

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Keith Lee
+1 (non binding) Best regards Keith Lee On Wed, Jun 26, 2024 at 9:48 AM Zakelly Lan wrote: > +1 (binding) > > > Best, > Zakelly > > On Wed, Jun 26, 2024 at 3:54 PM Yuepeng Pan wrote: > > > +1 (non-binding) > > > > > > > > > > Best regards, > > > > Yuepeng Pan > > > > > > > > > > > > > > > >

[jira] [Created] (FLINK-35703) Nested comments in CREAT TABLE are lost

2024-06-26 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-35703: Summary: Nested comments in CREAT TABLE are lost Key: FLINK-35703 URL: https://issues.apache.org/jira/browse/FLINK-35703 Project: Flink Issue Type:

Broken links to flink-training repository in documentation

2024-06-26 Thread Aleksandr Pilipenko
Hi all, Some of the pages under the "Learn Flink" section of Flink documentation contain links to apache/flink-training repository [1]. This repository have not been updated since Flink 1.17 release, resulting in documentation for Flink 1.18 onwards pointing to not existing resources[2]. Should

Re: [2.0] How to handle on-going feature development in Flink 2.0?

2024-06-26 Thread Zakelly Lan
+1 for a preview before the formal release. It would help us find issues in advance. Best, Zakelly On Wed, Jun 26, 2024 at 4:44 PM Jingsong Li wrote: > +1 to release a preview version. > > Best, > Jingsong > > On Wed, Jun 26, 2024 at 10:12 AM Jark Wu wrote: > > > > I also think this should

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Wed, Jun 26, 2024 at 3:54 PM Yuepeng Pan wrote: > +1 (non-binding) > > > > > Best regards, > > Yuepeng Pan > > > > > > > > > > > At 2024-06-26 15:27:17, "Piotr Nowojski" wrote: > >Thanks for pointing this out Zakelly. After the discussion on the dev > >mailing

Re: [2.0] How to handle on-going feature development in Flink 2.0?

2024-06-26 Thread Jingsong Li
+1 to release a preview version. Best, Jingsong On Wed, Jun 26, 2024 at 10:12 AM Jark Wu wrote: > > I also think this should not block new feature development. > Having "nice-to-have" and "must-to-have" tags on the FLIPs is a good idea. > > For the downstream projects, I think we need to

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Yuepeng Pan
+1 (non-binding) Best regards, Yuepeng Pan At 2024-06-26 15:27:17, "Piotr Nowojski" wrote: >Thanks for pointing this out Zakelly. After the discussion on the dev >mailing list, I have updated the `PathsCopyingFileSystem` to merge its >functionalities with `DuplicatingFileSystem`,

<    1   2   3   4   5   6   7   8   9   10   >