[jira] [Created] (FLINK-37044) Support connectors and formats as plugins

2025-01-07 Thread Karan Makhija (Jira)
Karan Makhija created FLINK-37044: - Summary: Support connectors and formats as plugins Key: FLINK-37044 URL: https://issues.apache.org/jira/browse/FLINK-37044 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-37043) [Umbrella] Test Flink Release 2.0

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37043: Summary: [Umbrella] Test Flink Release 2.0 Key: FLINK-37043 URL: https://issues.apache.org/jira/browse/FLINK-37043 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-37042) Unify option names using kebab-case in MaxComputeDataSinkOptions

2025-01-07 Thread ChaomingZhang (Jira)
ChaomingZhang created FLINK-37042: - Summary: Unify option names using kebab-case in MaxComputeDataSinkOptions Key: FLINK-37042 URL: https://issues.apache.org/jira/browse/FLINK-37042 Project: Flink

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Venkatakrishnan Sowrirajan
Thanks Tom for driving this, finally we are tackling the stale PR issues. Late +1 (non binding) On Tue, Jan 7, 2025, 12:25 PM Andrei Kaigorodov wrote: > +1 (non-binding) > > Thanks Tom for driving this! > > Best regards, > > Andrei Kaigorodov > > On Tue, Jan 7, 2025 at 5:27 PM Tom Cooper wrote

[jira] [Created] (FLINK-37036) CLONE - [Release-1.20] Prepare RC0 release

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37036: Summary: CLONE - [Release-1.20] Prepare RC0 release Key: FLINK-37036 URL: https://issues.apache.org/jira/browse/FLINK-37036 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-37041) CLONE - [Release-1.20] Verify that no exclusions were erroneously added to the japicmp plugin

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37041: Summary: CLONE - [Release-1.20] Verify that no exclusions were erroneously added to the japicmp plugin Key: FLINK-37041 URL: https://issues.apache.org/jira/browse/FLINK-37041

[jira] [Created] (FLINK-37031) Core dump in StateBackendTestV2Base.testAsyncStateBackendScaleDown

2025-01-07 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-37031: -- Summary: Core dump in StateBackendTestV2Base.testAsyncStateBackendScaleDown Key: FLINK-37031 URL: https://issues.apache.org/jira/browse/FLINK-37031 Project: Flink

[jira] [Created] (FLINK-37034) CLONE - [Release-1.20] Select executing Release Manager

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37034: Summary: CLONE - [Release-1.20] Select executing Release Manager Key: FLINK-37034 URL: https://issues.apache.org/jira/browse/FLINK-37034 Project: Flink Issu

[jira] [Created] (FLINK-37037) CLONE - [Release-1.20] Review Release Notes in JIRA

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37037: Summary: CLONE - [Release-1.20] Review Release Notes in JIRA Key: FLINK-37037 URL: https://issues.apache.org/jira/browse/FLINK-37037 Project: Flink Issue Typ

[jira] [Created] (FLINK-37038) CLONE - [Release-1.20] Cross team testing

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37038: Summary: CLONE - [Release-1.20] Cross team testing Key: FLINK-37038 URL: https://issues.apache.org/jira/browse/FLINK-37038 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-37039) CLONE - [Release-1.20] Triage release-blocking issues in JIRA

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37039: Summary: CLONE - [Release-1.20] Triage release-blocking issues in JIRA Key: FLINK-37039 URL: https://issues.apache.org/jira/browse/FLINK-37039 Project: Flink

[jira] [Created] (FLINK-37040) CLONE - [Release-1.20] Review and update documentation

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37040: Summary: CLONE - [Release-1.20] Review and update documentation Key: FLINK-37040 URL: https://issues.apache.org/jira/browse/FLINK-37040 Project: Flink Issue

[jira] [Created] (FLINK-37035) CLONE - [Release-1.20] Create a release branch

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37035: Summary: CLONE - [Release-1.20] Create a release branch Key: FLINK-37035 URL: https://issues.apache.org/jira/browse/FLINK-37035 Project: Flink Issue Type: S

[jira] [Created] (FLINK-37033) CLONE - [Release-1.20] Create a new version in JIRA

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37033: Summary: CLONE - [Release-1.20] Create a new version in JIRA Key: FLINK-37033 URL: https://issues.apache.org/jira/browse/FLINK-37033 Project: Flink Issue Typ

[jira] [Created] (FLINK-37032) Prepare Flink 2.0 Release

2025-01-07 Thread Xintong Song (Jira)
Xintong Song created FLINK-37032: Summary: Prepare Flink 2.0 Release Key: FLINK-37032 URL: https://issues.apache.org/jira/browse/FLINK-37032 Project: Flink Issue Type: New Feature C

[jira] [Created] (FLINK-37030) Support lazy initialization for state serializer in State V2

2025-01-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37030: --- Summary: Support lazy initialization for state serializer in State V2 Key: FLINK-37030 URL: https://issues.apache.org/jira/browse/FLINK-37030 Project: Flink I

[jira] [Created] (FLINK-37029) Fix the materialized table docs of full mode cron expression

2025-01-07 Thread dalongliu (Jira)
dalongliu created FLINK-37029: - Summary: Fix the materialized table docs of full mode cron expression Key: FLINK-37029 URL: https://issues.apache.org/jira/browse/FLINK-37029 Project: Flink Issue

[jira] [Created] (FLINK-37028) Datastream Window operator with async state processing

2025-01-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37028: --- Summary: Datastream Window operator with async state processing Key: FLINK-37028 URL: https://issues.apache.org/jira/browse/FLINK-37028 Project: Flink Issue Ty

Re: Full Checkpoint information in UI and API

2025-01-07 Thread Ryan van Huuksloot
Hi, I've updated the PR [https://github.com/apache/flink/pull/25899] to follow the incremental recommendation. It is short a test or two but otherwise should be ready to review. Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify]

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Andrei Kaigorodov
+1 (non-binding) Thanks Tom for driving this! Best regards, Andrei Kaigorodov On Tue, Jan 7, 2025 at 5:27 PM Tom Cooper wrote: > Hi Sergey, > > You make a very good point, I got a bit trigger happy when I got 3 binding > +1s. > > This change doesn't fit neatly into one of the categories on th

[jira] [Created] (FLINK-37027) Chinese document translation for additional TO_TIMESTAMP_LTZ() functions

2025-01-07 Thread Yiyu Tian (Jira)
Yiyu Tian created FLINK-37027: - Summary: Chinese document translation for additional TO_TIMESTAMP_LTZ() functions Key: FLINK-37027 URL: https://issues.apache.org/jira/browse/FLINK-37027 Project: Flink

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Tom Cooper
Hi Sergey, You make a very good point, I got a bit trigger happy when I got 3 binding +1s. This change doesn't fit neatly into one of the categories on the by-law page, but it is a big change, so I will leave the vote open for another day (3 in total) in case there are any dissenting opinion

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Sergey Nuyanzin
Hi Tom thanks for driving this one thing to clarify: If I understand correctly if the vote has been started it is still too early to close it at least based on [1] the minimum length for for voting is 3 days (however it is still not clear to me: as which action this one should be considered) [1]

[DISCUSS] FLIP-501: Support Window Extension in DataStream V2 API

2025-01-07 Thread Xu Huang
Hi Devs, Weijie Guo and I would like to initiate a discussion about FLIP-501: Support Window Extension in DataStream V2 API [1]. Window are at the heart of processing infinite streams. Window split the stream into "buckets" of finite size, over which we can apply computations. For example, time

[jira] [Created] (FLINK-37026) Enable Stale PR Github Action

2025-01-07 Thread Thomas Cooper (Jira)
Thomas Cooper created FLINK-37026: - Summary: Enable Stale PR Github Action Key: FLINK-37026 URL: https://issues.apache.org/jira/browse/FLINK-37026 Project: Flink Issue Type: Improvement

Re: CHI: Automatic Stale PR Cleanup

2025-01-07 Thread Hong
Huge +1 to this. I think X=6m and Y=3m makes sense, as something as simple as adding a comment refreshes it. As such, slightly longer than a normal Flink release cycle is a good line in the sand (as Matthias has said) Side note : Just thinking of a typical PR review process, PRs either fall in

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Hong
Huge +1 (non-binding) to this! Sad that I was late to this thread, but I agree completely with what has been said around keeping stale PRs breeding inaction! Thank you Tom for driving this. Hong > On 7 Jan 2025, at 23:30, Tom Cooper wrote: > > Thanks for the votes everyone. Summary below:

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Tom Cooper
Thanks for the votes everyone. Summary below: +1: Binding (3): - Gyula Fóra - Ron Liu - Rui Fan Non-binding (3): - Ahmed Hamdy - David Radley - Luke Chen No 0 or -1 votes. I added a page [1] to the CHI section of the Flink Wiki, summarising the proposal and linking

Re: CHI: Automatic Stale PR Cleanup

2025-01-07 Thread Tom Cooper
Hi Rui, Good point about recording the proposal. I am not sure it fits the FLIP process so I made a page [1] under the CHI workgroup. That page has a summary of the proposal and links to the discussion and vote threads. Thanks, Tom Cooper @tomncooper | tomcooper.dev [1] https://cwiki.apache

[VOTE] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

2025-01-07 Thread Xu Huang
Hi, all. I'd like to start a vote on FLIP-499: Support Event Time by Generalized Watermark in DataStream V2 [1]. You can find the discussion in here [2]. The vote will last for at least 72 hours unless there is objection or insufficient votes. Best regards, Xu Huang [1] https://cwiki.apache

Re: [DISCUSS] FLIP-500: Support Join Extension in DataStream V2 API

2025-01-07 Thread Xu Huang
Hi, Timo I agree that the DataStream API should provide primitives for stream processing, which is why we have divided the functionality into fundamental primitives and high-Level extensions in the umbrella FLIP [1]. I do not agree that providing a Join on DataStream V1 is useless. Not all users a

[jira] [Created] (FLINK-37025) Periodic SQL watermarks can travel back in time

2025-01-07 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-37025: Summary: Periodic SQL watermarks can travel back in time Key: FLINK-37025 URL: https://issues.apache.org/jira/browse/FLINK-37025 Project: Flink Issue

Re: [VOTE] CHI: Stale PR cleanup

2025-01-07 Thread Ahmed Hamdy
Thanks Tom +1 (non-binding) Best Regards Ahmed Hamdy On Mon, 6 Jan 2025 at 16:43, David Radley wrote: > Thanks for driving this Tom. > +1 (non-binding) > David > > From: Gyula Fóra > Date: Monday, 6 January 2025 at 16:33 > To: dev@flink.apache.org > Subject: [EXTERNAL] Re: [VOTE] CHI: Stale P

[jira] [Created] (FLINK-37024) Task can be stuck in deploying state forever when canceling job/failover

2025-01-07 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-37024: - Summary: Task can be stuck in deploying state forever when canceling job/failover Key: FLINK-37024 URL: https://issues.apache.org/jira/browse/FLINK-37024 Project: F

[jira] [Created] (FLINK-37023) JobManager rest API returns 500 error with CancellationException

2025-01-07 Thread amjidc (Jira)
amjidc created FLINK-37023: -- Summary: JobManager rest API returns 500 error with CancellationException Key: FLINK-37023 URL: https://issues.apache.org/jira/browse/FLINK-37023 Project: Flink Issue T

Re: Full Checkpoint information in UI and API

2025-01-07 Thread Zakelly Lan
Hi, I would +1 for this. As for the name: incremental: true vs. false sounds good to me, which is aligned with the config name 'execution.checkpointing.incremental'. Best, Zakelly On Tue, Dec 17, 2024 at 12:01 PM Ryan van Huuksloot wrote: > Hello, > > Would the community be open to adding ad

Re: [DISCUSS] FLIP-500: Support Join Extension in DataStream V2 API

2025-01-07 Thread Timo Walther
Hi Huang, I agree with Fabian that we should be careful with adding features to DataStream API V2. Providing it as an extension rather than a base API is definitely a good direction. Prepared built-in functions and algorithms should rather go into a lib module. Nevertheless, the DataStream A

Re: Elastic Scaling in Apache Flink and minimum parallelism

2025-01-07 Thread Rui Fan
Hi Pavel, > For now when there is no data coming into the pipeline (no payload > going to source), and the pipeline has around 0 CPU load, the Adaptive > Scaling drops the parallelism of all operators to 1. However, my > intention would be to have the min-parallelism at 8, so the latency > will be

Elastic Scaling in Apache Flink and minimum parallelism

2025-01-07 Thread Pavel Dmitriev
Hi, because there was no reply in user mailing list, I am duplicating my message to dev channel, hoping to get some insides about my problem :). I have a question about Elsatic Scaling in Apache Flink. Is there any possibility to set min-parallelism for a pipeline when the pipeline keeps silent

[NOTICE] Flink 2.0 Release Sync 01/08/2025

2025-01-07 Thread Xintong Song
Hi devs, It's 1 week away from the planned feature freeze date (Jan 13) of Flink 2.0. Time to revive the release sync. The next release sync will be held at the following time. - 15:00, Jan 08, BJT (GMT+8) - 08:00, Jan 08, CET (GMT+1) - 23:00, Jan 07, PT (GMT-8) Everyone is welcome to join via G