[jira] [Created] (FLINK-35761) Speed up the restore process of unaligned checkpoint

2024-07-04 Thread Rui Fan (Jira)
Rui Fan created FLINK-35761: --- Summary: Speed up the restore process of unaligned checkpoint Key: FLINK-35761 URL: https://issues.apache.org/jira/browse/FLINK-35761 Project: Flink Issue Type

[SUMMARY] Flink 1.20 Release Sync 07/02/2024

2024-07-02 Thread Rui Fan
Dear devs, This is the third meeting after the feature freeze of Flink 1.20. I'd like to share the information synced in the meeting. - Timeline Flink 1.20 doesn't have any blocker for now, and we hope all Cross-team release testing can be finished next week. We plan to start creating

[jira] [Created] (FLINK-35738) Release Testing: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order

2024-07-02 Thread Rui Fan (Jira)
Rui Fan created FLINK-35738: --- Summary: Release Testing: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order Key: FLINK-35738 URL: https

Re: [VOTE] FLIP-444: Native file copy support

2024-06-26 Thread Rui Fan
+1(binding) Best, Rui On Wed, Jun 26, 2024 at 10:22 PM Stefan Richter wrote: > > +1 (binding) > > Best, > Stefan > > > > > On 26. Jun 2024, at 16:14, Hong wrote: > > > > +1 (binding) > > > > Hong > > > >> On 26 Jun 2024, at 12:27, Keith Lee > wrote: > >> >

[jira] [Created] (FLINK-35665) Release Testing: FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-06-21 Thread Rui Fan (Jira)
Rui Fan created FLINK-35665: --- Summary: Release Testing: FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI Key: FLINK-35665 URL: https://issues.apache.org/jira/browse/FLINK-35665 Project

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.9.0, release candidate #1

2024-06-19 Thread Rui Fan
Thanks Gyula and Mate for driving this release! +1 (binding) Except the key is expired, and leaving a couple of comments to the flink-web PR, the rest of them are fine. - Downloaded artifacts from dist ( svn co https://dist.apache .org/repos/dist/dev/flink/flink-kubernetes-operator-1.9.0-rc1/ )

Re: [ANNOUNCE] Apache Flink 1.19.1 released

2024-06-18 Thread Rui Fan
Thanks Hong for driving this release! I clicked the library/flink docker images link[1] from 1.19.1-release-announcement[2]. And I cannot find the 1.19.1 images there, I'm not sure if it's caused by delay or some steps are missed. [1] https://hub.docker.com/_/flink/tags?page=1=1.19.1 [2]

[jira] [Created] (FLINK-35629) Performance regression in stringRead and stringWrite

2024-06-18 Thread Rui Fan (Jira)
Rui Fan created FLINK-35629: --- Summary: Performance regression in stringRead and stringWrite Key: FLINK-35629 URL: https://issues.apache.org/jira/browse/FLINK-35629 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing for the AdaptiveScheduler

2024-06-17 Thread Rui Fan
+1 (binding) Best, Rui On Mon, Jun 17, 2024 at 4:58 PM David Morávek wrote: > +1 (binding) > > On Mon, Jun 17, 2024 at 10:24 AM Matthias Pohl wrote: > > > Hi everyone, > > the discussion in [1] about FLIP-461 [2] is kind of concluded. I am > > starting a vote on this one here. > > > > The

[jira] [Created] (FLINK-35614) Release Testing Instructions: Verify FLIP-443: Interruptible timers firing

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35614: --- Summary: Release Testing Instructions: Verify FLIP-443: Interruptible timers firing Key: FLINK-35614 URL: https://issues.apache.org/jira/browse/FLINK-35614 Project: Flink

[jira] [Created] (FLINK-35613) Release Testing Instructions: Verify [FLIP-451] Introduce timeout configuration to AsyncSink

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35613: --- Summary: Release Testing Instructions: Verify [FLIP-451] Introduce timeout configuration to AsyncSink Key: FLINK-35613 URL: https://issues.apache.org/jira/browse/FLINK-35613

[jira] [Created] (FLINK-35612) Release Testing Instructions: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35612: --- Summary: Release Testing Instructions: Verify FLIP-445: Support dynamic parallelism inference for HiveSource Key: FLINK-35612 URL: https://issues.apache.org/jira/browse/FLINK-35612

[jira] [Created] (FLINK-35611) Release Testing Instructions: Verify [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35611: --- Summary: Release Testing Instructions: Verify [FLIP-453] Promote Unified Sink API V2 to Public and Deprecate SinkFunction Key: FLINK-35611 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-35610) Release Testing Instructions: Verify FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35610: --- Summary: Release Testing Instructions: Verify FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table Key: FLINK-35610 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-35609) Release Testing Instructions: Verify FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35609: --- Summary: Release Testing Instructions: Verify FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines Key: FLINK-35609 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-35608) CLONE - Release Testing Instructions: Verify FLIP-376: Add DISTRIBUTED BY clause

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35608: --- Summary: CLONE - Release Testing Instructions: Verify FLIP-376: Add DISTRIBUTED BY clause Key: FLINK-35608 URL: https://issues.apache.org/jira/browse/FLINK-35608 Project

[jira] [Created] (FLINK-35607) Release Testing Instructions: Verify FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35607: --- Summary: Release Testing Instructions: Verify FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI Key: FLINK-35607 URL: https://issues.apache.org/jira/browse/FLINK-35607

[jira] [Created] (FLINK-35606) Release Testing Instructions: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35606: --- Summary: Release Testing Instructions: Verify FLINK-26050 Too many small sst files in rocksdb state backend when using time window created in ascending order Key: FLINK-35606 URL: https

[jira] [Created] (FLINK-35605) Release Testing Instructions: Verify FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35605: --- Summary: Release Testing Instructions: Verify FLIP-306 Unified File Merging Mechanism for Checkpoints Key: FLINK-35605 URL: https://issues.apache.org/jira/browse/FLINK-35605

[jira] [Created] (FLINK-35604) Release Testing Instructions: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35604: --- Summary: Release Testing Instructions: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs Key: FLINK-35604 URL: https://issues.apache.org/jira/browse/FLINK-35604

[jira] [Created] (FLINK-35603) Release Testing Instructions: Verify FLINK-35533(FLIP-459): Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-14 Thread Rui Fan (Jira)
Rui Fan created FLINK-35603: --- Summary: Release Testing Instructions: Verify FLINK-35533(FLIP-459): Support Flink hybrid shuffle integration with Apache Celeborn Key: FLINK-35603 URL: https://issues.apache.org/jira

[June 15 Feature Freeze][SUMMARY] Flink 1.20 Release Sync 11/06/2024

2024-06-11 Thread Rui Fan
Dear devs, This is the sixth meeting for Flink 1.20 release[1] cycle. I'd like to share the information synced in the meeting. - Feature Freeze It is worth noting that there are only 3 days left until the feature freeze time(June 15, 2024, 00:00 CEST(UTC+2)), and developers need to pay

Re: [VOTE] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-06-11 Thread Rui Fan
+1(binding) Best, Rui On Tue, Jun 11, 2024 at 4:14 PM Muhammet Orazov wrote: > +1 (non-binding) > > Thanks Yuxin for driving this! > > Best, > Muhammet > > > On 2024-06-07 08:02, Yuxin Tan wrote: > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-459 Support Flink > > hybrid

Re: Flink Kubernetes Operator 1.9.0 release planning

2024-06-10 Thread Rui Fan
Thanks Gyula for driving this release! > I suggest we cut the release branch this week after merging current > outstanding smaller PRs. It makes sense to me. Best, Rui On Mon, Jun 10, 2024 at 3:05 PM Gyula Fóra wrote: > Hi all! > > I want to kick off the discussion / release process for the

Re: [VOTE] Release 1.19.1, release candidate #1

2024-06-07 Thread Rui Fan
+1(binding) - Reviewed the flink-web PR (Left some comments) - Checked Github release tag - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Start the cluster locally with

Re: [VOTE] Release flink-connector-gcp-pubsub v3.1.0, release candidate #1

2024-06-06 Thread Rui Fan
Thanks Danny for the hard work! +1(binding) - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Checked Github release tag - Reviewed the flink-web PR Best, Rui On Wed,

Re: [VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1

2024-06-06 Thread Rui Fan
Thanks Sergey for the hard work! +1(binding) - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Checked Github release tag - Reviewed the flink-web PR Best, Rui On Thu,

Re: [VOTE] Release flink-connector-opensearch v2.0.0, release candidate #1

2024-06-06 Thread Rui Fan
Thanks Sergey for the hard work! +1(binding) - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Checked Github release tag - Reviewed the flink-web PR Best, Rui On Mon,

Re: [VOTE] Release flink-connector-jdbc v3.2.0, release candidate #2

2024-06-06 Thread Rui Fan
Thanks Danny for the hard work! +1(binding) - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Checked Github release tag - Reviewed the flink-web PR Best, Rui On Tue,

Re: [VOTE] Release flink-connector-cassandra v3.2.0, release candidate #1

2024-06-06 Thread Rui Fan
Thanks Danny for the hard work! +1(binding) - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Checked Github release tag - Reviewed the flink-web PR Best, Rui On Wed,

Re: [VOTE] Release flink-connector-aws v4.3.0, release candidate #2

2024-06-06 Thread Rui Fan
Thanks Danny for the hard work! +1(binding) - Verified signatures - Verified sha512 (hashsums) - The source archives do not contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Checked Github release tag - Reviewed the flink-web PR Best, Rui On Fri,

Re: [DISCUSS] FLIP-461: FLIP-461: Synchronize rescaling with checkpoint creation to minimize reprocessing

2024-06-05 Thread Rui Fan
Thanks Matthias for driving this proposal! This proposal can reduce the amount of data that is processed repeatedly after rescaling, so this proposal makes sense to me. I have some questions: 1. The public change only includes the "New Configuration Parameters" part, right? 2.

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Rui Fan
Congratulations Weijie, well deserved! Best, Rui On Tue, Jun 4, 2024 at 2:47 PM Xintong Song wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Weijie Guo has joined > the Flink PMC! > > Weijie has been an active member of the Apache Flink community for many >

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-05-28 Thread Rui Fan
Thanks Yuxin for driving this proposal! Kindly reminder: the image of CIP-6[1] cannot be loaded. [1] https://cwiki.apache.org/confluence/display/CELEBORN/CIP-6+Support+Flink+hybrid+shuffle+integration+with+Apache+Celeborn Best, Rui On Wed, May 29, 2024 at 9:03 AM Xintong Song wrote: > +1 for

[jira] [Created] (FLINK-35471) Kubernetes operator bumps the flink version to 1.19

2024-05-28 Thread Rui Fan (Jira)
Rui Fan created FLINK-35471: --- Summary: Kubernetes operator bumps the flink version to 1.19 Key: FLINK-35471 URL: https://issues.apache.org/jira/browse/FLINK-35471 Project: Flink Issue Type

Re: [DISCUSS] The performance of serializerHeavyString starts regress since April 3

2024-05-27 Thread Rui Fan
ig further what's exactly causing this kind > > of issues. > > > > Best, > > Piotrek > > > > [1] https://issues.apache.org/jira/browse/FLINK-18684 > > [2] https://issues.apache.org/jira/browse/FLINK-27133 > > [3] https://issues.apache.org/jira/browse/F

Re: [DISCUSS] Flink 1.19.1 release

2024-05-26 Thread Rui Fan
+1 for release 1.19.1 and Hong as release manager. We are really looking forward to this version, thank you. Best, Rui On Mon, May 27, 2024 at 11:05 AM Xintong Song wrote: > +1 for the 1.19.1 release and +1 for Hong as the release manager. > > Hong, if you need help on PMC-related steps and

Re: [VOTE] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-24 Thread Rui Fan
+1(binding) Best, Rui On Fri, May 24, 2024 at 1:45 PM Leonard Xu wrote: > +1 > > Best, > Leonard > > > 2024年5月24日 下午1:27,weijie guo 写道: > > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Lincoln Lee 于2024年5月24日周五 12:20写道: > > > >> +1(binding) > >> > >> Best, > >> Lincoln

Re: [VOTE] FLIP-443: Interruptible watermark processing

2024-05-23 Thread Rui Fan
+1(binding) Best, Rui On Fri, May 24, 2024 at 12:01 PM Yanfei Lei wrote: > Thanks for driving this! > > +1 (binding) > > Best, > Yanfei > > Zakelly Lan 于2024年5月24日周五 10:13写道: > > > > > +1 (binding) > > > > Best, > > Zakelly > > > > On Thu, May 23, 2024 at 8:21 PM Piotr Nowojski > wrote: > >

Re: [SUMMARY] Flink 1.20 Release Sync 05/21/2024

2024-05-22 Thread Rui Fan
Thanks Weijie for the summary! Best, Rui On Wed, May 22, 2024 at 2:52 PM weijie guo wrote: > Dear devs, > > > This is the fourth meeting for Flink 1.20 release cycle. > > > I'd like to share the information synced in the meeting. > > > > - Feature Freeze > > > It is worth noting that there

Re: [DISCUSS] The performance of serializerHeavyString starts regress since April 3

2024-05-22 Thread Rui Fan
ssues. >> >> Best, >> Piotrek >> >> [1] https://issues.apache.org/jira/browse/FLINK-18684 >> [2] https://issues.apache.org/jira/browse/FLINK-27133 >> [3] https://issues.apache.org/jira/browse/FLINK-27165 >> [4] https://issues.apache.o

[DISCUSS] The performance of serializerHeavyString starts regress since April 3

2024-05-21 Thread Rui Fan
Hi devs: We(release managers of flink 1.20) wanna update one performance regresses to the flink dev mail list. # Background: The performance of serializerHeavyString starts regress since April 3, and we created FLINK-35040[1] to follow it. In brief: - The performance only regresses for jdk 11,

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

2024-05-16 Thread Rui Fan
erformance regression. > > Best, > Piotrek > > [1] http://flink-speed.xyz/timeline/?ben=fireProcessingTimers=3 > > > > wt., 7 maj 2024 o 09:47 Rui Fan <1996fan...@gmail.com> napisał(a): > > > Hi Piotr, > > > > Overall this FLIP is fine for me. I have

Re: [RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-15 Thread Rui Fan
st, Rui On Thu, May 16, 2024 at 2:16 AM Joao Boto wrote: > Hi, > > I am happy to say that FLIP-449: Reorganization of flink-connector-jdbc [1] > has been accepted. > > The proposal has been accepted with 5 approving votes (1 binding) and there > are no disapproval (vote

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Rui Fan
+1(binding) Best, Rui On Wed, May 15, 2024 at 5:01 PM Xuannan Su wrote: > Hi everyone, > > Thanks for all the feedback about the FLIP-450: Improve Runtime > Configuration for Flink 2.0 [1] [2]. > > I'd like to start a vote for it. The vote will be open for at least 72 > hours(excluding

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-14 Thread Rui Fan
Thanks Martijn for driving this proposal! +1(binding) Best, Rui On Tue, May 14, 2024 at 3:30 PM Ferenc Csaky wrote: > +1 (non-binding) > > Thanks, > Ferenc > > > > > On Tuesday, 14 May 2024 at 08:51, weijie guo > wrote: > > > > > > > Thanks Martijn for the effort! > > > > +1(binding) > > > >

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-10 Thread Rui Fan
ed it to 20. > > Best regards, > Xuannan > > On Mon, May 6, 2024 at 11:28 AM Rui Fan <1996fan...@gmail.com> wrote: > > > > Thanks Xuannan for driving this proposal! > > > > > taskmanager.network.memory.max-overdraft-buffers-per-gate will be > removed

Re: [VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-10 Thread Rui Fan
Thanks for driving this proposal! +1(binding) Best, Rui On Fri, May 10, 2024 at 9:50 AM Yuepeng Pan wrote: > Hi, Boto. > > +1 (non-binding). > > Thanks for your driving it. > > Best regards, > Yuepeng Pan. > > On 2024/05/09 12:01:04 Joao Boto wrote: > > Hi everyone, > > > > Thanks for all the

[jira] [Created] (FLINK-35315) MemoryManagerConcurrentModReleaseTest executes more than 15 minutes

2024-05-08 Thread Rui Fan (Jira)
Rui Fan created FLINK-35315: --- Summary: MemoryManagerConcurrentModReleaseTest executes more than 15 minutes Key: FLINK-35315 URL: https://issues.apache.org/jira/browse/FLINK-35315 Project: Flink

[jira] [Created] (FLINK-35306) Flink cannot compile with jdk17

2024-05-07 Thread Rui Fan (Jira)
Rui Fan created FLINK-35306: --- Summary: Flink cannot compile with jdk17 Key: FLINK-35306 URL: https://issues.apache.org/jira/browse/FLINK-35306 Project: Flink Issue Type: Bug Affects Versions

[SUMMARY] Flink 1.20 Release Sync 05/07/2024

2024-05-07 Thread Rui Fan
Dear devs, Today is the third meeting for Flink 1.20 release cycle. I'd like to share the information synced in the meeting. - Feature Freeze As we discussed before, the feature freeze time is June 15, 2024, 00:00 CEST(UTC+2). It is worth noting that there are only 6 weeks left until the

Re: [DISCUSS] FLIP-443: Interruptible watermark processing

2024-05-07 Thread Rui Fan
Hi Piotr, Overall this FLIP is fine for me. I have a minor concern: IIUC, the code path will become more complex after this FLIP due to the addition of shouldIntterupt() checks, right? If so, it's better to add a benchmark to check whether the job performance regresses when one job has a lot of

Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-05 Thread Rui Fan
+1 (binding) Best, Rui On Mon, May 6, 2024 at 11:01 AM Yanfei Lei wrote: > +1 (binding) > > Best, > Yanfei > > Zakelly Lan 于2024年5月6日周一 11:00写道: > > > > +1 (binding) > > > > Thanks for driving this! > > > > > > Best, > > Zakelly > > > > On Mon, May 6, 2024 at 10:54 AM yue ma wrote: > > > > >

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-05 Thread Rui Fan
Thanks Xuannan for driving this proposal! > taskmanager.network.memory.max-overdraft-buffers-per-gate will be removed and hard-coded to either 10 or 20. Currently, it's a public option. Could we determine the value of the overdraft buffer in the current FLIP? I vote 20 as the hard code value

Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Rui Fan
+1(binding) Best, Rui On Fri, Apr 26, 2024 at 10:26 AM Muhammet Orazov wrote: > Hey Xia, > > +1 (non-binding) > > Thanks and best, > Muhammet > > On 2024-04-26 02:21, Xia Sun wrote: > > Hi everyone, > > > > I'd like to start a vote on FLIP-445: Support dynamic parallelism > > inference > > for

Re: [VOTE] FLIP-446: Kubernetes Operator State Snapshot CRD

2024-04-24 Thread Rui Fan
+1(binding) Best, Rui On Wed, Apr 24, 2024 at 4:03 PM Mate Czagany wrote: > Hi everyone, > > I'd like to start a vote on the FLIP-446: Kubernetes Operator State > Snapshot CRD [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection

[jira] [Created] (FLINK-35227) Remove execution-mode in ExecutionConfigInfo

2024-04-24 Thread Rui Fan (Jira)
Rui Fan created FLINK-35227: --- Summary: Remove execution-mode in ExecutionConfigInfo Key: FLINK-35227 URL: https://issues.apache.org/jira/browse/FLINK-35227 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35226) Deprecate execution-mode in ExecutionConfigInfo related rest api

2024-04-24 Thread Rui Fan (Jira)
Rui Fan created FLINK-35226: --- Summary: Deprecate execution-mode in ExecutionConfigInfo related rest api Key: FLINK-35226 URL: https://issues.apache.org/jira/browse/FLINK-35226 Project: Flink

[jira] [Created] (FLINK-35225) Remove Execution mode in Flink WebUI

2024-04-24 Thread Rui Fan (Jira)
Rui Fan created FLINK-35225: --- Summary: Remove Execution mode in Flink WebUI Key: FLINK-35225 URL: https://issues.apache.org/jira/browse/FLINK-35225 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35223) Add jobType in JobDetailsInfo related rest api

2024-04-24 Thread Rui Fan (Jira)
Rui Fan created FLINK-35223: --- Summary: Add jobType in JobDetailsInfo related rest api Key: FLINK-35223 URL: https://issues.apache.org/jira/browse/FLINK-35223 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35224) Show the JobType on Flink WebUI

2024-04-24 Thread Rui Fan (Jira)
Rui Fan created FLINK-35224: --- Summary: Show the JobType on Flink WebUI Key: FLINK-35224 URL: https://issues.apache.org/jira/browse/FLINK-35224 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35222) Adding getJobType for AccessExecutionGraph

2024-04-24 Thread Rui Fan (Jira)
Rui Fan created FLINK-35222: --- Summary: Adding getJobType for AccessExecutionGraph Key: FLINK-35222 URL: https://issues.apache.org/jira/browse/FLINK-35222 Project: Flink Issue Type: Sub-task

Re: [SUMMARY] Flink 1.20 Release Sync 04/23/2024

2024-04-23 Thread Rui Fan
Rui, > > Thanks for the summary! > > Could you please write what time are you meeting on 5th May? > > Thanks and best, > Muhammet > > On 2024-04-23 09:13, Rui Fan wrote: > > Dear devs, > > > > Today is the second meeting for Flink 1.20 release cycle.

[SUMMARY] Flink 1.20 Release Sync 04/23/2024

2024-04-23 Thread Rui Fan
Dear devs, Today is the second meeting for Flink 1.20 release cycle. I'd like to share the information synced in the meeting. - Features: There're 8 weeks until the feature freeze date, so far we've had 6 flips/features and the status looks good. It is encouraged to continuously updating

[jira] [Created] (FLINK-35215) The performance of serializerKryo and serializerKryoWithoutRegistration are regressed

2024-04-22 Thread Rui Fan (Jira)
Rui Fan created FLINK-35215: --- Summary: The performance of serializerKryo and serializerKryoWithoutRegistration are regressed Key: FLINK-35215 URL: https://issues.apache.org/jira/browse/FLINK-35215 Project

Re: [DISCUSS] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-04-22 Thread Rui Fan
Thanks Yue for driving this proposal! This upgrade makes sense, +1 for that. Best, Rui On Tue, Apr 23, 2024 at 12:06 PM Roman Khachatryan wrote: > Hi, > > Thanks for writing the proposal and preparing the upgrade. > > FRocksDB definitely needs to be kept in sync with the upstream and the new

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-17 Thread Rui Fan
+1(binding) Best, Rui On Wed, Apr 17, 2024 at 2:45 PM Feng Jin wrote: > +1 (non-binding) > > Best, > Feng Jin > > On Wed, Apr 17, 2024 at 2:28 PM Ron liu wrote: > > > +1(binding) > > > > Best, > > Ron > > > > Ron liu 于2024年4月17日周三 14:27写道: > > > > > Hi Dev, > > > > > > Thank you to everyone

Re: [VOTE] FLIP-442: General Improvement to Configuration for Flink 2.0

2024-04-17 Thread Rui Fan
+1(binding) Best, Rui On Wed, Apr 17, 2024 at 1:02 PM Xuannan Su wrote: > Hi everyone, > > Thanks for all the feedback about the FLIP-442: General Improvement to > Configuration for Flink 2.0 [1] [2]. > > I'd like to start a vote for it. The vote will be open for at least 72 > hours(excluding

[jira] [Created] (FLINK-35105) Support setting default Autoscaler options at autoscaler standalone level

2024-04-15 Thread Rui Fan (Jira)
Rui Fan created FLINK-35105: --- Summary: Support setting default Autoscaler options at autoscaler standalone level Key: FLINK-35105 URL: https://issues.apache.org/jira/browse/FLINK-35105 Project: Flink

[RESULT][VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-14 Thread Rui Fan
- Samrat Deb - gongzhongqiang - Zhu Zhu (binding) - Ahmed Hamdy - Muhammet Orazov - Jinzhong Li - Hangxiang Yu (binding) - Yanfei Lei (binding) - Yuepeng Pan - Zakelly Lan (binding) - Lijie Wang (binding) - Junrui Lee - Rui Fan (binding) [1] https://cwiki.apache.org/confluence/x/agrPEQ [2] https

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-14 Thread Rui Fan
2024年4月12日周五 10:26写道: > > > > >> > > > > >> +1 (binding) > > > > >> > > > > >> On Fri, Apr 12, 2024 at 10:22 AM Jinzhong Li < > > > lijinzhong2...@gmail.com> > > > > >> wrote: > >

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Rui Fan
Congratulations! Best, Rui On Mon, Apr 15, 2024 at 11:01 AM Congxian Qiu wrote: > Congratulations! > > Best, > Congxian > > > Ron liu 于2024年4月15日周一 11:00写道: > > > Congratulations! > > > > Best, > > Ron > > > > Yuan Mei 于2024年4月15日周一 10:51写道: > > > > > Hi everyone, > > > > > > On behalf of

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Rui Fan
Congratulations, Jing~ Best, Rui On Fri, Apr 12, 2024 at 4:28 PM Yun Tang wrote: > Congratulations, Jing! > > Best > Yun Tang > > From: Jark Wu > Sent: Friday, April 12, 2024 16:02 > To: dev > Cc: gej...@gmail.com > Subject: [ANNOUNCE] New Apache Flink PMC

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Rui Fan
Congratulations, Lincoln! Best, Rui On Fri, Apr 12, 2024 at 3:59 PM Jark Wu wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Lincoln Lee has > joined the Flink PMC! > > Lincoln has been an active member of the Apache Flink community for > many years. He mainly

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

2024-04-11 Thread Rui Fan
new classes, we propose updating the > `ConfigOptionsDocGenerator` to throw an exception and fail the build > if it detects any new class missing the proper annotation in the > future. > > Best regards, > Xuannan > > > On Wed, Apr 10, 2024 at 2:09 PM Rui Fan <1996fan...@gmail.com> wrote: >

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

2024-04-10 Thread Rui Fan
Thanks Xuannan for driving this proposal! > Ensure all the ConfigOptions are properly annotated as PublicEvolving Could we add a specification directly? All XxxOptions classes are PublicEvolving by default. I'm afraid some new classes still miss PublicEvolving in the future. If we have a

[VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-09 Thread Rui Fan
Hi devs, Thank you to everyone for the feedback on FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI[1] which has been discussed in this thread [2]. I would like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-08 Thread Rui Fan
gt; Ahmed Hamdy > > > On Sun, 7 Apr 2024 at 03:37, Rui Fan <1996fan...@gmail.com> wrote: > > > If there are no extra comments, I will start voting in three days, thank > > you~ > > > > Best, > > Rui > > > > On Thu, Mar 28, 2024 at 4:46 PM Muhamme

[jira] [Created] (FLINK-35040) The performance of serializerHeavyString regresses since April 3

2024-04-07 Thread Rui Fan (Jira)
Rui Fan created FLINK-35040: --- Summary: The performance of serializerHeavyString regresses since April 3 Key: FLINK-35040 URL: https://issues.apache.org/jira/browse/FLINK-35040 Project: Flink

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-06 Thread Rui Fan
posal. > > Best, > Muhammet > > On 2024-03-28 07:37, Rui Fan wrote: > > Hi Muhammet, > > > > Thanks for your reply! > > > >> The execution mode is also used for the DataStream API [1], > >> would that also affect/hide the DataStream execution mo

Re: Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 8:32 PM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 18:43:36, "Yuan Mei" wrote: > >+1 (binding) > > > >Best, > >Yuan > > > >On Wed, Mar 27, 2024 at 7:31 PM Jinzhong Li >

Re: Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 8:31 PM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 18:43:12, "Yuan Mei" wrote: > >+1 (binding) > > > >Best, > >Yuan > > > >On Wed, Mar 27, 2024 at 6:56 PM Jinzhong Li >

Re: Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 8:31 PM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 20:21:50, "Jing Ge" wrote: > >+1 (binding) > > > >Thanks! > > > >Best regards, > >Jing > > > >On Wed, Mar 27, 2024 at

Re: Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:12 PM Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Thu, Mar 28, 2024 at 1:30 PM Feifan Wang wrote: > > > +1 (non-binding) > > > > > > > > —— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28

Re: Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:30 PM Piotr Nowojski wrote: > +1 (binding) > > czw., 28 mar 2024 o 13:31 Feifan Wang napisał(a): > > > +1 (non-binding) > > > > > > > > > > —— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28 19:01:01,

Re: Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:13 PM Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Thu, Mar 28, 2024 at 1:28 PM Feifan Wang wrote: > > > +1 (non-binding) > > > > —— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Rui Fan
Congratulations~ Best, Rui On Thu, Mar 28, 2024 at 3:55 PM Yu Li wrote: > CC the Flink user and dev mailing list. > > Paimon originated within the Flink community, initially known as Flink > Table Store, and all our incubating mentors are members of the Flink > Project Management Committee. I

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-28 Thread Rui Fan
ode, andthe JobType will have the third type in the future, the WebUI can show it properly. Best, Rui On Thu, Mar 28, 2024 at 3:37 PM Rui Fan <1996fan...@gmail.com> wrote: > Hi Muhammet, > > Thanks for your reply! > > > The execution mode is also used for the DataStream A

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-28 Thread Rui Fan
nse.com/v3/__https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/dev/datastream/execution_mode/__;!!IKRxdwAv5BmarQ!eFyqVJyje_8hu1vMSUwKGBsj8vqsFDisEvJ5AxPV0LduhhHWF3rPKYEEE-09biA0unFbfMy5AVQZMgBv1AOa5oTHmcYlkUE$ >>> >>> >>> On 2024-03-27 06:23, Rui Fan wrot

[jira] [Created] (FLINK-34957) JDBC Autoscaler event handler throws Column 'message' cannot be null

2024-03-27 Thread Rui Fan (Jira)
Rui Fan created FLINK-34957: --- Summary: JDBC Autoscaler event handler throws Column 'message' cannot be null Key: FLINK-34957 URL: https://issues.apache.org/jira/browse/FLINK-34957 Project: Flink

[jira] [Created] (FLINK-34956) The config type is wrong for Duration

2024-03-27 Thread Rui Fan (Jira)
Rui Fan created FLINK-34956: --- Summary: The config type is wrong for Duration Key: FLINK-34956 URL: https://issues.apache.org/jira/browse/FLINK-34956 Project: Flink Issue Type: Bug

[DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-27 Thread Rui Fan
Hi flink developers, I'd like to start a discussion to discuss FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI[1]. Currently, the jobType has 2 types in Flink: STREAMING and BATCH. They work on completely different principles, such as: scheduler, shuffle, join, etc. These

Re: [DISCUSS] Planning Flink 1.20

2024-03-25 Thread Rui Fan
Welcome Ufuk and Robert join the release manager group! Best, Rui Márton Balassi 于2024年3月25日 周一20:04写道: > Thanks for kicking this off, folks. > > +1 for the timeline and the release manager candidates (Weijie, Rui > Fan,Ufuk/Robert). > > On Mon, Mar 25, 2024 at 12:54 PM

Re: [DISCUSS] Flink Website Menu Adjustment

2024-03-25 Thread Rui Fan
Thanks Zhongqiang for driving this discussion, +1 for the proposal Best, Rui Jingsong Li 于2024年3月25日 周一22:47写道: > +1 for the proposal > > On Mon, Mar 25, 2024 at 10:01 PM Ferenc Csaky > wrote: > > > > Suggested changes makes sense, +1 for the proposed menus and order. > > > > Best, > > Ferenc

Re: [ANNOUNCE] Apache Flink Kubernetes Operator 1.8.0 released

2024-03-25 Thread Rui Fan
Congratulations! Thanks Max for the release and all involved for the great work! A gentle reminder to users: the maven artifact has just been released and will take some time to complete. Best, Rui On Mon, Mar 25, 2024 at 6:35 PM Maximilian Michels wrote: > The Apache Flink community is very

Re: [DISCUSS] Planning Flink 1.20

2024-03-22 Thread Rui Fan
lot! > > Best regards, > > Weijie > > > Leonard Xu 于2024年3月22日周五 12:09写道: > >> +1 for the proposed release managers (Weijie Guo, Rui Fan), both the two >> candidates are pretty active committers thus I believe they know the >> community development process well. T

[jira] [Created] (FLINK-34907) jobRunningTs should be the timestamp that all tasks are running

2024-03-21 Thread Rui Fan (Jira)
Rui Fan created FLINK-34907: --- Summary: jobRunningTs should be the timestamp that all tasks are running Key: FLINK-34907 URL: https://issues.apache.org/jira/browse/FLINK-34907 Project: Flink Issue

[jira] [Created] (FLINK-34906) Don't start autoscaling when some tasks are not running

2024-03-21 Thread Rui Fan (Jira)
Rui Fan created FLINK-34906: --- Summary: Don't start autoscaling when some tasks are not running Key: FLINK-34906 URL: https://issues.apache.org/jira/browse/FLINK-34906 Project: Flink Issue Type

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Rui Fan
Congratulations! Best, Rui On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan wrote: > Congrattulations! > > Best, > Hang > > Lincoln Lee 于2024年3月21日周四 09:54写道: > >> >> Congrats, thanks for the great work! >> >> >> Best, >> Lincoln Lee >> >> >> Peter Huang 于2024年3月20日周三 22:48写道: >> >>>

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-20 Thread Rui Fan
+1(binding) Thanks to Weijie for driving this proposal, which solves the problem that I raised in FLIP-359. Best, Rui On Thu, Mar 21, 2024 at 10:10 AM Hangxiang Yu wrote: > +1 (binding) > > On Thu, Mar 21, 2024 at 10:04 AM Xintong Song > wrote: > > > +1 (binding) > > > > Best, > > > >

  1   2   3   4   5   >