Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-05-05 Thread Yuan Mei
+1(binding) Best Yuan On Mon, May 6, 2024 at 11:28 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (binding) > > Best, > Rui > > On Mon, May 6, 2024 at 11:01 AM Yanfei Lei wrote: > > > +1 (binding) > > > > Best, > > Yanfei > > > > Zakelly Lan 于2024年5月6日周一 11:00写道: > > > > > > +1 (binding) > > >

Re: [DISCUSS] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-04-23 Thread Yuan Mei
Hey Yue, Thanks for all the great efforts significantly improving rescaling and upgrading rocksdb. +1 for this. Best Yuan On Wed, Apr 24, 2024 at 10:46 AM Zakelly Lan wrote: > Hi Yue, > > Thanks for this proposal! > > Given the great improvement we could have, the slight regression in write

[ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Yuan Mei
Hi everyone, On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become a new Flink Committer! Zakelly has been continuously contributing to the Flink project since 2020, with a focus area on Checkpointing, State as well as frocksdb (the default on-disk state db). He leads

[jira] [Created] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-34984: Summary: Disaggregated State Storage and Management (Umbrella FLIP) Key: FLINK-34984 URL: https://issues.apache.org/jira/browse/FLINK-34984 Project: Flink Issue

[RESULT][VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei
Hey dev, I'm happy to announce that FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1] has been accepted with 7 approving votes (5 binding) [2] Piotrek Nowojski (binding) Feifan Wang (non-binding) Jing Ge (binding) Rui Fan (binding) Xintong (binding) Yue (non-binding) Yuan

Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei
+1 vote myself & Thanks all for the voting. I'm closing the vote and the result will be posted in a separate mail. Best Yuan On Fri, Mar 29, 2024 at 3:07 PM yue ma wrote: > +1 (non-binding) > > > Best, > Yue >

Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Yuan Mei
+1 (binding) Best Yuan On Wed, Mar 27, 2024 at 6:37 PM Hangxiang Yu wrote: > Hi devs, > > Thanks all for your valuable feedback about FLIP-427: Disaggregated state > Store [1]. > I'd like to start a vote on it. The discussion thread is here [2]. > > The vote will be open for at least 72

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Yuan Mei
Congratulations Best Yuan On Thu, Mar 28, 2024 at 5:35 PM Samrat Deb wrote: > Congratulations ! > Great news > > Bests, > Samrat > > On Thu, 28 Mar 2024 at 3:00 PM, Ahmed Hamdy wrote: > > > Congratulations! > > Best Regards > > Ahmed Hamdy > > > > > > On Thu, 28 Mar 2024 at 08:16, Paul Lam

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Tue, Mar 26, 2024 at 8:59 AM Yunfeng Zhou wrote: > +1 (non-binding) > > Best, > Yunfeng > > On Wed, Mar 20, 2024 at 8:29 PM weijie guo > wrote: > > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-433: State Access on > > DataStream API V2

Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Wed, Mar 27, 2024 at 7:31 PM Jinzhong Li wrote: > Hi devs, > > > I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale > Integration for Disaggregated State [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Thu, Mar 28, 2024 at 4:33 PM Xuannan Su wrote: > +1 (non-binding) > > Best regards, > Xuannan > > On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > > Model [1]. The

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Thu, Mar 28, 2024 at 4:30 PM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > > > Hi devs, > > > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. > The > > discussion thread

Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Wed, Mar 27, 2024 at 6:56 PM Jinzhong Li wrote: > Hi devs, > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or >

[VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Yuan Mei
Hi devs, I'd like to start a vote on the FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/confluence/x/R4p3EQ

Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-28 Thread Yuan Mei
; > >>> > >> > > > - There are already too many options in Flink that > barely > > > >>> know how > > > >>> > >> to use > > > >>> > >> > > > them. I think Flink should try

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-21 Thread Yuan Mei
Thanks for driving these efforts! Congratulations Best Yuan On Thu, Mar 21, 2024 at 4:35 PM Yu Li wrote: > Congratulations and look forward to its further development! > > Best Regards, > Yu > > On Thu, 21 Mar 2024 at 15:54, ConradJam wrote: > > > > Congrattulations! > > > > Leonard Xu

Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-06 Thread Yuan Mei
ra, providing much more scalability and > resource > > > efficiency > > > > >> >> > when handling a *huge state*. > > > > >> >> > > > > > >> >> > What also worries me a lot in this fine grained model is the > > > effect on the >

[DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-02-28 Thread Yuan Mei
Hi Devs, This is a joint work of Yuan Mei, Zakelly Lan, Jinzhong Li, Hangxiang Yu, Yanfei Lei and Feng Wang. We'd like to start a discussion about introducing Disaggregated State Storage and Management in Flink 2.0. The past decade has witnessed a dramatic shift in Flink's deployment mode

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Yuan Mei
+1 On Thu, Jan 25, 2024 at 10:57 AM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > On Thu, Jan 25, 2024 at 10:15 AM Lijie Wang > wrote: > > > > +1 (binding) > > > > Best, > > Lijie > > > > Yanfei Lei 于2024年1月25日周四 10:06写道: > > > > > +1 (binding) > > > > > > Hangxiang Yu

Re: [VOTE] FLIP-416: Deprecate and remove the RestoreMode#LEGACY

2024-01-18 Thread Yuan Mei
+1 binding Best Yuan On Fri, Jan 19, 2024 at 12:09 PM Zakelly Lan wrote: > Hi everyone, > > I'd like to start a vote on the FLIP-416: Deprecate and remove the > RestoreMode#LEGACY [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an

Re: [DISCUSS] FLIP-416: Deprecate and remove the RestoreMode#LEGACY

2024-01-15 Thread Yuan Mei
+1 Thanks for driving this Zakelly! Best Yuan On Mon, Jan 15, 2024 at 10:47 PM Piotr Nowojski wrote: > +1 good idea! > > pon., 15 sty 2024 o 05:11 Jinzhong Li > napisał(a): > > > Hi Zakelly, > > > > Thanks for driving the discussion. It makes sense to remove LEGACY mode > in > > Flink 2.0.

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-08 Thread Yuan Mei
+1 binding On Tue, Jan 9, 2024 at 3:21 PM Yuan Mei wrote: > +1 > > Best, > Yuan > > On Tue, Jan 9, 2024 at 3:06 PM tison wrote: > >> +1 non-binding >> >> Best, >> tison. >> >> Leonard Xu 于2024年1月9日周二 15:05写道: >> > >

Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-08 Thread Yuan Mei
+1 Best, Yuan On Tue, Jan 9, 2024 at 3:06 PM tison wrote: > +1 non-binding > > Best, > tison. > > Leonard Xu 于2024年1月9日周二 15:05写道: > > > > Hello all, > > > > This is the official vote whether to accept the Flink CDC code > contribution > > to Apache Flink. > > > > The current Flink CDC code,

Re: [ANNOUNCE] The Flink Speed Center and benchmark daily run are back online

2023-10-20 Thread Yuan Mei
Thank you for your great efforts! Best Yuan On Fri, Oct 20, 2023 at 4:08 PM Sergey Nuyanzin wrote: > Thanks a lot for working on this! > > On Fri, Oct 20, 2023 at 9:27 AM Yangze Guo wrote: > > > Thanks for the effort, Zhaoqian! > > > > Best, > > Yangze Guo > > > > On Fri, Oct 20, 2023 at 2:55 

Re: FW: RE: [DISCUSS] FLIP-368 Reorganize the exceptions thrown in state interfaces

2023-10-13 Thread Yuan Mei
+1 for the proposal But "Since the signature of the public state API has been changed", I was wondering whether this would be more fittable in Flink 2.0, instead of 1.19? WDYT? Best Yuan On Wed, Oct 11, 2023 at 4:34 PM David Radley wrote: > Hi Zakelly, > Thanks for making this clear for me.

Re: [ANNOUNCE] Release 1.18.0, release candidate #0

2023-09-19 Thread Yuan Mei
Hey Zakelly, Thanks very much for the efforts to re-build the entire benchmark environment. As long as we have 1) the pipeline set up and ready (no need for the entire portal ready), 2) get benchmark comparison numbers (comparing with the commit just before the benchmark pipeline is down) and 3)

Re: [DISCUSS] Update Flink Roadmap

2023-08-12 Thread Yuan Mei
ink. Best Yuan On Mon, Jul 24, 2023 at 12:07 PM Yuan Mei wrote: > Sorry have missed this email and respond a bit late. > > I will put a draft for the long-term vision for the state as well as > large-scale state support into the roadmap. > > Best > Yuan > > On Mon, Ju

[ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread Yuan Mei
Incremental Checkpoints in Flink Forward and Meet-up. Hangxiang also spent a good amount of time supporting users, participating in Jira/mailing list discussions, and reviewing code. Please join me in congratulating Hangxiang for becoming a Flink Committer! Thanks, Yuan Mei (on behalf

[ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread Yuan Mei
for becoming a Flink Committer! Thanks, Yuan Mei (on behalf of the Flink PMC)

Re: [DISCUSS] Update Flink Roadmap

2023-07-23 Thread Yuan Mei
Sorry have missed this email and respond a bit late. I will put a draft for the long-term vision for the state as well as large-scale state support into the roadmap. Best Yuan On Mon, Jul 17, 2023 at 10:34 AM Jark Wu wrote: > Hi Jiabao, > > Thank you for your suggestions. I have added them to

Re: [VOTE] Release 2.0 must-have work items - Round 2

2023-07-23 Thread Yuan Mei
+1 (binding) Thanks for driving the discussion through and for all the efforts in resolving the complexities :-) Best Yuan On Thu, Jul 20, 2023 at 5:23 PM Xintong Song wrote: > Hi all, > > I'd like to start another round of VOTE for the must-have work items for > release 2.0 [1]. The

[jira] [Created] (FLINK-32651) Benchmark Support for Changelog Statebackend

2023-07-23 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-32651: Summary: Benchmark Support for Changelog Statebackend Key: FLINK-32651 URL: https://issues.apache.org/jira/browse/FLINK-32651 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 2.0 must-have work items

2023-07-17 Thread Yuan Mei
gt; >> take > > >> > > much > > >> > > > effort to fully cover the missing api. > > >> > > > > > > >> > > > > [1] > > >> https://lists.apache.org/thread/syjmt8f74gh8ok3z4lhgt95zl4dzn168 > > >> > > > > > > >&

Re: [VOTE] Release 2.0 must-have work items

2023-07-11 Thread Yuan Mei
As a second thought, I think "Eager State Declaration" is probably not a must-have. I was originally thinking it is a prerequisite for "state querying for disaggregated state management". Since disaggregated state management itself is not a must-have, "Eager State Declaration" is not as well. We

Re: [VOTE] Release 2.0 must-have work items

2023-07-09 Thread Yuan Mei
+1 (binding) Thanks for driving this! Best Yuan On Mon, Jul 10, 2023 at 10:26 AM Jark Wu wrote: > +1 (binding) > > Thanks for driving this. Looking forward to starting the 2.0 works. > > Best, > Jark > > On Fri, 7 Jul 2023 at 17:31, Xintong Song wrote: > > > Hi all, > > > > I'd like to

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-06 Thread Yuan Mei
Congrats everyone :-) Best Yuan On Fri, Jul 7, 2023 at 11:29 AM Hang Ruan wrote: > Hi, Leonard. > > I would like to help to add this page. Please assign this issue to me. > Thanks. > > Best, > Hang > > Leonard Xu 于2023年7月7日周五 11:26写道: > >> Congrats to all ! >> >> It will be helpful to promote

Re: [DISCUSS] Release 2.0 Work Items

2023-07-03 Thread Yuan Mei
> > > There seems to be no changes needed for "Move Calcite rules from > Scala > > to > > > > Java" as it's already nice-to-have. > > > > > > > > > > > > If there's no objections, I'll update the wiki page according

Re: [DISCUSS] Release 2.0 Work Items

2023-06-29 Thread Yuan Mei
Thanks for driving this effort, Xintong! To Chesnay > I'm curious as to why the "Disaggregated State Management" item is > marked as a must-have; will it require changes that break something? > What prevents it from being added in 2.1? As to "Disaggregated State Management". We plan to provide

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints - Re-sent

2023-05-09 Thread Yuan Mei
Please ignore this duplicated voting email due to infra outage INFRA-24572[1]. Voting is happening in the thread [2] [1] https://issues.apache.org/jira/browse/INFRA-24572 [2] https://www.mail-archive.com/dev@flink.apache.org/msg66500.html Best, Yuan On Wed, May 10, 2023 at 1:08 AM Zakelly Lan

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Yuan Mei
Please ignore this duplicated voting email due to infra outage INFRA-24572[1]. Voting is happening in the thread [2] [1] https://issues.apache.org/jira/browse/INFRA-24572 [2] https://www.mail-archive.com/dev@flink.apache.org/msg66500.html On Wed, May 10, 2023 at 1:29 AM Zakelly Lan wrote: >

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Yuan Mei
Please ignore this duplicated voting email for due to infra outage INFRA-24572[1]. Voting is happening in the thread [2] [1] https://issues.apache.org/jira/browse/INFRA-24572 [2] https://www.mail-archive.com/dev@flink.apache.org/msg66500.html On Wed, May 10, 2023 at 1:47 AM Zakelly Lan wrote:

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Yuan Mei
Thanks for driving this, Zakelly. As discussed in the thread, +1 for the proposal (binding) Best, Yuan On Wed, May 10, 2023 at 10:39 AM Zakelly Lan wrote: > Hi everyone, > > Sorry for the 4 duplicate emails. There was a problem with the dev > mailing list blocking the mails from Gmail. I

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Yuan Mei
Hey all, Thanks @Zakelly for driving this effort and thanks everyone for the warm discussion. Sorry for the late response. As I and Zakelly have already discussed and reviewed the design carefully when drafting this FLIP, I do not have additional inputs here. But I want to highlight several

Re: RIC Incremental and GIC Incremental checkpoint use question

2023-03-26 Thread Yuan Mei
Hey Thanks for trying out GIC! As Yanfei mentioned, GIC and RocksDB incremental do not conflict with each other. GIC is a generalized way to do incremental Flink checkpoints. At the same time, RocksDB-incremental is a way to do incremental snapshots for backend db (RocksDB). Please let us know

Re: [ANNOUNCE] FRocksDB 6.20.3-ververica-2.0 released

2023-01-30 Thread Yuan Mei
Thanks Yanfei for driving the release! Best Yuan On Mon, Jan 30, 2023 at 8:46 PM Jing Ge via user wrote: > Hi Yanfei, > > Thanks for your effort. Looking forward to checking it. > > Best regards, > Jing > > On Mon, Jan 30, 2023 at 1:42 PM Yanfei Lei wrote: > >> It is very happy to announce

Re: [VOTE] FLIP-290: Operator state compression (FLINK-30113)

2023-01-27 Thread Yuan Mei
+1 binding Best Yuan On Sat, Jan 21, 2023 at 12:49 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (no-binding) > > Best > Rui Fan > > On Fri, Jan 20, 2023 at 10:46 PM ConradJam wrote: > > > +1 (no-binding) > > thanks driving it > > > > Martijn Visser 于2023年1月20日周五 21:16写道: > > > > > +1

Re: [DISCUSS] FLIP-290: Operator state compression (FLINK-30113)

2023-01-19 Thread Yuan Mei
The proposal reads quite reasonable! I do not have additional comments as long as the change can insure backward compatibility. And many thanks to Dawid for catching this! Best Yuan On Thu, Jan 19, 2023 at 6:03 PM Piotr Nowojski wrote: > Hi, > > The idea sounds like a nice improvement to

Re: [DISCUSS] Incorporate performance regression monitoring into routine process

2023-01-19 Thread Yuan Mei
Hey Yanfei, Thanks so much for the efforts driving the whole process. It's great to see that the performance benchmarks are indeed useful to help find regressions. This is a discussion thread separated from the original performance benchmark announcement thread [1]. Let's continue here so that

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2023-01-17 Thread Yuan Mei
; > Hi, > > >> > > > > > >> > > > Is there any update to be expected on the benchmark? I see > > results of > > >> > the > > >> > > > benchmark being posted to Slack, but it appears that it'

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Yuan Mei
Congratulations, Lincoln! Best, Yuan On Tue, Jan 10, 2023 at 12:23 PM Lijie Wang wrote: > Congratulations, Lincoln! > > Best, > Lijie > > Jingsong Li 于2023年1月10日周二 12:07写道: > > > Congratulations, Lincoln! > > > > Best, > > Jingsong > > > > On Tue, Jan 10, 2023 at 11:56 AM Leonard Xu wrote: >

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

2022-10-31 Thread Yuan Mei
+1 Best Yuan On Mon, Oct 31, 2022 at 5:01 PM Dawid Wysakowicz wrote: > +1 > > On 28/10/2022 16:57, Piotr Nowojski wrote: > > Hi, > > > > As discussed on the dev mailing list [0] I would like to start a vote to > > drop support of older savepoint formats (for Flink versions older than > > 1.8).

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-31 Thread Yuan Mei
Congrats! Thanks everyone who is making this release happen! Best Yuan On Mon, Oct 31, 2022 at 5:18 PM Danny Cranmer wrote: > Nice work everyone! > > Congratulations to all involved :D > > Danny, > > On Mon, Oct 31, 2022 at 4:07 AM Paul Lam wrote: > > > Congrats! Finally! > > > > Best, > >

Re: [DISCUSS] Delete useless branches from Flink repository

2022-10-27 Thread Yuan Mei
Hey Leonard, Thanks for your efforts to clean up our repo! Best Yuan On Thu, Oct 27, 2022 at 11:55 PM Leonard Xu wrote: > Thanks Matthias and Chesnay for the quick ACK. > > I’ve deleted following branches. > > FLINK-29638-1.15 > > FLINK-29638-1.16 > > 28733 > >

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

2022-10-27 Thread Yuan Mei
+1 (binding) Thanks for driving this. Best Yuan On Fri, Oct 28, 2022 at 11:17 AM yanfei lei wrote: > +1(non-binding) and thanks for Hangxiang's driving. > > > > Hangxiang Yu 于2022年10月28日周五 09:24写道: > > > Hi everyone, > > > > I'd like to start the vote for FLIP-263 [1]. > > > > Thanks for

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2022-10-26 Thread Yuan Mei
Thanks, Yanfei, to drive this and make the performance monitoring publicly available. Looking forward to seeing the workflow, and more details as Martijn mentioned. Best Yuan On Wed, Oct 26, 2022 at 2:59 PM Martijn Visser wrote: > Hi Yanfei Lei, > > Thanks for setting this up! It would be

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-25 Thread Yuan Mei
ay implement their own serializers based on inner serializers, we > > should make sure that the new interface of inner TypeSerializerSnapshots > is > > usable. > > > > > > Then I think it could work for both old custom serializers or new custom > > seriali

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-24 Thread Yuan Mei
Hey Hangxiang, Thanks for driving this issue. I've read through all the discussions and suggestions in this thread, and here is my take: 1. I agree that the compatibility check should be done in the opposite direction. The current interface *causes some real issues* for users using their own

Re: [DISCUSS] Planning Flink 1.17

2022-10-20 Thread Yuan Mei
Thanks, Qingsheng for the kicking-off efforts. 1. January 17th, 2023 as feature freeze data sounds reasonable to me. 2. We will input our plan to the wiki link. Thanks Best Yuan Ververica (Alibaba) On Fri, Oct 21, 2022 at 10:38 AM Xingbo Huang wrote: > Thanks Qingsheng, Leonard and Martijn

Re: [VOTE] Drop Gelly

2022-10-18 Thread Yuan Mei
+1 On Tue, Oct 18, 2022 at 10:49 AM Dong Lin wrote: > +1 > > On Thu, Oct 13, 2022 at 4:59 AM Martijn Visser > wrote: > > > Hi everyone, > > > > I would like to open a vote for dropping Gelly, which was discussed a > long > > time ago but never put to a vote [1]. > > > > Voting will be open for

Re: Rescuing Queryable State from deprecation

2022-09-08 Thread Yuan Mei
Hey Ron, Sorry for the late response. Thanks for the initiative to bring up this topic and appreciate your efforts to rescue Queryable State :-). I will try to answer your questions at my best! *Why is Queryable State in the deprecation list?* I've seen quite a few users bring up the requests to

[jira] [Created] (FLINK-29082) Clean-up Leftovers for changelog pre-uploading files after failover

2022-08-23 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-29082: Summary: Clean-up Leftovers for changelog pre-uploading files after failover Key: FLINK-29082 URL: https://issues.apache.org/jira/browse/FLINK-29082 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Junhan Yang

2022-08-20 Thread Yuan Mei
Congratulations Junhan! Best, Yuan On Sat, Aug 20, 2022 at 2:11 PM Danny Cranmer wrote: > Congratulations Junhan! Welcome to the team. > > On Sat, 20 Aug 2022, 03:01 yuxia, wrote: > > > Congratulations, Junhan! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Aitozi" > >

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

2022-08-20 Thread Yuan Mei
Congratulations, Lijie! Best, Yuan On Sat, Aug 20, 2022 at 2:12 PM Danny Cranmer wrote: > Congratulations Lijie! Welcome to the team. > > On Sat, 20 Aug 2022, 03:25 Yun Tang, wrote: > > > Congratulations, Lijie! > > > > > > Best > > Yun Tang > > > > From: Geng

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Yuan Mei
+1 (binding) & thanks for the efforts! Best Yuan On Mon, Jul 11, 2022 at 2:08 PM Yun Gao wrote: > +1 (binding) > > Thanks Anton for driving this! > > > Best, > Yun Gao > > > -- > From:Anton Kalashnikov > Send Time:2022 Jul. 8

Re: Re: Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-07-10 Thread Yuan Mei
gt; I haven't gotten a better idea about it. > Maybe @ro...@apache.org who is the owner of incremental > checkpoint support of HashMapStateBackend could share more ideas about it. > > On Sat, Jun 25, 2022 at 2:38 PM Lihe Ma wrote: > > > Hi, Yuan Mei, > > >

Re: [DISCUSS] Creating benchmark channel in Apache Flink slack

2022-07-07 Thread Yuan Mei
+1 for the proposal Anton, and thanks very much to move this effort forward! In long term, I think it would be helpful to ask volunteers to help watching-out the daily micro benchmark results. But let's make it more visible as the very first step! Best Regards, Yuan On Tue, Jul 5, 2022 at

Re: Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread Yuan Mei
Congrats Qingsheng and ShengKai! Best, Yuan On Tue, Jun 21, 2022 at 11:27 AM Terry Wang wrote: > Congratulations, Qingsheng and ShengKai! >

Re: Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-19 Thread Yuan Mei
remental checkpoint is stable. What do you > > > think? > > > > > > > > > Best, > > > Lihe Ma > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > &

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Yuan Mei
Congrats, Jingsong! Best, Yuan On Thu, Jun 16, 2022 at 11:31 AM Yang Wang wrote: > Congrats, Jingsong! > > Best, > Yang > > Zakelly Lan 于2022年6月16日周四 11:16写道: > > > Congrats & well deserved! > > > > Best, > > Zakelly > > > > On Thu, Jun 16, 2022 at 10:36 AM Guowei Ma wrote: > > > > >

Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-14 Thread Yuan Mei
Thanks for bringing this up. I am +1 on making incremental checkpoints by default for RocksDB, but not universally for all state backends. Besides being widely used in prod, enabling incremental checkpoint for RocksDB by default is also a pre-requisite when enabling task-local by default

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

2022-06-08 Thread Yuan Mei
o > > > > > everyone you want to invite, should considered a 'coworker'. > > > > > > > > > > Best regards, > > > > > > > > > > Martijn > > > > > > > > > > Op za 4 jun. 2022 om 20:02 schree

Re: [ANNOUNCE] Welcome to join the Apache Flink community on Slack

2022-06-03 Thread Yuan Mei
Thanks, Xintong and Jark the great effort driving this, and everyone for making this possible. I've also Twittered this announcement on our Apache Flink Twitter account. Best Yuan On Fri, Jun 3, 2022 at 12:54 AM Jing Ge wrote: > Thanks everyone for your effort! > > Best regards, > Jing > >

Re: [VOTE] Creating an Apache Flink slack workspace

2022-05-19 Thread Yuan Mei
+1 (binding) This facilitates people collaborating on the same project from different organizations. I really like this idea. On Thu, May 19, 2022 at 12:43 PM Peter Huang wrote: > +1 (non-binding) > > > Best Regards > Peter Huang > > On Wed, May 18, 2022 at 9:33 PM Leonard Xu wrote: > > >

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

2022-05-05 Thread Yuan Mei
Congrats and well Deserved, Yang! Best, Yuan On Thu, May 5, 2022 at 8:21 PM Nicholas Jiang wrote: > Congrats Yang! > > Best regards, > Nicholas Jiang > > On 2022/05/05 11:18:10 Xintong Song wrote: > > Hi all, > > > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > > >

Re: [ANNOUNCE] Apache Flink 1.15.0 released

2022-05-05 Thread Yuan Mei
Great! Thanks, Yun Gao, Till, and Joe for driving the release, and thanks to everyone for making this release happen! Best Yuan On Thu, May 5, 2022 at 4:40 PM Leonard Xu wrote: > Congratulations! > > Thanks Yun Gao, Till and Joe for the great work as our release manager and > everyone who

[jira] [Created] (FLINK-27214) Build Failed on state backend benchmark

2022-04-12 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-27214: Summary: Build Failed on state backend benchmark Key: FLINK-27214 URL: https://issues.apache.org/jira/browse/FLINK-27214 Project: Flink Issue Type: Bug

Re: Flink 1.15 Stabilisation Sync

2022-04-05 Thread Yuan Mei
FLINK-26985 was discovered just before last weekend. We will get it resolved first thing after the holiday (tomorrow). Best Yuan On Tue, Apr 5, 2022 at 5:37 PM Yun Gao wrote: > Hi Robert, > > Very sorry for the long delay before the rc1 could be published. > > For the open critical issues, I

[jira] [Created] (FLINK-26992) PojoSerializer may cause concurrent exception passing directly between threads

2022-04-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-26992: Summary: PojoSerializer may cause concurrent exception passing directly between threads Key: FLINK-26992 URL: https://issues.apache.org/jira/browse/FLINK-26992 Project

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

2022-03-05 Thread Yuan Mei
Congratulations, David! Best Regards, Yuan On Sat, Mar 5, 2022 at 8:13 PM Roman Khachatryan wrote: > Congratulations, David! > > Regards, > Roman > > On Fri, Mar 4, 2022 at 7:54 PM Austin Cawley-Edwards > wrote: > > > > Congrats David! > > > > On Fri, Mar 4, 2022 at 12:18 PM Zhilong Hong >

Re: Re: Change of focus

2022-02-28 Thread Yuan Mei
Thanks Till for everything you've done for the community! Good luck with your new adventure and best wishes to your new life! Best Regards, Yuan On Tue, Mar 1, 2022 at 10:35 AM Zhu Zhu wrote: > Thank you for all the efforts and good luck for the new adventure, Till! > > Thanks, > Zhu > > Terry

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-17 Thread Yuan Mei
Congratulations! Best Regards, Yuan On Thu, Feb 17, 2022 at 5:17 PM Aitozi wrote: > Congratulations! > > Best, > Aitozi > > > Guowei Ma 于2022年2月17日周四 15:53写道: > > > Congratulations > > > > Best, > > Guowei > > > > > > On Thu, Feb 17, 2022 at 3:29 PM Yang Wang wrote: > > > > > Congratulations

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-17 Thread Yuan Mei
Congratulations! Best Regards, Yuan On Thu, Feb 17, 2022 at 5:15 PM Aitozi wrote: > Congratulations! > > Best, > Aitozi > > Guowei Ma 于2022年2月17日周四 15:52写道: > > > Congratulations to Feng and Zhipeng! > > Best, > > Guowei > > > > > > On Thu, Feb 17, 2022 at 3:30 PM Yang Wang wrote: > > > > >

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-08 Thread Yuan Mei
currently a source > > > implementation where this wouldn't work? For Kafka it should work > because > > > we store the offset per assigned partition. For Kinesis it is probably > > the > > > same. For the Filesource we store the set of unread input splits in the

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-07 Thread Yuan Mei
h can be a big burden to the job manager. The > > meaning of the checkpoint id will also be changed, which can affect many > > aspects. There can be lots of work and risks, and the risks still exist > if > > we only individually checkpoint separated job subgraphs, since the >

Re: [DISCUSS] Checkpointing (partially) failing jobs

2022-02-06 Thread Yuan Mei
Hey Gyula, That's a very interesting idea. The discussion about the `Individual` vs `Global` checkpoint was raised before, but the main concern was from two aspects: - Non-deterministic replaying may lead to an inconsistent view of checkpoint - It is not easy to form a clear cut of past and

Re: [DISCUSS] Pushing Apache Flink 1.15 Feature Freeze

2022-01-25 Thread Yuan Mei
+1 extending feature freeze for one week. Code Freeze on 6th (end of Spring Festival) is equivalent to say code freeze at the end of this week for Chinese buddies, since Spring Festival starts next week. It also means they should be partially available during the holiday, otherwise they would

[jira] [Created] (FLINK-25512) Materialization Files are not cleaned up if no checkpoint is using it

2022-01-04 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-25512: Summary: Materialization Files are not cleaned up if no checkpoint is using it Key: FLINK-25512 URL: https://issues.apache.org/jira/browse/FLINK-25512 Project: Flink

[jira] [Created] (FLINK-25511) Leftovers after truncation are not be cleaned up if pre-uploading is enabled

2022-01-04 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-25511: Summary: Leftovers after truncation are not be cleaned up if pre-uploading is enabled Key: FLINK-25511 URL: https://issues.apache.org/jira/browse/FLINK-25511 Project: Flink

[jira] [Created] (FLINK-25470) Add/Expose/differentiate metrics of checkpoint size between changelog size vs materialization size

2021-12-28 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-25470: Summary: Add/Expose/differentiate metrics of checkpoint size between changelog size vs materialization size Key: FLINK-25470 URL: https://issues.apache.org/jira/browse/FLINK-25470

Re: [DISCUSS] Immediate dedicated Flink releases for log4j vulnerability

2021-12-12 Thread Yuan Mei
+1 for quick release. On Mon, Dec 13, 2021 at 2:55 PM Martijn Visser wrote: > +1 to address the issue like this > > On Mon, 13 Dec 2021 at 07:46, Jingsong Li wrote: > > > +1 for fixing it in these versions and doing quick releases. Looks good > to > > me. > > > > Best, > > Jingsong > > > > On

Re: [ANNOUNCE] New Apache Flink Committer - Yingjie Cao

2021-11-18 Thread Yuan Mei
well deserved! Congratulations, Yingjie! On Fri, Nov 19, 2021 at 12:39 PM Yu Li wrote: > Congrats and welcome, Yingjie! > > Best Regards, > Yu > > > On Thu, 18 Nov 2021 at 19:01, Yun Tang wrote: > > > Congratulations, Yinjie! > > > > Best > > Yun Tang > > > > On 2021/11/18 08:01:44 Martijn

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-11 Thread Yuan Mei
Congrats Leonard! Best Yuan On Fri, Nov 12, 2021 at 12:21 PM Paul Lam wrote: > Congrats! Well deserved! > > Best, > Paul Lam > > > 2021年11月12日 12:16,Yangze Guo 写道: > > > > Congrats, Leonard! > > > > Jingsong Li 于 2021年11月12日周五 下午12:15写道: > > > >> Congrats & well deserved, Leonard! > >> > >>

Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo

2021-11-11 Thread Yuan Mei
Congrats Yangze! Best Yuan On Fri, Nov 12, 2021 at 11:57 AM Leonard Xu wrote: > Congrats & well deserved, Yangze! > > Best, > Leonard > > > 在 2021年11月12日,11:51,godfrey he 写道: > > > > Congrats, Yangze! > > > > Best, > > Godfrey > > > > Yuepeng Pan 于2021年11月12日周五 上午10:49写道: > >> > >> Congrats.

[jira] [Created] (FLINK-24436) FsStateChangelogWriter#lastAppendedSequenceNumber return different seq number with no writes

2021-10-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-24436: Summary: FsStateChangelogWriter#lastAppendedSequenceNumber return different seq number with no writes Key: FLINK-24436 URL: https://issues.apache.org/jira/browse/FLINK-24436

[jira] [Created] (FLINK-24435) FsStateChangelogWriter#lastAppendedSequenceNumber return different seq number with no writes

2021-10-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-24435: Summary: FsStateChangelogWriter#lastAppendedSequenceNumber return different seq number with no writes Key: FLINK-24435 URL: https://issues.apache.org/jira/browse/FLINK-24435

[jira] [Created] (FLINK-23765) PythonTableFunctionOperatorTestBase

2021-08-13 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-23765: Summary: PythonTableFunctionOperatorTestBase Key: FLINK-23765 URL: https://issues.apache.org/jira/browse/FLINK-23765 Project: Flink Issue Type: Bug

Re: [VOTE] FLIP-183: Dynamic buffer size adjustment

2021-07-21 Thread Yuan Mei
+1 (binding) Best Yuan On Wed, Jul 21, 2021 at 7:40 PM Piotr Nowojski wrote: > +1 (binding) > > Piotrek > > śr., 21 lip 2021 o 13:21 Anton Kalashnikov > napisał(a): > > > Hi everyone, > > > > I would like to start a vote on FLIP-183 [1] which was discussed in this > > thread [2]. > > The vote

[jira] [Created] (FLINK-23441) Remove CheckpointOptions Argument away from Snapshotable#snapshot

2021-07-20 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-23441: Summary: Remove CheckpointOptions Argument away from Snapshotable#snapshot Key: FLINK-23441 URL: https://issues.apache.org/jira/browse/FLINK-23441 Project: Flink

[jira] [Created] (FLINK-23367) testKeyGroupedInternalPriorityQueue does not dispose rocksdb properly, and fails the test

2021-07-12 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-23367: Summary: testKeyGroupedInternalPriorityQueue does not dispose rocksdb properly, and fails the test Key: FLINK-23367 URL: https://issues.apache.org/jira/browse/FLINK-23367

Re: [ANNOUNCE] New Apache Flink Committer - Yuan Mei

2021-07-12 Thread Yuan Mei
gt; > >>>> > > >>>> On Thu, Jul 8, 2021 at 6:02 AM Yang Wang > > >> wrote: > > >>>>> > > >>>>> Congratulations Yuan! > > >>>>> > > >>>>> Best, > > >>>>> Yang > > >>>>> > > >>>>> XING JIN 于2021年7月8日周四 上午11:46写道: > > >>>>&g

  1   2   >