[RESULT][VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Hi all, Thanks everyone for your review and the votes! I am happy to announce that FLIP-309: Support using larger checkpointing interval when source is processing backlog [1] has been accepted. There are 11 binding votes and 1 non-binding vote [2]: - Rui Fan (binding) - Jing Ge (binding) - Piotr Nowojski (binding) - Jark Wu (binding) - Jingsong Li (binding) - Leonard Xu (binding) - Guowei Ma (binding) - Yu Xia (binding) - Zhu Zhu (binding) - Stefan Richter (binding) - Dong Lin (binding) - Hang Ruan There is no disapproving vote. Cheers, Dong [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog [2] https://lists.apache.org/thread/1rl1hm7ssr9hyb20p7m20gzt6j245j8n
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Thanks, Stefan > On 20. Jul 2023, at 05:24, Zhu Zhu wrote: > > +1 (binding) > > Thanks, > Zhu > > yuxia mailto:luoyu...@alumni.sjtu.edu.cn>> > 于2023年7月20日周四 09:23写道： >> >> +1（binding) >> >> Best regards, >> Yuxia >> >> - 原始邮件 - >> 发件人: "Guowei Ma" >> 收件人: "dev" >> 发送时间: 星期三, 2023年 7 月 19日 下午 1:54:52 >> 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when >> source is processing backlog >> >> +1（binding） >> Best, >> Guowei >> >> >> On Wed, Jul 19, 2023 at 11:18 AM Hang Ruan wrote: >> >>> +1 (non-binding) >>> >>> Thanks for driving. >>> >>> Best, >>> Hang >>> >>> Leonard Xu 于2023年7月19日周三 10:42写道： >>> >>>> Thanks Dong for the continuous work. >>>> >>>> +1(binding) >>>> >>>> Best, >>>> Leonard >>>> >>>>> On Jul 18, 2023, at 10:16 PM, Jingsong Li >>>> wrote: >>>>> >>>>> +1 binding >>>>> >>>>> Thanks Dong for continuous driving. >>>>> >>>>> Best, >>>>> Jingsong >>>>> >>>>> On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: >>>>>> >>>>>> +1 (binding) >>>>>> >>>>>> Best, >>>>>> Jark >>>>>> >>>>>> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski >>>> wrote: >>>>>> >>>>>>> +1 (binding) >>>>>>> >>>>>>> Piotrek >>>>>>> >>>>>>> wt., 18 lip 2023 o 08:51 Jing Ge >>>> napisał(a): >>>>>>> >>>>>>>> +1(binding) >>>>>>>> >>>>>>>> Best regards, >>>>>>>> Jing >>>>>>>> >>>>>>>> On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> >>> wrote: >>>>>>>> >>>>>>>>> +1(binding) >>>>>>>>> >>>>>>>>> Best, >>>>>>>>> Rui Fan >>>>>>>>> >>>>>>>>> >>>>>>>>> On Tue, Jul 18, 2023 at 12:04 PM Dong Lin >>>> wrote: >>>>>>>>> >>>>>>>>>> Hi all, >>>>>>>>>> >>>>>>>>>> We would like to start the vote for FLIP-309: Support using larger >>>>>>>>>> checkpointing interval when source is processing backlog [1]. This >>>>>>> FLIP >>>>>>>>> was >>>>>>>>>> discussed in this thread [2]. >>>>>>>>>> >>>>>>>>>> The vote will be open until at least July 21st (at least 72 >>> hours), >>>>>>>>>> following >>>>>>>>>> the consensus voting process. >>>>>>>>>> >>>>>>>>>> Cheers, >>>>>>>>>> Yunfeng and Dong >>>>>>>>>> >>>>>>>>>> [1] >>>>>>>>>> https://www.google.com/url?q=https://cwiki.apache.org/confluence/display/FLINK/FLIP-309=gmail-imap=169042832200=AOvVaw1wfp503kSgJUL104d3jGMP >>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>> >>> %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog >>>>>>>>>> [2] >>>> https://www.google.com/url?q=https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37=gmail-imap=169042832200=AOvVaw3vOlMrVETPjeFtQe-wZ_7I
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Thanks, Zhu yuxia 于2023年7月20日周四 09:23写道： > > +1（binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Guowei Ma" > 收件人: "dev" > 发送时间: 星期三, 2023年 7 月 19日 下午 1:54:52 > 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when > source is processing backlog > > +1（binding） > Best, > Guowei > > > On Wed, Jul 19, 2023 at 11:18 AM Hang Ruan wrote: > > > +1 (non-binding) > > > > Thanks for driving. > > > > Best, > > Hang > > > > Leonard Xu 于2023年7月19日周三 10:42写道： > > > > > Thanks Dong for the continuous work. > > > > > > +1(binding) > > > > > > Best, > > > Leonard > > > > > > > On Jul 18, 2023, at 10:16 PM, Jingsong Li > > > wrote: > > > > > > > > +1 binding > > > > > > > > Thanks Dong for continuous driving. > > > > > > > > Best, > > > > Jingsong > > > > > > > > On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: > > > >> > > > >> +1 (binding) > > > >> > > > >> Best, > > > >> Jark > > > >> > > > >> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski > > > wrote: > > > >> > > > >>> +1 (binding) > > > >>> > > > >>> Piotrek > > > >>> > > > >>> wt., 18 lip 2023 o 08:51 Jing Ge > > > napisał(a): > > > >>> > > > >>>> +1(binding) > > > >>>> > > > >>>> Best regards, > > > >>>> Jing > > > >>>> > > > >>>> On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> > > wrote: > > > >>>> > > > >>>>> +1(binding) > > > >>>>> > > > >>>>> Best, > > > >>>>> Rui Fan > > > >>>>> > > > >>>>> > > > >>>>> On Tue, Jul 18, 2023 at 12:04 PM Dong Lin > > > wrote: > > > >>>>> > > > >>>>>> Hi all, > > > >>>>>> > > > >>>>>> We would like to start the vote for FLIP-309: Support using larger > > > >>>>>> checkpointing interval when source is processing backlog [1]. This > > > >>> FLIP > > > >>>>> was > > > >>>>>> discussed in this thread [2]. > > > >>>>>> > > > >>>>>> The vote will be open until at least July 21st (at least 72 > > hours), > > > >>>>>> following > > > >>>>>> the consensus voting process. > > > >>>>>> > > > >>>>>> Cheers, > > > >>>>>> Yunfeng and Dong > > > >>>>>> > > > >>>>>> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > > >>>>>> [2] > > > https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > > > > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1（binding) Best regards, Yuxia - 原始邮件 - 发件人: "Guowei Ma" 收件人: "dev" 发送时间: 星期三, 2023年 7 月 19日 下午 1:54:52 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog +1（binding） Best, Guowei On Wed, Jul 19, 2023 at 11:18 AM Hang Ruan wrote: > +1 (non-binding) > > Thanks for driving. > > Best, > Hang > > Leonard Xu 于2023年7月19日周三 10:42写道： > > > Thanks Dong for the continuous work. > > > > +1(binding) > > > > Best, > > Leonard > > > > > On Jul 18, 2023, at 10:16 PM, Jingsong Li > > wrote: > > > > > > +1 binding > > > > > > Thanks Dong for continuous driving. > > > > > > Best, > > > Jingsong > > > > > > On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: > > >> > > >> +1 (binding) > > >> > > >> Best, > > >> Jark > > >> > > >> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski > > wrote: > > >> > > >>> +1 (binding) > > >>> > > >>> Piotrek > > >>> > > >>> wt., 18 lip 2023 o 08:51 Jing Ge > > napisał(a): > > >>> > > >>>> +1(binding) > > >>>> > > >>>> Best regards, > > >>>> Jing > > >>>> > > >>>> On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> > wrote: > > >>>> > > >>>>> +1(binding) > > >>>>> > > >>>>> Best, > > >>>>> Rui Fan > > >>>>> > > >>>>> > > >>>>> On Tue, Jul 18, 2023 at 12:04 PM Dong Lin > > wrote: > > >>>>> > > >>>>>> Hi all, > > >>>>>> > > >>>>>> We would like to start the vote for FLIP-309: Support using larger > > >>>>>> checkpointing interval when source is processing backlog [1]. This > > >>> FLIP > > >>>>> was > > >>>>>> discussed in this thread [2]. > > >>>>>> > > >>>>>> The vote will be open until at least July 21st (at least 72 > hours), > > >>>>>> following > > >>>>>> the consensus voting process. > > >>>>>> > > >>>>>> Cheers, > > >>>>>> Yunfeng and Dong > > >>>>>> > > >>>>>> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > >>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > >>>>>> [2] > > https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > >>>>>> > > >>>>> > > >>>> > > >>> > > > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1（binding） Best, Guowei On Wed, Jul 19, 2023 at 11:18 AM Hang Ruan wrote: > +1 (non-binding) > > Thanks for driving. > > Best, > Hang > > Leonard Xu 于2023年7月19日周三 10:42写道： > > > Thanks Dong for the continuous work. > > > > +1(binding) > > > > Best, > > Leonard > > > > > On Jul 18, 2023, at 10:16 PM, Jingsong Li > > wrote: > > > > > > +1 binding > > > > > > Thanks Dong for continuous driving. > > > > > > Best, > > > Jingsong > > > > > > On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: > > >> > > >> +1 (binding) > > >> > > >> Best, > > >> Jark > > >> > > >> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski > > wrote: > > >> > > >>> +1 (binding) > > >>> > > >>> Piotrek > > >>> > > >>> wt., 18 lip 2023 o 08:51 Jing Ge > > napisał(a): > > >>> > > >>>> +1(binding) > > >>>> > > >>>> Best regards, > > >>>> Jing > > >>>> > > >>>> On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> > wrote: > > >>>> > > >>>>> +1(binding) > > >>>>> > > >>>>> Best, > > >>>>> Rui Fan > > >>>>> > > >>>>> > > >>>>> On Tue, Jul 18, 2023 at 12:04 PM Dong Lin > > wrote: > > >>>>> > > >>>>>> Hi all, > > >>>>>> > > >>>>>> We would like to start the vote for FLIP-309: Support using larger > > >>>>>> checkpointing interval when source is processing backlog [1]. This > > >>> FLIP > > >>>>> was > > >>>>>> discussed in this thread [2]. > > >>>>>> > > >>>>>> The vote will be open until at least July 21st (at least 72 > hours), > > >>>>>> following > > >>>>>> the consensus voting process. > > >>>>>> > > >>>>>> Cheers, > > >>>>>> Yunfeng and Dong > > >>>>>> > > >>>>>> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > >>>>>> > > >>>>>> > > >>>>> > > >>>> > > >>> > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > >>>>>> [2] > > https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > >>>>>> > > >>>>> > > >>>> > > >>> > > > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (non-binding) Thanks for driving. Best, Hang Leonard Xu 于2023年7月19日周三 10:42写道： > Thanks Dong for the continuous work. > > +1(binding) > > Best, > Leonard > > > On Jul 18, 2023, at 10:16 PM, Jingsong Li > wrote: > > > > +1 binding > > > > Thanks Dong for continuous driving. > > > > Best, > > Jingsong > > > > On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: > >> > >> +1 (binding) > >> > >> Best, > >> Jark > >> > >> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski > wrote: > >> > >>> +1 (binding) > >>> > >>> Piotrek > >>> > >>> wt., 18 lip 2023 o 08:51 Jing Ge > napisał(a): > >>> > >>>> +1(binding) > >>>> > >>>> Best regards, > >>>> Jing > >>>> > >>>> On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> wrote: > >>>> > >>>>> +1(binding) > >>>>> > >>>>> Best, > >>>>> Rui Fan > >>>>> > >>>>> > >>>>> On Tue, Jul 18, 2023 at 12:04 PM Dong Lin > wrote: > >>>>> > >>>>>> Hi all, > >>>>>> > >>>>>> We would like to start the vote for FLIP-309: Support using larger > >>>>>> checkpointing interval when source is processing backlog [1]. This > >>> FLIP > >>>>> was > >>>>>> discussed in this thread [2]. > >>>>>> > >>>>>> The vote will be open until at least July 21st (at least 72 hours), > >>>>>> following > >>>>>> the consensus voting process. > >>>>>> > >>>>>> Cheers, > >>>>>> Yunfeng and Dong > >>>>>> > >>>>>> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > >>>>>> > >>>>>> > >>>>> > >>>> > >>> > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > >>>>>> [2] > https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > >>>>>> > >>>>> > >>>> > >>> > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Thanks Dong for the continuous work. +1(binding) Best, Leonard > On Jul 18, 2023, at 10:16 PM, Jingsong Li wrote: > > +1 binding > > Thanks Dong for continuous driving. > > Best, > Jingsong > > On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: >> >> +1 (binding) >> >> Best, >> Jark >> >> On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski wrote: >> >>> +1 (binding) >>> >>> Piotrek >>> >>> wt., 18 lip 2023 o 08:51 Jing Ge napisał(a): >>> >>>> +1(binding) >>>> >>>> Best regards, >>>> Jing >>>> >>>> On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> wrote: >>>> >>>>> +1(binding) >>>>> >>>>> Best, >>>>> Rui Fan >>>>> >>>>> >>>>> On Tue, Jul 18, 2023 at 12:04 PM Dong Lin wrote: >>>>> >>>>>> Hi all, >>>>>> >>>>>> We would like to start the vote for FLIP-309: Support using larger >>>>>> checkpointing interval when source is processing backlog [1]. This >>> FLIP >>>>> was >>>>>> discussed in this thread [2]. >>>>>> >>>>>> The vote will be open until at least July 21st (at least 72 hours), >>>>>> following >>>>>> the consensus voting process. >>>>>> >>>>>> Cheers, >>>>>> Yunfeng and Dong >>>>>> >>>>>> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 >>>>>> >>>>>> >>>>> >>>> >>> %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog >>>>>> [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 >>>>>> >>>>> >>>> >>>
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 binding Thanks Dong for continuous driving. Best, Jingsong On Tue, Jul 18, 2023 at 10:04 PM Jark Wu wrote: > > +1 (binding) > > Best, > Jark > > On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski wrote: > > > +1 (binding) > > > > Piotrek > > > > wt., 18 lip 2023 o 08:51 Jing Ge napisał(a): > > > > > +1(binding) > > > > > > Best regards, > > > Jing > > > > > > On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> wrote: > > > > > > > +1(binding) > > > > > > > > Best, > > > > Rui Fan > > > > > > > > > > > > On Tue, Jul 18, 2023 at 12:04 PM Dong Lin wrote: > > > > > > > > > Hi all, > > > > > > > > > > We would like to start the vote for FLIP-309: Support using larger > > > > > checkpointing interval when source is processing backlog [1]. This > > FLIP > > > > was > > > > > discussed in this thread [2]. > > > > > > > > > > The vote will be open until at least July 21st (at least 72 hours), > > > > > following > > > > > the consensus voting process. > > > > > > > > > > Cheers, > > > > > Yunfeng and Dong > > > > > > > > > > [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > > > > > > > > > > > > > > > > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > > > > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > > > > > > > > > > > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Best, Jark On Tue, 18 Jul 2023 at 20:30, Piotr Nowojski wrote: > +1 (binding) > > Piotrek > > wt., 18 lip 2023 o 08:51 Jing Ge napisał(a): > > > +1(binding) > > > > Best regards, > > Jing > > > > On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> wrote: > > > > > +1(binding) > > > > > > Best, > > > Rui Fan > > > > > > > > > On Tue, Jul 18, 2023 at 12:04 PM Dong Lin wrote: > > > > > > > Hi all, > > > > > > > > We would like to start the vote for FLIP-309: Support using larger > > > > checkpointing interval when source is processing backlog [1]. This > FLIP > > > was > > > > discussed in this thread [2]. > > > > > > > > The vote will be open until at least July 21st (at least 72 hours), > > > > following > > > > the consensus voting process. > > > > > > > > Cheers, > > > > Yunfeng and Dong > > > > > > > > [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > > > > > > > > > > > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > > > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > > > > > > > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Piotrek wt., 18 lip 2023 o 08:51 Jing Ge napisał(a): > +1(binding) > > Best regards, > Jing > > On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> wrote: > > > +1(binding) > > > > Best, > > Rui Fan > > > > > > On Tue, Jul 18, 2023 at 12:04 PM Dong Lin wrote: > > > > > Hi all, > > > > > > We would like to start the vote for FLIP-309: Support using larger > > > checkpointing interval when source is processing backlog [1]. This FLIP > > was > > > discussed in this thread [2]. > > > > > > The vote will be open until at least July 21st (at least 72 hours), > > > following > > > the consensus voting process. > > > > > > Cheers, > > > Yunfeng and Dong > > > > > > [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > > > > > > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > > > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1(binding) Best regards, Jing On Tue, Jul 18, 2023 at 8:31 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui Fan > > > On Tue, Jul 18, 2023 at 12:04 PM Dong Lin wrote: > > > Hi all, > > > > We would like to start the vote for FLIP-309: Support using larger > > checkpointing interval when source is processing backlog [1]. This FLIP > was > > discussed in this thread [2]. > > > > The vote will be open until at least July 21st (at least 72 hours), > > following > > the consensus voting process. > > > > Cheers, > > Yunfeng and Dong > > > > [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > > > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1(binding) Best, Rui Fan On Tue, Jul 18, 2023 at 12:04 PM Dong Lin wrote: > Hi all, > > We would like to start the vote for FLIP-309: Support using larger > checkpointing interval when source is processing backlog [1]. This FLIP was > discussed in this thread [2]. > > The vote will be open until at least July 21st (at least 72 hours), > following > the consensus voting process. > > Cheers, > Yunfeng and Dong > > [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 > > %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 >
[VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Hi all, We would like to start the vote for FLIP-309: Support using larger checkpointing interval when source is processing backlog [1]. This FLIP was discussed in this thread [2]. The vote will be open until at least July 21st (at least 72 hours), following the consensus voting process. Cheers, Yunfeng and Dong [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309 %3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Hi Chesnay, Thank you for your comments and I would be happy to discuss together to find a solution. I just want to note that the discussion thread for this FLIP has been open for almost two months for everyone to leave comments. I will really appreciate it if in the future you can help provide comments earlier in the discussion thread so that I (and probably other contributors) can have the chance to address your concern and achieve consensus sooner than later. I am hoping we can be more considerate and help each other in the community be more productive. Thanks, Dong On Fri, Jun 30, 2023 at 11:18 PM Chesnay Schepler wrote: > -1 (binding) > > I feel like this FLIP needs a bit more time in the oven. > > It seems to be very light on actual details; you can summarize the > entire changes section as "The enumerator calls this method and then > another checkpoint interval is used." > I would love to know how this is wired into the triggering of > checkpoints, what the behavior is with multiple sources, if a sink is > allowed to set this at any point or just once, what the semantics of a > "backlog" are for sources other than Hybrid/ MySQL CDC (because catching > up after a failover is a common enough pattern), whether/how this > information could also be interesting for the scheduler (because we may > want to avoid rescalings during the backlog processing), whether the > backlog processing should be exposed as a metric for users (or for that > matter, how we inform users at all that we're using a different > checkpoint interval at this time). > > Following my discussion with Piotr and Stefan I'm also not sure how > future-proof the proposed API really is. Already I feel like the name > "setIsProcessingBacklog()" is rather specific for the state of the > source (making it technically wrong to call it in other situations like > being backpressured (again, depending on what "backlog processing" even > means)), while not being clear on what this actually results in. The > javadocs don't even mention the checkpointing interval at all, but > instead reference downstream optimizations that, afaict, aren't > mentioned in the FLIP. > > I'd be very hesitant with marking it as public from the get-go. Ideally > it would maybe even be added as a separate interface (somehow). > > On 30/06/2023 16:37, Piotr Nowojski wrote: > > Hey, > > > > Sorry to disturb this voting, but after discussing this thoroughly with > > Chesnay and Stefan Richter I have to vote: > > -1 (binding) > > mainly to suspend the current voting thread. Please take a look at my > mail > > at dev mailing list. > > > > Best, > > Piotrek > > > > czw., 29 cze 2023 o 14:59 feng xiangyu > napisał(a): > > > >> +1 (non-binding) > >> > >> Best, > >> Xiangyu > >> > >> yuxia 于2023年6月29日周四 20:44写道： > >> > >>> +1 (binding) > >>> > >>> Best regards, > >>> Yuxia > >>> > >>> - 原始邮件 - > >>> 发件人: "Yuepeng Pan" > >>> 收件人: "dev" > >>> 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 > >>> 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval > when > >>> source is processing backlog > >>> > >>> +1 non-binding. > >>> > >>> > >>> Best. > >>> Yuepeng Pan > >>> > >>> > >>> Replied Message > >>> | From | Jingsong Li | > >>> | Date | 06/29/2023 13:25 | > >>> | To | dev | > >>> | Cc | flink.zhouyunfeng | > >>> | Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing > >>> interval when source is processing backlog | > >>> +1 binding > >>> > >>> On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > >>>> Hi all, > >>>> > >>>> We would like to start the vote for FLIP-309: Support using larger > >>>> checkpointing interval when source is processing backlog [1]. This > FLIP > >>> was > >>>> discussed in this thread [2]. > >>>> > >>>> Flink 1.18 release will feature freeze on July 11. We hope to make > this > >>>> feature available in Flink 1.18. > >>>> > >>>> The vote will be open until at least July 4th (at least 72 hours), > >>> following > >>>> the consensus voting process. > >>>> > >>>> Cheers, > >>>> Yunfeng and Dong > >>>> > >>>> [1] > >>>> > >> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > >>>> [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Hi Chesnay, can you put your comments in the discussion thread, so that we can continue the technical discussion there?
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
-1 (binding) I feel like this FLIP needs a bit more time in the oven. It seems to be very light on actual details; you can summarize the entire changes section as "The enumerator calls this method and then another checkpoint interval is used." I would love to know how this is wired into the triggering of checkpoints, what the behavior is with multiple sources, if a sink is allowed to set this at any point or just once, what the semantics of a "backlog" are for sources other than Hybrid/ MySQL CDC (because catching up after a failover is a common enough pattern), whether/how this information could also be interesting for the scheduler (because we may want to avoid rescalings during the backlog processing), whether the backlog processing should be exposed as a metric for users (or for that matter, how we inform users at all that we're using a different checkpoint interval at this time). Following my discussion with Piotr and Stefan I'm also not sure how future-proof the proposed API really is. Already I feel like the name "setIsProcessingBacklog()" is rather specific for the state of the source (making it technically wrong to call it in other situations like being backpressured (again, depending on what "backlog processing" even means)), while not being clear on what this actually results in. The javadocs don't even mention the checkpointing interval at all, but instead reference downstream optimizations that, afaict, aren't mentioned in the FLIP. I'd be very hesitant with marking it as public from the get-go. Ideally it would maybe even be added as a separate interface (somehow). On 30/06/2023 16:37, Piotr Nowojski wrote: Hey, Sorry to disturb this voting, but after discussing this thoroughly with Chesnay and Stefan Richter I have to vote: -1 (binding) mainly to suspend the current voting thread. Please take a look at my mail at dev mailing list. Best, Piotrek czw., 29 cze 2023 o 14:59 feng xiangyu napisał(a): +1 (non-binding) Best, Xiangyu yuxia 于2023年6月29日周四 20:44写道： +1 (binding) Best regards, Yuxia - 原始邮件 - 发件人: "Yuepeng Pan" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog +1 non-binding. Best. Yuepeng Pan Replied Message | From | Jingsong Li | | Date | 06/29/2023 13:25 | | To | dev | | Cc | flink.zhouyunfeng | | Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog | +1 binding On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: Hi all, We would like to start the vote for FLIP-309: Support using larger checkpointing interval when source is processing backlog [1]. This FLIP was discussed in this thread [2]. Flink 1.18 release will feature freeze on July 11. We hope to make this feature available in Flink 1.18. The vote will be open until at least July 4th (at least 72 hours), following the consensus voting process. Cheers, Yunfeng and Dong [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Hey, Sorry to disturb this voting, but after discussing this thoroughly with Chesnay and Stefan Richter I have to vote: -1 (binding) mainly to suspend the current voting thread. Please take a look at my mail at dev mailing list. Best, Piotrek czw., 29 cze 2023 o 14:59 feng xiangyu napisał(a): > +1 (non-binding) > > Best, > Xiangyu > > yuxia 于2023年6月29日周四 20:44写道： > > > +1 (binding) > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Yuepeng Pan" > > 收件人: "dev" > > 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 > > 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when > > source is processing backlog > > > > +1 non-binding. > > > > > > Best. > > Yuepeng Pan > > > > > > ---- Replied Message ---- > > | From | Jingsong Li | > > | Date | 06/29/2023 13:25 | > > | To | dev | > > | Cc | flink.zhouyunfeng | > > | Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing > > interval when source is processing backlog | > > +1 binding > > > > On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > > > > > > Hi all, > > > > > > We would like to start the vote for FLIP-309: Support using larger > > > checkpointing interval when source is processing backlog [1]. This FLIP > > was > > > discussed in this thread [2]. > > > > > > Flink 1.18 release will feature freeze on July 11. We hope to make this > > > feature available in Flink 1.18. > > > > > > The vote will be open until at least July 4th (at least 72 hours), > > following > > > the consensus voting process. > > > > > > Cheers, > > > Yunfeng and Dong > > > > > > [1] > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (non-binding) Best, Xiangyu yuxia 于2023年6月29日周四 20:44写道： > +1 (binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Yuepeng Pan" > 收件人: "dev" > 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 > 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when > source is processing backlog > > +1 non-binding. > > > Best. > Yuepeng Pan > > > Replied Message > | From | Jingsong Li | > | Date | 06/29/2023 13:25 | > | To | dev | > | Cc | flink.zhouyunfeng | > | Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing > interval when source is processing backlog | > +1 binding > > On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > > > > Hi all, > > > > We would like to start the vote for FLIP-309: Support using larger > > checkpointing interval when source is processing backlog [1]. This FLIP > was > > discussed in this thread [2]. > > > > Flink 1.18 release will feature freeze on July 11. We hope to make this > > feature available in Flink 1.18. > > > > The vote will be open until at least July 4th (at least 72 hours), > following > > the consensus voting process. > > > > Cheers, > > Yunfeng and Dong > > > > [1] > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Best regards, Yuxia - 原始邮件 - 发件人: "Yuepeng Pan" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog +1 non-binding. Best. Yuepeng Pan Replied Message | From | Jingsong Li | | Date | 06/29/2023 13:25 | | To | dev | | Cc | flink.zhouyunfeng | | Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog | +1 binding On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > > Hi all, > > We would like to start the vote for FLIP-309: Support using larger > checkpointing interval when source is processing backlog [1]. This FLIP was > discussed in this thread [2]. > > Flink 1.18 release will feature freeze on July 11. We hope to make this > feature available in Flink 1.18. > > The vote will be open until at least July 4th (at least 72 hours), following > the consensus voting process. > > Cheers, > Yunfeng and Dong > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 non-binding. Best. Yuepeng Pan Replied Message | From | Jingsong Li | | Date | 06/29/2023 13:25 | | To | dev | | Cc | flink.zhouyunfeng | | Subject | Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog | +1 binding On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > > Hi all, > > We would like to start the vote for FLIP-309: Support using larger > checkpointing interval when source is processing backlog [1]. This FLIP was > discussed in this thread [2]. > > Flink 1.18 release will feature freeze on July 11. We hope to make this > feature available in Flink 1.18. > > The vote will be open until at least July 4th (at least 72 hours), following > the consensus voting process. > > Cheers, > Yunfeng and Dong > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Best, Jark > 2023年6月29日 18:12，Jing Ge 写道： > > +1(binding) > > On Thu, Jun 29, 2023 at 7:47 AM Leonard Xu wrote: > >> +1 (binding) >> >> Best, >> Leonard >> >>> On Jun 29, 2023, at 1:25 PM, Jingsong Li wrote: >>> >>> +1 binding >>> >>> On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: >>>> >>>> Hi all, >>>> >>>> We would like to start the vote for FLIP-309: Support using larger >>>> checkpointing interval when source is processing backlog [1]. This FLIP >> was >>>> discussed in this thread [2]. >>>> >>>> Flink 1.18 release will feature freeze on July 11. We hope to make this >>>> feature available in Flink 1.18. >>>> >>>> The vote will be open until at least July 4th (at least 72 hours), >> following >>>> the consensus voting process. >>>> >>>> Cheers, >>>> Yunfeng and Dong >>>> >>>> [1] >>>> >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog >>>> [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 >> >>
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1(binding) On Thu, Jun 29, 2023 at 7:47 AM Leonard Xu wrote: > +1 (binding) > > Best, > Leonard > > > On Jun 29, 2023, at 1:25 PM, Jingsong Li wrote: > > > > +1 binding > > > > On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > >> > >> Hi all, > >> > >> We would like to start the vote for FLIP-309: Support using larger > >> checkpointing interval when source is processing backlog [1]. This FLIP > was > >> discussed in this thread [2]. > >> > >> Flink 1.18 release will feature freeze on July 11. We hope to make this > >> feature available in Flink 1.18. > >> > >> The vote will be open until at least July 4th (at least 72 hours), > following > >> the consensus voting process. > >> > >> Cheers, > >> Yunfeng and Dong > >> > >> [1] > >> > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > >> [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37 > >
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 (binding) Best, Leonard > On Jun 29, 2023, at 1:25 PM, Jingsong Li wrote: > > +1 binding > > On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: >> >> Hi all, >> >> We would like to start the vote for FLIP-309: Support using larger >> checkpointing interval when source is processing backlog [1]. This FLIP was >> discussed in this thread [2]. >> >> Flink 1.18 release will feature freeze on July 11. We hope to make this >> feature available in Flink 1.18. >> >> The vote will be open until at least July 4th (at least 72 hours), following >> the consensus voting process. >> >> Cheers, >> Yunfeng and Dong >> >> [1] >> https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog >> [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
+1 binding On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > > Hi all, > > We would like to start the vote for FLIP-309: Support using larger > checkpointing interval when source is processing backlog [1]. This FLIP was > discussed in this thread [2]. > > Flink 1.18 release will feature freeze on July 11. We hope to make this > feature available in Flink 1.18. > > The vote will be open until at least July 4th (at least 72 hours), following > the consensus voting process. > > Cheers, > Yunfeng and Dong > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog > [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
[VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog
Hi all, We would like to start the vote for FLIP-309: Support using larger checkpointing interval when source is processing backlog [1]. This FLIP was discussed in this thread [2]. Flink 1.18 release will feature freeze on July 11. We hope to make this feature available in Flink 1.18. The vote will be open until at least July 4th (at least 72 hours), following the consensus voting process. Cheers, Yunfeng and Dong [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-309%3A+Support+using+larger+checkpointing+interval+when+source+is+processing+backlog [2] https://lists.apache.org/thread/l1l7f30h7zldjp6ow97y70dcthx7tl37
