Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
Hi all, I'm happy to announce that FLIP-187 is approved. We have 6 approving votes, 3 of which are binding: Guowei Ma (binding) David Morávek (non-binding) Jingsong Li (non-binding) Zhu Zhu (binding) Till Rohrmann (binding) Zakelly Lan (non-binding) Thanks everyone for voting! Best, Lijie Zakelly Lan 于2021年11月10日周三 下午6:10写道： > +1 (non-binding) > > It will be a great improvement. > > Best, > Zakelly > > On Wed, Nov 10, 2021 at 5:24 PM Till Rohrmann > wrote: > > > +1 (binding) > > > > Cheers, > > Till > > > > On Wed, Nov 10, 2021 at 6:37 AM Zhu Zhu wrote: > > > > > +1 (binding) > > > > > > Thanks, > > > Zhu > > > > > > Jingsong Li 于2021年11月9日周二 下午4:01写道： > > > > > > > +1 (non-binding) > > > > > > > > This greatly enhances the ease of use of batch jobs. (Parallelism > > > > setting is really a challenge) > > > > > > > > (non-binding: I'm not familiar with runtime, just a general > > > understanding) > > > > > > > > Best, > > > > Jingsong > > > > > > > > On Tue, Nov 9, 2021 at 3:48 PM David Morávek > wrote: > > > > > > > > > > Thanks for the FLIP, this is going to be a great improvement to the > > > batch > > > > > execution. > > > > > > > > > > +1 (non-binding) > > > > > > > > > > Best, > > > > > D. > > > > > > > > > > On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma > > wrote: > > > > > > > > > > > Thanks for your excellent FLIP! > > > > > > +1 binding > > > > > > > > > > > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > I would like to start the vote for FLIP-187[1], which proposes > to > > > > > > introduce > > > > > > > a new scheduler to Flink: adaptive batch job scheduler. The new > > > > scheduler > > > > > > > can automatically decide parallelisms of job vertices for batch > > > jobs, > > > > > > > according to the size of data volume each vertex needs to > > process. > > > > This > > > > > > > FLIP was discussed in [2]. > > > > > > > > > > > > > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) > unless > > > > there is > > > > > > > an objection or insufficient votes. > > > > > > > > > > > > > > [1] > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > > > > > > > > > > > > > [2] > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > > > > > > > > > > > > > Best, > > > > > > > > > > > > > > Lijie > > > > > > > > > > > > > -- > > > > > > Best, > > > > > > Guowei > > > > > > > > > > > > > > > > > > > > > > -- > > > > Best, Jingsong Lee > > > > > > > > > >
Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
+1 (non-binding) It will be a great improvement. Best, Zakelly On Wed, Nov 10, 2021 at 5:24 PM Till Rohrmann wrote: > +1 (binding) > > Cheers, > Till > > On Wed, Nov 10, 2021 at 6:37 AM Zhu Zhu wrote: > > > +1 (binding) > > > > Thanks, > > Zhu > > > > Jingsong Li 于2021年11月9日周二 下午4:01写道： > > > > > +1 (non-binding) > > > > > > This greatly enhances the ease of use of batch jobs. (Parallelism > > > setting is really a challenge) > > > > > > (non-binding: I'm not familiar with runtime, just a general > > understanding) > > > > > > Best, > > > Jingsong > > > > > > On Tue, Nov 9, 2021 at 3:48 PM David Morávek wrote: > > > > > > > > Thanks for the FLIP, this is going to be a great improvement to the > > batch > > > > execution. > > > > > > > > +1 (non-binding) > > > > > > > > Best, > > > > D. > > > > > > > > On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma > wrote: > > > > > > > > > Thanks for your excellent FLIP! > > > > > +1 binding > > > > > > > > > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > > > > > > > > > Hi all, > > > > > > > > > > > > I would like to start the vote for FLIP-187[1], which proposes to > > > > > introduce > > > > > > a new scheduler to Flink: adaptive batch job scheduler. The new > > > scheduler > > > > > > can automatically decide parallelisms of job vertices for batch > > jobs, > > > > > > according to the size of data volume each vertex needs to > process. > > > This > > > > > > FLIP was discussed in [2]. > > > > > > > > > > > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) unless > > > there is > > > > > > an objection or insufficient votes. > > > > > > > > > > > > [1] > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > > > > > > > > > > > [2] > > > > > > > > > > > > > > > > > > > > > > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > > > > > > > > > > > Best, > > > > > > > > > > > > Lijie > > > > > > > > > > > -- > > > > > Best, > > > > > Guowei > > > > > > > > > > > > > > > > > -- > > > Best, Jingsong Lee > > > > > >
Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
+1 (binding) Cheers, Till On Wed, Nov 10, 2021 at 6:37 AM Zhu Zhu wrote: > +1 (binding) > > Thanks, > Zhu > > Jingsong Li 于2021年11月9日周二 下午4:01写道： > > > +1 (non-binding) > > > > This greatly enhances the ease of use of batch jobs. (Parallelism > > setting is really a challenge) > > > > (non-binding: I'm not familiar with runtime, just a general > understanding) > > > > Best, > > Jingsong > > > > On Tue, Nov 9, 2021 at 3:48 PM David Morávek wrote: > > > > > > Thanks for the FLIP, this is going to be a great improvement to the > batch > > > execution. > > > > > > +1 (non-binding) > > > > > > Best, > > > D. > > > > > > On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma wrote: > > > > > > > Thanks for your excellent FLIP! > > > > +1 binding > > > > > > > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > > > > > > > Hi all, > > > > > > > > > > I would like to start the vote for FLIP-187[1], which proposes to > > > > introduce > > > > > a new scheduler to Flink: adaptive batch job scheduler. The new > > scheduler > > > > > can automatically decide parallelisms of job vertices for batch > jobs, > > > > > according to the size of data volume each vertex needs to process. > > This > > > > > FLIP was discussed in [2]. > > > > > > > > > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) unless > > there is > > > > > an objection or insufficient votes. > > > > > > > > > > [1] > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > > > > > > > > > [2] > > > > > > > > > > > > > > > > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > > > > > > > > > Best, > > > > > > > > > > Lijie > > > > > > > > > -- > > > > Best, > > > > Guowei > > > > > > > > > > > > -- > > Best, Jingsong Lee > > >
Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
+1 (binding) Thanks, Zhu Jingsong Li 于2021年11月9日周二 下午4:01写道： > +1 (non-binding) > > This greatly enhances the ease of use of batch jobs. (Parallelism > setting is really a challenge) > > (non-binding: I'm not familiar with runtime, just a general understanding) > > Best, > Jingsong > > On Tue, Nov 9, 2021 at 3:48 PM David Morávek wrote: > > > > Thanks for the FLIP, this is going to be a great improvement to the batch > > execution. > > > > +1 (non-binding) > > > > Best, > > D. > > > > On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma wrote: > > > > > Thanks for your excellent FLIP! > > > +1 binding > > > > > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > > > > > Hi all, > > > > > > > > I would like to start the vote for FLIP-187[1], which proposes to > > > introduce > > > > a new scheduler to Flink: adaptive batch job scheduler. The new > scheduler > > > > can automatically decide parallelisms of job vertices for batch jobs, > > > > according to the size of data volume each vertex needs to process. > This > > > > FLIP was discussed in [2]. > > > > > > > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) unless > there is > > > > an objection or insufficient votes. > > > > > > > > [1] > > > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > > > > > > > [2] > > > > > > > > > > > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > > > > > > > Best, > > > > > > > > Lijie > > > > > > > -- > > > Best, > > > Guowei > > > > > > > -- > Best, Jingsong Lee >
Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
+1 (non-binding) This greatly enhances the ease of use of batch jobs. (Parallelism setting is really a challenge) (non-binding: I'm not familiar with runtime, just a general understanding) Best, Jingsong On Tue, Nov 9, 2021 at 3:48 PM David Morávek wrote: > > Thanks for the FLIP, this is going to be a great improvement to the batch > execution. > > +1 (non-binding) > > Best, > D. > > On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma wrote: > > > Thanks for your excellent FLIP! > > +1 binding > > > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > > > Hi all, > > > > > > I would like to start the vote for FLIP-187[1], which proposes to > > introduce > > > a new scheduler to Flink: adaptive batch job scheduler. The new scheduler > > > can automatically decide parallelisms of job vertices for batch jobs, > > > according to the size of data volume each vertex needs to process. This > > > FLIP was discussed in [2]. > > > > > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) unless there is > > > an objection or insufficient votes. > > > > > > [1] > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > > > > > [2] > > > > > > > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > > > > > Best, > > > > > > Lijie > > > > > -- > > Best, > > Guowei > > -- Best, Jingsong Lee
Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
Thanks for the FLIP, this is going to be a great improvement to the batch execution. +1 (non-binding) Best, D. On Tue, Nov 9, 2021 at 1:05 AM Guowei Ma wrote: > Thanks for your excellent FLIP! > +1 binding > > Lijie Wang 于2021年11月8日 周一下午2:53写道： > > > Hi all, > > > > I would like to start the vote for FLIP-187[1], which proposes to > introduce > > a new scheduler to Flink: adaptive batch job scheduler. The new scheduler > > can automatically decide parallelisms of job vertices for batch jobs, > > according to the size of data volume each vertex needs to process. This > > FLIP was discussed in [2]. > > > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) unless there is > > an objection or insufficient votes. > > > > [1] > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > > > [2] > > > > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > > > Best, > > > > Lijie > > > -- > Best, > Guowei >
Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler
Thanks for your excellent FLIP! +1 binding Lijie Wang 于2021年11月8日 周一下午2:53写道： > Hi all, > > I would like to start the vote for FLIP-187[1], which proposes to introduce > a new scheduler to Flink: adaptive batch job scheduler. The new scheduler > can automatically decide parallelisms of job vertices for batch jobs, > according to the size of data volume each vertex needs to process. This > FLIP was discussed in [2]. > > The vote will last at least 72 hours (Nov 11th 12:00 GMT) unless there is > an objection or insufficient votes. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-187%3A+Adaptive+Batch+Job+Scheduler > > [2] > > https://lists.apache.org/thread.html/r32bd8f521daf4446fb70366bfabc4603bf3f56831c04e65bee6709aa%40%3Cdev.flink.apache.org%3E > > Best, > > Lijie > -- Best, Guowei
