Thanks for the comments, Till and Wenlong. @Wenlong Regarding slot sharing, the general idea is to request a slot with resources for tasks of the entire slot sharing group. Details can be found in FLIP-53 [1], regarding how to decide the slot sharing groups and how to manage task resources within the shared slots.
Thank you~ Xintong Song On Mon, Sep 16, 2019 at 10:42 AM wenlong.lwl <wenlong88....@gmail.com> wrote: > Hi, Xintong, thanks for the great proposal. big +1 for the feature! It is > something like mapreduce-1.0 to mapreduce-2.0. > > I like the design on the whole. One point may need to be included in the > proposal：How we deal with slot share group and dynamic slot allocation? It > can be quite different with dynamic slot allocation. > > On Fri, 13 Sep 2019 at 16:42, Till Rohrmann <trohrm...@apache.org> wrote: > > > Thanks for the update Xintong. From a high level perspective the > > implementation plan looks good to me. > > > > Cheers, > > Till > > > > On Thu, Sep 12, 2019 at 11:04 AM Xintong Song <tonysong...@gmail.com> > > wrote: > > > > > Added implementation steps for this FLIP on the wiki page [1]. > > > > > > > > > Thank you~ > > > > > > Xintong Song > > > > > > > > > [1] > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-56%3A+Dynamic+Slot+Allocation > > > > > > > > > > > > On Tue, Aug 20, 2019 at 3:43 PM Xintong Song <tonysong...@gmail.com> > > > wrote: > > > > > > > @Zili > > > > > > > > As far as I know, Timo is drafting a FLIP that has taken the number > 55. > > > > There is a round-up number maintained on the FLIP wiki page [1] shows > > > > which number should be used for the new FLIP, which should be > increased > > > by > > > > whoever takes the number for a new FLIP. > > > > > > > > Thank you~ > > > > > > > > Xintong Song > > > > > > > > > > > > [1] > > > > > > > > > > https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals > > > > > > > > On Tue, Aug 20, 2019 at 3:28 AM Zili Chen <wander4...@gmail.com> > > wrote: > > > > > > > >> We suddenly skipped FLIP-55 lol. > > > >> > > > >> > > > >> Xintong Song <tonysong...@gmail.com> 于2019年8月19日周一 下午10:23写道： > > > >> > > > >> > Hi everyone, > > > >> > > > > >> > We would like to start a discussion thread on "FLIP-56: Dynamic > Slot > > > >> > Allocation" [1]. This is originally part of the discussion thread > > for > > > >> > "FLIP-53: Fine Grained Resource Management" [2]. As Till > suggested, > > we > > > >> > would like split the original discussion into two topics, and > start > > a > > > >> > separate new discussion thread as well as FLIP process for this > one. > > > >> > > > > >> > Thank you~ > > > >> > > > > >> > Xintong Song > > > >> > > > > >> > > > > >> > [1] > > > >> > > > > >> > > > > >> > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-56%3A+Dynamic+Slot+Allocation > > > >> > > > > >> > [2] > > > >> > > > > >> > > > > >> > > > > > > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-53-Fine-Grained-Resource-Management-td31831.html > > > >> > > > > >> > > > > > > > > > >
