Hi Xintong, Hi Yang, Hi everyone, Thank you for speaking up. The vote is formally only about the deprecation in Flink 1.15.
We can and should continue to collect blockers for the deletion of per-job mode on YARN. Then there should be one release that allows users to switch. So, Flink 1.16 indeed is unrealistic for dropping, as we would need to address all Blockers still in Flink 1.15. I think a certain degree of urgency helps us to address these issues and encourages users to switch to application mode. So, I would continue to target Flink 1.17 for dropping per-job mode, but let's reevaluate after Flink 1.16. Hope this helps, Konstantin Since we recently decided that On Sun, Jan 30, 2022 at 4:13 AM Yang Wang <danrtsey...@gmail.com> wrote: > Hi all, > > > > I second Xintong’s comments to not drop the per-job mode too aggressively. > And I am afraid > > we need to get more inputs from users after deprecating the per-job mode in > release-1.15. > > > Most Flink on YARN users are using CLI command to integrate with the job > lifecycle management system. > > And they are still using the old compatibility mode "flink run -m > yarn-cluster", not the generic CLI mode "--target > yarn-per-job/yarn-application". > > Apart from the functionalities, they need some time to upgrade the external > systems. > > > BTW, the application mode does not support attached mode now. Some users > have asked for this in FLINK-25495[1]. > > > [1]. https://issues.apache.org/jira/browse/FLINK-25495 > > > > > Best, > > Yang > > Xintong Song <tonysong...@gmail.com> 于2022年1月30日周日 08:35写道： > > > Hi Konstantin, > > > > Could we be more specific about what this vote is for? I'm asking > because I > > don't think we have consensus on all you have mentioned. > > > > To be specific, I'd be +1 for deprecating per-job mode in 1.15. However, > > I'm not sure about the following. > > - Targeting to drop it in 1.16 or 1.17. TBH, I'd expect to stay > compatible > > on the per-job mode a bit longer. > > - Targeting Yarn application mode on par with the standalone / K8s. I > think > > we need the Yarn application mode on par with the Yarn per-job mode, as > the > > latter is being dropped and users are migrating from. > > - FLINK-24897 being the only blocker for dropping the per-job mode. I > think > > a good time to drop the per-job mode is probably when we know most users > > have migrated to the application mode. Even if the Yarn application mode > > provides equivalent functionality as the Yarn per-job mode does, it's > > probably nicer to not force users to migrate if the per-job mode is still > > widely used. > > > > Discussing the above items is not my purpose here. Just trying to say > that > > IMHO in the previous discussion [1] we have not reached consensus on all > > the things mentioned in this voting thread. Consequently, if these are > all > > included in the scope of the vote, I'm afraid I cannot give my +1 on > this. > > Sorry if I'm nitpicking. > > > > Thank you~ > > > > Xintong Song > > > > > > [1] https://lists.apache.org/thread/b8g76cqgtr2c515rd1bs41vy285f317n > > > > On Sat, Jan 29, 2022 at 2:27 PM Jing Zhang <beyond1...@gmail.com> wrote: > > > > > +1 (binding) > > > > > > Thanks Konstantin for driving this. > > > > > > Best, > > > Jing Zhang > > > > > > Chenya Zhang <chenyazhangche...@gmail.com> 于2022年1月29日周六 07:04写道： > > > > > > > +1 (non-binding) > > > > > > > > On Fri, Jan 28, 2022 at 12:46 PM Thomas Weise <t...@apache.org> > wrote: > > > > > > > > > +1 (binding) > > > > > > > > > > On Fri, Jan 28, 2022 at 9:27 AM David Morávek <d...@apache.org> > > wrote: > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > D. > > > > > > > > > > > > On Fri 28. 1. 2022 at 17:53, Till Rohrmann <trohrm...@apache.org > > > > > > wrote: > > > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > > > Cheers, > > > > > > > Till > > > > > > > > > > > > > > On Fri, Jan 28, 2022 at 4:57 PM Gabor Somogyi < > > > > > gabor.g.somo...@gmail.com > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > We're intended to make tests when FLINK-24897 > > > > > > > > <https://issues.apache.org/jira/browse/FLINK-24897> is > fixed. > > > > > > > > In case of further issues we're going to create further > jiras. > > > > > > > > > > > > > > > > BR, > > > > > > > > G > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Jan 28, 2022 at 4:30 PM Konstantin Knauf < > > > > kna...@apache.org> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Hi everyone, > > > > > > > > > > > > > > > > > > Based on the discussion in [1], I would like to start a > vote > > on > > > > > > > > deprecating > > > > > > > > > per-job mode in Flink 1.15. Consequently, we would target > to > > > drop > > > > > it > > > > > > in > > > > > > > > > Flink 1.16 or Flink 1.17 latest. > > > > > > > > > > > > > > > > > > The only limitation that would block dropping Per-Job mode > > > > > mentioned > > > > > > in > > > > > > > > [1] > > > > > > > > > is tracked in > > > https://issues.apache.org/jira/browse/FLINK-24897. > > > > > In > > > > > > > > > general, the implementation of application mode in YARN > > should > > > be > > > > > on > > > > > > > par > > > > > > > > > with the standalone and Kubernetes before we drop per-job > > mode. > > > > > > > > > > > > > > > > > > The vote will last for at least 72 hours, and will be > > accepted > > > > by a > > > > > > > > > consensus of active committers. > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > > > > Konstantin > > > > > > > > > > > > > > > > > > [1] > > > > > https://lists.apache.org/thread/b8g76cqgtr2c515rd1bs41vy285f317n > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > > > > Konstantin Knauf > > > > > > > > > > > > > > > > > > https://twitter.com/snntrable > > > > > > > > > > > > > > > > > > https://github.com/knaufk > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- Konstantin Knauf https://twitter.com/snntrable https://github.com/knaufk
