Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-30 Thread Sunil G
Thanks everyone for the feedback! Based on positive feedback, we started voting thread in http://mail-archives.apache.org/mod_mbox/hadoop-yarn-dev/201711.mbox/%3CCACYiTuhzMrd_kFRT7_f4VBHejrajbCnVB1wmgHLMLXRr58y0MA%40mail.gmail.com%3E @Carlo: Yes, this change should be straight forward except some

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Carlo Aldo Curino
I haven't tested this, but I support the merge as the patch is very much needed for MS usecases as well... Can this be cherry-picked on 2.9 easily? Thanks for this contribution! Cheers, Carlo On Nov 29, 2017 6:34 PM, "Weiwei Yang" wrote: > Hi Sunil > > +1 from my side. > Actually we have appli

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Weiwei Yang
Hi Sunil +1 from my side. Actually we have applied some of these patches to our production cluster since Sep this year, on over 2000+ nodes and it works nicely. +1 for the merge. I am pretty sure this feature will help a lot of users, especially those on cloud. Thanks for getting this done, gre

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Rohith Sharma K S
+1, thanks Sunil for working on this feature! -Rohith Sharma K S On 24 November 2017 at 23:19, Sunil G wrote: > Hi All, > > We would like to bring up the discussion of merging “absolute min/max > resources support in capacity scheduler” branch (YARN-5881) [2] into trunk > in a few weeks. The go

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Sunil G
nding resources. > > Thanks,Eric > > > From: Sunil G > To: "yarn-...@hadoop.apache.org" ; Hadoop > Common ; Hdfs-dev < > hdfs-...@hadoop.apache.org>; "mapreduce-dev@hadoop.apache.org" < > mapreduce-dev@hadoop.apache.org> > Sent

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-28 Thread Eric Payne
: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk Hi All, We would like to bring up the discussion of merging “absolute min/max resources support in capacity scheduler” branch (YARN-5881) [2] into trunk in a few weeks. The goal is to get

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-27 Thread Wangda Tan
Thanks Sunil for starting this, +1 from my side. - Wangda On Fri, Nov 24, 2017 at 9:49 AM, Sunil G wrote: > Hi All, > > We would like to bring up the discussion of merging “absolute min/max > resources support in capacity scheduler” branch (YARN-5881) [2] into trunk > in a few weeks. The goal i

[DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-24 Thread Sunil G
Hi All, We would like to bring up the discussion of merging “absolute min/max resources support in capacity scheduler” branch (YARN-5881) [2] into trunk in a few weeks. The goal is to get it in for Hadoop 3.1. *Major work happened in this branch* - YARN-6471. Support to add min/max resource c