Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Carlo Aldo Curino
I haven't tested this, but I support the merge as the patch is very much needed for MS usecases as well... Can this be cherry-picked on 2.9 easily? Thanks for this contribution! Cheers, Carlo On Nov 29, 2017 6:34 PM, "Weiwei Yang" wrote: > Hi Sunil > > +1 from my side. > Actually we have appli

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Weiwei Yang
Hi Sunil +1 from my side. Actually we have applied some of these patches to our production cluster since Sep this year, on over 2000+ nodes and it works nicely. +1 for the merge. I am pretty sure this feature will help a lot of users, especially those on cloud. Thanks for getting this done, gre

[VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Sunil G
Hi All, Based on the discussion at [1], I'd like to start a vote to merge feature branch YARN-5881 to trunk. Vote will run for 7 days, ending Wednesday Dec 6 at 6:00PM PDT. This branch adds support to configure queue capacity as absolute resource in capacity scheduler. This will help admins w

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Rohith Sharma K S
+1, thanks Sunil for working on this feature! -Rohith Sharma K S On 24 November 2017 at 23:19, Sunil G wrote: > Hi All, > > We would like to bring up the discussion of merging “absolute min/max > resources support in capacity scheduler” branch (YARN-5881) [2] into trunk > in a few weeks. The go

[jira] [Resolved] (HADOOP-15075) Implement KnoxSSO for hadoop web UIs (hdfs, yarn, history server etc.)

2017-11-29 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Larry McCay resolved HADOOP-15075. -- Resolution: Not A Problem Closing as not a problem - since JWTRedirectAuthenticationHandler sh

[jira] [Created] (HADOOP-15075) Implement KnoxSSO for hadoop web UIs (hdfs, yarn, history server etc.)

2017-11-29 Thread madhu raghavendra (JIRA)
madhu raghavendra created HADOOP-15075: -- Summary: Implement KnoxSSO for hadoop web UIs (hdfs, yarn, history server etc.) Key: HADOOP-15075 URL: https://issues.apache.org/jira/browse/HADOOP-15075

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2017-11-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/54/ [Nov 27, 2017 10:52:18 PM] (kihwal) HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu [Nov 27, 2017 10:54:27 PM] (yufei) YARN-7363. ContainerLocalizer don't have a valid log4j config in ca

[jira] [Created] (HADOOP-15074) SequenceFile#Writer flush does not update the length of the written file.

2017-11-29 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HADOOP-15074: -- Summary: SequenceFile#Writer flush does not update the length of the written file. Key: HADOOP-15074 URL: https://issues.apache.org/jira/browse/HADOOP-15074

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Sunil G
Thanks Eric. Appreciate the support in verifying the feature. YARN-7575 is closed now. - Sunil On Tue, Nov 28, 2017 at 11:15 PM Eric Payne wrote: > Thanks Sunil for the great work on this feature. > I looked through the design document, reviewed the code, and tested out > branch YARN-5881. The

[jira] [Created] (HADOOP-15073) SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended

2017-11-29 Thread Howard Lee (JIRA)
Howard Lee created HADOOP-15073: --- Summary: SequenceFile.Reader will unexpectedly quit next() iterator while the file ends with sync and appended Key: HADOOP-15073 URL: https://issues.apache.org/jira/browse/HADOOP-15