[jira] [Created] (YARN-7378) Documentation changes post branch-2 merge

Varun Saxena created YARN-7378: -- Summary: Documentation changes post branch-2 merge Key: YARN-7378 URL: https://issues.apache.org/jira/browse/YARN-7378 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-7377) Duplicate Containers allocated for Long-Running Application after NM lost and restart and RM restart

rangjiaheng created YARN-7377: - Summary: Duplicate Containers allocated for Long-Running Application after NM lost and restart and RM restart Key: YARN-7377 URL: https://issues.apache.org/jira/browse/YARN-7377

Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/2/ [Oct 20, 2017 9:24:17 PM] (haibochen) YARN-7372. [Oct 20, 2017 9:27:04 PM] (stevel) HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. [Oct 20, 2017 10:54:15 PM] (wangda) YARN-7318. Fix shell

Re: [DISCUSS] Feature Branch Merge and Security Audits

Hi Eric - Thanks for the additional item suggestions! "We might want to start a security section for Hadoop wiki for each of the services and components. This helps to track what has been completed." Do you mean to keep the audit checklist for each service and component there? Interesting idea,

2.9.0 status update (10/20/2017)

Today was the feature freeze date and we are glad to inform that all the major planned features are merged in branch-2: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Plannedfeatures : Kudos to everyone who pulled through multiple blockers and made this happen. Special shoutout

Re: [DISCUSS] Feature Branch Merge and Security Audits

The check list looks good. Some more items to add: Kerberos TGT renewal SPNEGO support Delegation token Proxy User ACL CVE tracking list We might want to start a security section for Hadoop wiki for each of the services and components. This helps to track what has been completed. How do

[jira] [Created] (YARN-7376) YARN top ACLs

Jonathan Hung created YARN-7376: --- Summary: YARN top ACLs Key: YARN-7376 URL: https://issues.apache.org/jira/browse/YARN-7376 Project: Hadoop YARN Issue Type: Improvement Reporter: J

[jira] [Created] (YARN-7375) NPE in the RM Webapp when HA is enabled and the active RM fails

Chandni Singh created YARN-7375: --- Summary: NPE in the RM Webapp when HA is enabled and the active RM fails Key: YARN-7375 URL: https://issues.apache.org/jira/browse/YARN-7375 Project: Hadoop YARN

[jira] [Resolved] (YARN-6142) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/YARN-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved YARN-6142. -- Resolution: Information Provided Fix Version/s: 3.0.0 Protobuf and JACC analysis done. Will conti

Re: 答复: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

All - I broke this list of questions out into a separate DISCUSS thread where we can iterate over how a security audit process at merge time might look and whether it is even something that we want to take on. I will try and continue discussion on that thread and drive that to some conclusion bef

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

Thanks, Junping. +1 (non-binding) - Build from hadoop-2.8.2-src.tar.gz (skipped test) and also tried hadoop-2.8.2.tar.gz - Setup a 30-node HDFS cluster - Run some basic HDFS/webhdfs commands (read/write/mkdirs/listStatus/getFileInfo) - Check NN Web UI and operations through the UI - Run a simple

Re: Apache YARN committers/contribu­t­ors meetup #4 (10/27)

Seems to me like we're due for a YARN contributors meetup.  Anyone want to volunteer to host?  I'd be happy to handle the logistics and host here at Cloudera, but I don't want to take the opportunity away from another company. :) Daniel On 10/28/16 3:27 PM, Vinod Kumar Vavilapalli wrote: Tha

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

Hi Junping, Thanks for preparing the 2.8.2-RC1 release. Verified the following: - Built from source on Mac OS X 10.11.6 with Java 1.7.0_79 - Deployed binary to a 3-node docker cluster - Sanity checks - Basic dfs operations - MapReduce Wordcount & Grep +1 (non-binding) Thanks,

2017-10-20 Hadoop 3 release status update

https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3+release+status+updates 2017-10-20 Apologies for skipping the update last week. Here's how we're tracking for GA. Highlights: - Merge of HDFS router-based federation and API-based scheduler configuration with no reported problems.

Re: [DISCUSS] Feature Branch Merge and Security Audits

Adding security@hadoop list as well... On Fri, Oct 20, 2017 at 2:29 PM, larry mccay wrote: > All - > > Given the maturity of Hadoop at this point, I would like to propose that > we start doing explicit security audits of features at merge time. > > There are a few reasons that I think this is a

Re: [VOTE] Merge YARN-3368 (new web UI) to trunk

Thanks everyone. The new YARN UI v2 has now landed on branch-2 with the merge done with --no-ff. We will keep monitoring this to see if any issues arise. Special thanks to Sunil Govind, Wangda Tan and Varun Saxena for all their help on completing this. Details at https://issues.apache.org/jira/b

[jira] [Created] (YARN-7374) Improve performance of DRF comparisons for resource types in fair scheduler

Daniel Templeton created YARN-7374: -- Summary: Improve performance of DRF comparisons for resource types in fair scheduler Key: YARN-7374 URL: https://issues.apache.org/jira/browse/YARN-7374 Project:

[jira] [Created] (YARN-7373) The atomicity of container update in RM is not clear

Haibo Chen created YARN-7373: Summary: The atomicity of container update in RM is not clear Key: YARN-7373 URL: https://issues.apache.org/jira/browse/YARN-7373 Project: Hadoop YARN Issue Type: Im

[DISCUSS] Feature Branch Merge and Security Audits

All - Given the maturity of Hadoop at this point, I would like to propose that we start doing explicit security audits of features at merge time. There are a few reasons that I think this is a good place/time to do the review: 1. It represents a specific snapshot of where the feature stands as a

Re: 答复: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

I previously sent this same email from my work email and it doesn't seem to have gone through - resending from apache account (apologizing up from for the length) For such sizable merges in Hadoop, I would like to start doing security audits in order to have an initial idea of the attack surfa

Re: 答复: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Hi Steve, In addition to everything Weiwei mentioned (chapter 3 of user guide), if you really want to drill down to REST protocol you might want to apply this patch and build ozone. https://issues.apache.org/jira/browse/HDFS-12690 This will generate an Open API (https://www.openapis.org , http

答复: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Hi Steve The code is available in HDFS-7240 feature branch, public git repo here. I am not sure if there is a "public" API for object stores, but the design doc uses m

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Wow, big piece of work 1. Where is a PR/branch on github with rendered docs for us to look at? 2. Have you made any public APi changes related to object stores? That's probably something I'll have opinions on more than implementation details. thanks > On 19 Oct 2017, at 02:54, Yang Weiwei wro

Re: [VOTE] Merge YARN-3368 (new web UI) to trunk

Thanks Vrushali for helping to backport YARN-7170 as well. +1 from my end. tested UI against latest branch and all pages seems to work fine. - Sunil On Fri, Oct 20, 2017 at 11:07 AM Vrushali C wrote: > Thanks everyone! > > Subru: Yes, I will back-port YARN-7170 as well. > > Will do some more