Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-06 Thread Rohith Sharma K S
Thanks Subru/Arun for the great work! Downloaded source and built from it. Deployed RM HA non-secured cluster along with new YARN UI and ATSv2. I am facing basic RM HA switch issue after first time successful start. *Can anyone else is facing this issue?* When RM is switched from ACTIVE to STAND

RE: [DISCUSS] A final minor release off branch-2?

2017-11-06 Thread Zheng, Kai
Thanks Vinod. >> Of the top of my head, one of the biggest areas is application >> compatibility. When folks move from 2.x to 3.x, are their apps binary >> compatible? Source compatible? Or need changes? I thought these are good concerns from overall perspective. On the other hand, I've discuss

Re: [DISCUSS] A final minor release off branch-2?

2017-11-06 Thread Vinod Kumar Vavilapalli
The main goal of the bridging release is to ease transition on stuff that is guaranteed to be broken. Of the top of my head, one of the biggest areas is application compatibility. When folks move from 2.x to 3.x, are their apps binary compatible? Source compatible? Or need changes? In 1.x -> 2

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-11-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/582/ [Nov 6, 2017 7:28:38 AM] (naganarasimha_gr) MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. -1 overall The following subsystems voted -1: asflicense unit The following subsy

[jira] [Created] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2017-11-06 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-7451: Summary: Resources Types should be visible in the Cluster Apps API "resourceRequests" section Key: YARN-7451 URL: https://issues.apache.org/jira/browse/YARN-7451 Project: Had

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Vinod Kumar Vavilapalli
Congratulations to all the contributors involved, this is a great step forward! +Vinod > On Nov 6, 2017, at 2:40 PM, Jian He wrote: > > Okay, I just merged the branch to trunk (108 commits in total !) > Again, thanks for all who contributed to this feature! > > Jian > > On Nov 6, 2017, at 1:2

[jira] [Resolved] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-4793. --- Resolution: Fixed > [Umbrella] Simplified API layer for services and beyond > -

[jira] [Resolved] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-4692. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Release Note: A REST

[jira] [Resolved] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5079. --- Resolution: Fixed Fix Version/s: 3.1.0 Target Version/s: 3.1.0 Branch is merged to trunk, reso

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Jian He
Okay, I just merged the branch to trunk (108 commits in total !) Again, thanks for all who contributed to this feature! Jian On Nov 6, 2017, at 1:26 PM, Jian He mailto:j...@hortonworks.com>> wrote: Here’s +1 from myself. The vote passes with 7 (+1) bindings and 2 (+1) non-bindings. Thanks for

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Jian He
Here’s +1 from myself. The vote passes with 7 (+1) bindings and 2 (+1) non-bindings. Thanks for all who voted. I’ll merge to trunk by the end of today. Jian On Nov 6, 2017, at 8:38 AM, Billie Rinaldi mailto:billie.rina...@gmail.com>> wrote: +1 (binding) On Mon, Oct 30, 2017 at 1:06 PM, Jian H

[jira] [Created] (YARN-7450) ATS Client should retry on intermittent Kerberos issues.

2017-11-06 Thread Ravi Prakash (JIRA)
Ravi Prakash created YARN-7450: -- Summary: ATS Client should retry on intermittent Kerberos issues. Key: YARN-7450 URL: https://issues.apache.org/jira/browse/YARN-7450 Project: Hadoop YARN Issue

Re: [DISCUSS] A final minor release off branch-2?

2017-11-06 Thread Andrew Wang
What are the known gaps that need bridging between 2.x and 3.x? >From an HDFS perspective, we've tested wire compat, rolling upgrade, and rollback. >From a YARN perspective, we've tested wire compat and rolling upgrade. Arun just mentioned an NM rollback issue that I'm not familiar with. Anythin

[jira] [Created] (YARN-7449) Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl

2017-11-06 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-7449: -- Summary: Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl Key: YARN-7449 URL: https://issues.apache.org/jira/browse/YARN-7449 Project: Hadoop YARN

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2017-11-06 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/32/ [Nov 6, 2017 7:40:41 AM] (naganarasimha_gr) MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph. [Error replacing 'FILE' - Workspace is not accessible] --

[jira] [Created] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7448: - Summary: [API] Add SchedulingRequest to the AllocateRequest Key: YARN-7448 URL: https://issues.apache.org/jira/browse/YARN-7448 Project: Hadoop YARN Issue Type: Su

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-06 Thread Carlo Aldo Curino
+1 from me. I have: 1) setup a small cluster 2) enabled the reservation system 3) submitted reservation through REST 4) ran a job within reservation 5) did few negative tests (what happens if res system is disabled and you try to reserve, what happens if a job is submitted with invalid res id, etc

[jira] [Created] (YARN-7447) Fix a couple of issues in services REST API

2017-11-06 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-7447: Summary: Fix a couple of issues in services REST API Key: YARN-7447 URL: https://issues.apache.org/jira/browse/YARN-7447 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2017-11-06 Thread Eric Yang (JIRA)
Eric Yang created YARN-7446: --- Summary: Docker container privileged mode and --user flag contradict each other Key: YARN-7446 URL: https://issues.apache.org/jira/browse/YARN-7446 Project: Hadoop YARN

[jira] [Resolved] (YARN-7433) java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support.

2017-11-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-7433. -- Resolution: Invalid Closing this since this is a user issue with the build and/or deployment of Hadoop a

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Billie Rinaldi
+1 (binding) On Mon, Oct 30, 2017 at 1:06 PM, Jian He wrote: > Hi All, > > I would like to restart the vote for merging yarn-native-services to trunk. > Since last vote, we have been working on several issues in documentation, > DNS, CLI modifications etc. We believe now the feature is in a much

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Gour Saha
+1 (non-binding) -Gour On 10/30/17, 1:49 PM, "Jian He" wrote: >Few more things: > >This is the document for trying a non-docker service on YARN. >https://github.com/apache/hadoop/blob/yarn-native-services/hadoop-yarn-pro >ject/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/QuickSt

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-06 Thread Arun Suresh
Here is my +1 to start. - Setup a small 4 node cluster - Verified some basic HDFS commands - Ran Pi / sleep jobs (with some mix of Opportunistic containers - both distributed and centralized scheduling) Cheers -Arun On Fri, Nov 3, 2017 at 4:38 PM, Arun Suresh wrote: > Hey Vinod, > > I've clea

[jira] [Created] (YARN-7445) Render filters on Applications and Services page

2017-11-06 Thread Vasudevan Skm (JIRA)
Vasudevan Skm created YARN-7445: --- Summary: Render filters on Applications and Services page Key: YARN-7445 URL: https://issues.apache.org/jira/browse/YARN-7445 Project: Hadoop YARN Issue Type:

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Rohith Sharma K S
+1 (binding) thanks Jian for all the great work! Built from branch and deployed, able to bring up services along with atsv2 enabled and new YARN UI integration. Tried flexing, start, stop operations using REST api's. - Rohith Sharma K S On 31 October 2017 at 01:36, Jian He wrote: > Hi All, > >