Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

+1 I built from source code deployed a cluster and successfully ran jobs while restarting RM as well Jian > On Dec 12, 2017, at 4:28 PM, John Zhuge wrote: > > Thanks Junping for the great effort! > > > - Verified checksums and signatures of all tarballs > - Built source with native, Azu

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

My late +1 > On Dec 7, 2017, at 7:38 PM, Sunil G wrote: > > Thank You all. > > We merged the branch to trunk and updated jiras accordingly. Thanks > everyone who helped in this feature. > > - Sunil and Wangda > > > On Thu, Dec 7, 2017 at 10:13 PM Sunil G wrote: > >> And lastly +1 (binding

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (binding) Built from source code. Successfully ran jobs and in the meantime tried to restart RM. Jian > On Nov 13, 2017, at 4:10 PM, Arun Suresh wrote: > > Hi Folks, > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the > starting release for Apache Hadoop 2.9.x l

Re: [VOTE] Merge yarn-native-services branch into trunk

Okay, I just merged the branch to trunk (108 commits in total !) Again, thanks for all who contributed to this feature! Jian On Nov 6, 2017, at 1:26 PM, Jian He mailto:j...@hortonworks.com>> wrote: Here’s +1 from myself. The vote passes with 7 (+1) bindings and 2 (+1) non-bindings. Than

Re: [VOTE] Merge yarn-native-services branch into trunk

Here’s +1 from myself. The vote passes with 7 (+1) bindings and 2 (+1) non-bindings. Thanks for all who voted. I’ll merge to trunk by the end of today. Jian On Nov 6, 2017, at 8:38 AM, Billie Rinaldi mailto:billie.rina...@gmail.com>> wrote: +1 (binding) On Mon, Oct 30, 2017 at 1:06 PM

Re: [VOTE] Merge yarn-native-services branch into trunk

/apache/hadoop/blob/yarn-native-services/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/Examples.md And the vote lasts 7 days as usual. Thanks, Jian On Oct 30, 2017, at 1:06 PM, Jian He mailto:j...@hortonworks.com>> wrote: Hi All, I would like to restart th

[VOTE] Merge yarn-native-services branch into trunk

Hi All, I would like to restart the vote for merging yarn-native-services to trunk. Since last vote, we have been working on several issues in documentation, DNS, CLI modifications etc. We believe now the feature is in a much better shape. Some back ground: At a high level, the following are the

Re: YARN native services Re: 2017-10-06 Hadoop 3 release status update

Allen, I was under the impression (and, maybe this was my misunderstanding. if so, sorry) that “the goal” for this first pass was to integrate the existing Apache Slider functionality into YARN. As it stands, I don’t think those goals have been met. It doesn’t seem to be much different than j

Re: 2017-10-06 Hadoop 3 release status update

Hi Allen, Thanks for spending the time reviewing it. A new patch was uploaded yesterday on YARN-7198 to address the documentation of missing config, you might want to check. The api-server is basically a REST server which accepts user requests to deploy services, it now has an option to be run a

Re: [VOTE] Merge yarn-native-services branch into trunk

Hi Allen, Thanks for sharing the feedback. I opened YARN-7191 for addressing the feedback. We can move the discussions there. Thanks, Jian > On Sep 13, 2017, at 10:10 AM, Allen Wittenauer > wrote: > > >> On Sep 8, 2017, at 9:25 AM, Jian He wrote: >> >> Hi Al

Re: [DISCUSS] Merge yarn-native-services branch into trunk

N-7126 has some introductory documentation, But I think we need to flesh it up a bit more before release, I would also like to see steps to deploy a sample service. Cheers -Arun On Thu, Aug 31, 2017 at 12:40 AM, Jian He mailto:j...@hortonworks.com>> wrote: Update: I’ve chatted with An

Re: [VOTE] Merge yarn-native-services branch into trunk

ning GA for Nov 1st, and 3.1.0 for January. > > Best, > Andrew > > On Wed, Sep 6, 2017 at 10:19 AM, Jian He wrote: > >>> Please correct me if I’m wrong, but the current summary of the >> branch, post these changes, looks like: >> Sorry for confusion, I was

Re: [VOTE] Merge yarn-native-services branch into trunk

:19 AM, Jian He wrote: > >> Please correct me if I’m wrong, but the current summary of the branch, >> post these changes, looks like: > Sorry for confusion, I was actively writing the formal documentation for how > to use/how it works etc. and will post soon in a few

Re: [VOTE] Merge yarn-native-services branch into trunk

AM, Allen Wittenauer > wrote: > > >> On Sep 5, 2017, at 6:23 PM, Jian He wrote: >> >>> If it doesn’t have all the bells and whistles, then it shouldn’t be on >>> port 53 by default. >> Sure, I’ll change the default port to not use 53 and document it

Re: [VOTE] Merge yarn-native-services branch into trunk

ipt. > Check the output. It’s pretty obviously borked: Thanks for pointing out. Missed this when rebasing onto trunk. > On Sep 5, 2017, at 3:11 PM, Allen Wittenauer > wrote: > > >> On Sep 5, 2017, at 2:53 PM, Jian He wrote: >> >>> Based on the documen

Re: [VOTE] Merge yarn-native-services branch into trunk

> 1) Did I miss it or is there no actual end-user documentation on how to use > this? Yes, we are in the process of finishing up the the doc and posting it. We considered this a release blocker for 3.0.0-beta1 and so working on it in parallel while the branch merge happens. > 2) Lots of

[VOTE] Merge yarn-native-services branch into trunk

Hi All, I would like to call a vote for merging yarn-native-services to trunk. The vote will run for 7 days as usual. At a high level, the following are the key feautres implemented. - YARN-5079[1]. A native YARN framework (ApplicationMaster) to migrate and orchestrate existing services to YAR

Re: [DISCUSS] Merge yarn-native-services branch into trunk

YARN-7127 to run the entire patch against trunk, once that goes green, I plan to start a formal vote. Thanks, Jian On Aug 18, 2017, at 2:48 PM, Andrew Wang mailto:andrew.w...@cloudera.com>> wrote: Hi Jian, thanks for the reply, On Thu, Aug 17, 2017 at 1:03 PM, Jian He mailto:j...@hort

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

le hbase cluster >> - Flow level aggregations done as dynamic (table level) coprocessors >> - Uses latest stable HBase release 1.2.6 >> >> There are a total of 82 subtasks that were completed as part of this >> effort. >> >> We paid close attention to ensu

Re: [DISCUSS] Merge yarn-native-services branch into trunk

g 15, 2017 at 1:56 PM, Jian He mailto:j...@hortonworks.com>> wrote: Hi All, I would like to bring up the discussion of merging yarn-native-services branch into trunk in a few weeks. There are a few issues left under YARN-5079 that are being actively worked upon. As soon as they are resolve

[DISCUSS] Merge yarn-native-services branch into trunk

Hi All, I would like to bring up the discussion of merging yarn-native-services branch into trunk in a few weeks. There are a few issues left under YARN-5079 that are being actively worked upon. As soon as they are resolved, we plan on start a vote hopefully in next 2 weeks. The goal is to get t

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

+1 (binding) - built from source - deployed a pseudo cluster - ran basic example tests. - Navigate the UI a bit, looks good. Jian > On Mar 22, 2017, at 9:03 PM, larry mccay wrote: > > +1 (non-binding) > > - verified signatures > - built from source and ran tests > - deployed pseudo cluster >

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

+1 Built from source code. Deployed single node cluster. Successfully ran some example jobs. Jian > On Aug 18, 2016, at 10:05 AM, Vinod Kumar Vavilapalli > wrote: > > Hi all, > > I've created a new release candidate RC2 for Apache Hadoop 2.7.3. > > As discussed before, this is the next main

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 for the source tarball. - Compiled and built from the source code - Deployed a cluster - Successfully ran some sample jobs. Thanks, Jian > On Jul 27, 2016, at 10:11 AM, Akira Ajisaka > wrote: > > +1 for the source tarball. > > - Downloaded source tarball and binary tarball > - Verified si

Re: [Release thread] 2.8.0 release activities

For MapReduce/YARN, I closed a few staled ones. Only 4 jiras needs attention for 2.8 MAPREDUCE-6288 YARN-1815 YARN-4685 YARN-4844 The rest are either improvements or long-standing issues and does not qualify release blocker, IMO. I think we’ll try to get these 4 jiras in asap. The rest will be

[jira] [Resolved] (MAPREDUCE-6099) Adding getSplits(JobContext job, List stats) to mapreduce CombineFileInputFormat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-6099. Resolution: Won't Fix Close as Jason mentioned > Adding getSplits(JobContext job, Li

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

+1, - built from source code - deployed a single cluster - run sample jobs which pass successfully. Jian > On Jan 22, 2016, at 6:52 AM, Sunil Govind wrote: > > +1 (Non Binding) > > * Built tar ball from source and deployed > * Verified few MR Jobs for various nodelabel and preemption cases. >

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, Build and deploy the cluster from source code. Ran a few example jobs and passed successfully. Jian > On Dec 16, 2015, at 2:19 PM, Vinod Kumar Vavilapalli > wrote: > > +1 (binding) for the RC except for my question below about the tag. > > I checked 2.6.3-RC0, based on my check-list: >

Re: Planning Apache Hadoop 2.7.2

sorry, missed the cut.. I’d like to merge YARN-4127 into branch-2.7.2 also. That’s important because it prevents RM to startup, if the problem is hit. > On Nov 3, 2015, at 3:24 PM, Vinod Vavilapalli wrote: > > I’m closing down 2.7.2 now, almost there. > > Created a new branch-2.7.2 for the r

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

+1 (binding) Build from source code. Deployed a local cluster. Validated sample jobs passed. Jian > On Sep 18, 2015, at 7:34 AM, Wangda Tan wrote: > > Deployed a local cluster, verified configured cluster with node labels, run > jobs with/without node labels. > > +1 (non-binding) > > Thanks!

Re: Planning Hadoop 2.6.1 release

Can we include YARN-3999 too, if the list is not yet frozen. > On Aug 11, 2015, at 1:49 PM, Hitesh Shah wrote: > > Jason Lowe just filed YARN-4047 ( patch available too ) which probably is > also a good candidate for 2.6.1 or 2.6.2 if the list is frozen. I have > labelled the jira as a 2.6.1

Re: [VOTE] Release Apache Hadoop 2.6.0

+1, Built from source. Deployed a single node cluster. Ran sample MapReduce jobs while restarting RM successfully. Jian On Tue, Nov 18, 2014 at 8:47 AM, Eric Payne wrote: > +1 . Thanks Arun, for producing this release. I downloaded and built > the source. I started local cluster and ran wordco

[jira] [Created] (MAPREDUCE-6087) MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS config name is wrong

Jian He created MAPREDUCE-6087: -- Summary: MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS config name is wrong Key: MAPREDUCE-6087 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6087

Re: hadoop-2.5 - June end?

Just found the roadmap includes a wrong jira link for "RM Webservices YARN-1731", it should be YARN-1695 . Jian On Mon, Jun 23, 2014 at 2:51 PM, Karthik Kambatla wrote: > While YARN-1492 would greatly benefit performance, I think it might be a >

Re: [VOTE] Release Apache Hadoop 2.4.1

+1, built from source code. installed single node cluster. ran a few sample jobs successfully. Jian On Wed, Jun 18, 2014 at 12:13 PM, Vinod Kumar Vavilapalli < vino...@apache.org> wrote: > > There is one item [MAPREDUCE-5830 HostUtil.getTaskLogUrl is not backwards > binary compatible with 2.3]

[jira] [Created] (MAPREDUCE-5838) TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently

Jian He created MAPREDUCE-5838: -- Summary: TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently Key: MAPREDUCE-5838 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5838

[jira] [Created] (MAPREDUCE-5832) TestJobClient fails sometimes on Windows

Jian He created MAPREDUCE-5832: -- Summary: TestJobClient fails sometimes on Windows Key: MAPREDUCE-5832 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5832 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-5818) hsadmin cmd is missing in mapred.cmd

Jian He created MAPREDUCE-5818: -- Summary: hsadmin cmd is missing in mapred.cmd Key: MAPREDUCE-5818 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5818 Project: Hadoop Map/Reduce Issue

Re: [VOTE] Release Apache Hadoop 2.4.0

+1 non-binding Built from source code, tested on a single node cluster. Successfully ran a few MR sample jobs. Tested RM restart while job is running. Thanks, Jian On Tue, Apr 1, 2014 at 5:42 PM, Travis Thompson wrote: > +1 non-binding > > Built from git. Started with 120 node 2.3.0 cluster wit

Re: [VOTE] Release Apache Hadoop 2.3.0

+1 (non-binding) Built from source. Ran a few MR sample jobs on a pseudo cluster. Everything works fine. Jian On Wed, Feb 12, 2014 at 2:32 PM, Aaron T. Myers wrote: > +1 (binding) > > I downloaded the source tar ball, checked signatures, built from the > source, ran a few of the sample jobs o

[jira] [Resolved] (MAPREDUCE-5397) AM crashes because Webapp failed to start on multi node cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-5397. Resolution: Cannot Reproduce > AM crashes because Webapp failed to start on multi node clus

Re: [VOTE] Release Apache Hadoop 2.2.0

+1 non-binding Built from source code, and ran a few sample jobs on single node cluster, tested RM and AM recovery. Thanks, Jian On Thu, Oct 10, 2013 at 10:59 AM, Chris Nauroth wrote: > +1 non-binding > > I verified the checksum and signature. I deployed the tarball to a small > cluster of Ub

[jira] [Created] (MAPREDUCE-5568) JHS return invalid string for reducer completion percentage if AM restarts with 0 reducer.

Jian He created MAPREDUCE-5568: -- Summary: JHS return invalid string for reducer completion percentage if AM restarts with 0 reducer. Key: MAPREDUCE-5568 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5568

[jira] [Created] (MAPREDUCE-5535) TestClusterMRNotification.testMR is failing

Jian He created MAPREDUCE-5535: -- Summary: TestClusterMRNotification.testMR is failing Key: MAPREDUCE-5535 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5535 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5519) Change JobClient to use YarnClient to interact with RM

Jian He created MAPREDUCE-5519: -- Summary: Change JobClient to use YarnClient to interact with RM Key: MAPREDUCE-5519 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5519 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5516) TestMRJobClient fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-5516. Resolution: Duplicate > TestMRJobClient fails on tr

[jira] [Created] (MAPREDUCE-5516) TestMRJobClient fails, TestUberAM hangs on trunk

Jian He created MAPREDUCE-5516: -- Summary: TestMRJobClient fails, TestUberAM hangs on trunk Key: MAPREDUCE-5516 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5516 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-5471. Resolution: Duplicate Closed as a duplicate of YARN-540 > Succeed job tr

[jira] [Created] (MAPREDUCE-5505) Clients should be notified job finished after job successfully unregistered

Jian He created MAPREDUCE-5505: -- Summary: Clients should be notified job finished after job successfully unregistered Key: MAPREDUCE-5505 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5505

[jira] [Created] (MAPREDUCE-5497) '5s sleep' in MRAppMaster.shutDownJob is only needed before stopping ClientService

Jian He created MAPREDUCE-5497: -- Summary: '5s sleep' in MRAppMaster.shutDownJob is only needed before stopping ClientService Key: MAPREDUCE-5497 URL: https://issues.apache.org/jira/browse/MAPR

[jira] [Created] (MAPREDUCE-5436) Better exception handling for Invalid AMRMToken exception for MapReduce

Jian He created MAPREDUCE-5436: -- Summary: Better exception handling for Invalid AMRMToken exception for MapReduce Key: MAPREDUCE-5436 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5436 Project

[jira] [Created] (MAPREDUCE-5412) Change MR to use multiple containers API of ContainerManager after YARN-926

Jian He created MAPREDUCE-5412: -- Summary: Change MR to use multiple containers API of ContainerManager after YARN-926 Key: MAPREDUCE-5412 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5412

[jira] [Created] (MAPREDUCE-5397) AM crashes because Webapp failed to start on multi node cluster

Jian He created MAPREDUCE-5397: -- Summary: AM crashes because Webapp failed to start on multi node cluster Key: MAPREDUCE-5397 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5397 Project: Hadoop

[jira] [Created] (MAPREDUCE-5303) Changes on MR after moving ProtoBase to package impl.pb on YARN-724

Jian He created MAPREDUCE-5303: -- Summary: Changes on MR after moving ProtoBase to package impl.pb on YARN-724 Key: MAPREDUCE-5303 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5303 Project

[jira] [Created] (MAPREDUCE-5297) Update MR App after YARN-748

Jian He created MAPREDUCE-5297: -- Summary: Update MR App after YARN-748 Key: MAPREDUCE-5297 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5297 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-5285) Update MR App to use immutable ApplicationAttemptID, ContainerID, NodeID after YARN-735

Jian He created MAPREDUCE-5285: -- Summary: Update MR App to use immutable ApplicationAttemptID, ContainerID, NodeID after YARN-735 Key: MAPREDUCE-5285 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5285

[jira] [Created] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

Jian He created MAPREDUCE-5270: -- Summary: Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side Key: MAPREDUCE-5270 URL: https://issues.apache.org/jira/browse/MAPREDUCE