Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-19 Thread Sunil Govind
+1 (non-binding). Thanks Junping for the effort. I have used release package and verified below cases - Ran MR sleep job and wordcount successfully in where nodes are configured with labels. - Verified application priority feature and I could see high priority apps are getting resource over lower

Re: Assignee request for YARN-6164 and YARN-6195

2017-02-15 Thread Sunil Govind
Hello Benson I added you are a Contributor for YARN project. You could go ahead and assign yourself from now onwards. Thanks - Sunil On Wed, Feb 15, 2017 at 1:56 PM Benson Qiu wrote: > Hi, > > I created YARN-6164 and > YARN-6195

Re: Jenkins patch-compile fails on trunk

2016-11-11 Thread Sunil Govind
Hi YARN-5868 is created to handle this issue. Thanks Sunil On Fri, Nov 11, 2016 at 6:09 AM Wangda Tan wrote: > This looks like bug caused by npm, looking into it now. > > Thanks, > Wangda > > On Thu, Nov 10, 2016 at 4:00 PM, Zhe Zhang wrote: > > > https://builds.apache.org/job/PreCommit-HDFS

Re: [VOTE] Merge YARN-3368 (new web UI) to trunk

2016-11-01 Thread Sunil Govind
Thank you very much Wangda for starting the vote thread. I have launched new UI in a 5 node cluster and tested. All pages are loading fine and provides necessary information. I think new UI will be a very good addition and it can provide a lot of information which user seeking for in much easier

Re: [Discuss] Merge YARN-3368 to trunk

2016-10-23 Thread Sunil Govind
Thanks Wangda for starting the thread. Tested latest patch against trunk. UI looks good. +1 for the merge. + Sunil On Wed, Oct 19, 2016 at 5:16 AM Wangda Tan wrote: > YARN Devs, > > *Updates since Sep 22, 2016:* > > We sent a merge YARN-3368 discussion email on Sep 22, 2016 and received > some

Re: [Discuss] Merge YARN-3368 to trunk

2016-09-20 Thread Sunil Govind
Thank You Wangda for driving the proposal. I had taken the branch code and applied against trunk. Also verified basic operations in all pages. Looks fine to me for now. I am fine in merging the new UI base to trunk. Thanks, Sunil On Sat, Sep 10, 2016 at 4:25 AM Wangda Tan wrote: > YARN devs,

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

2016-08-23 Thread Sunil Govind
Hi All +1 non-binding 1. Built from source and deployed 2 node cluster 2. Tested node labels basic scenarios 3. Ran sleep and wordcount. 4. Verified few cli commands and web UI. Thanks Sunil On Thu, Aug 18, 2016 at 7:35 AM Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created a new releas

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-27 Thread Sunil Govind
Hi All +1 (non-binding) - Compiled and created tar ball from source - Tested few MR jobs with node labels - Verified UI Thanks Sunil On Sat, Jul 23, 2016 at 7:45 AM Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created a release candidate RC0 for Apache Hadoop 2.7.3. > > As discussed before

Re: Queue ACLs overridden by yarn.admin.acl

2016-07-01 Thread Sunil Govind
ave acl_view_applications on queue > similar to acl_administer_queue. A user can kill other user's job with > acl_administer_queue. Similarly, a user can be made to view other user's > job with acl_view_applications. > > On Fri, Jul 1, 2016 at 1:40 PM, Sunil Govind > wrote: > >

Re: Queue ACLs overridden by yarn.admin.acl

2016-07-01 Thread Sunil Govind
Hi Prabhu If "yarn.admin.acl" is configured with "yarn", then "yarn" user can be used to administer apps in cluster generally. This is handled as per admin ACLs. Similarly CS also have Queue ACLs, and these ACLs can be set per queue level. So as per you example (with some minor changes) yarn.adm

Re: Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Sunil Govind
Hi Tsuyoshi I think you might need to set below environment variables for HADOOP_MAPRED_HOME mapreduce.admin.user.env yarn.app.mapreduce.am.env Thanks Sunil On Mon, Jun 27, 2016 at 4:10 PM Tsuyoshi Ozawa wrote: > Hi, > > Have anyone tried to submit jobs on trunk cluster? > I failed to launch

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-09 Thread Sunil Govind
+1 (non-binding) with one note, - Installed tar ball from source and brought up the cluster - Ran few MR jobs and those are working fine. - UI and REST apis are also looks fine. Ran few rest queries for this test. - Tested node label feature and works fine. (one observation during this testing) O

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-22 Thread Sunil Govind
+1 (Non Binding) * Built tar ball from source and deployed * Verified few MR Jobs for various nodelabel and preemption cases. * Verified RM Web UI and REST queries. looks fine. Thanks and Regards Sunil G On Fri, Jan 15, 2016 at 10:27 AM Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created

Re: [Update] Reg recent recurring Test failures in YARN

2016-01-07 Thread Sunil Govind
Hi All It seems like there will be a security loophole with this patch. So for now, we are reverting this fix. Without this fix, we will see test fails again. Mostly we need to make some changes in jenkins machine's /etc/hosts. Thoughts are welcome. Thank You Sunil On Thu, Jan 7, 2016 at 3:38 P

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Sunil Govind
+1 (Non Binding) * Built tar ball from source and deployed * Ran few MR Jobs successfully. Also tested preemption, node labels sanity scenarios including HA. * Verified RM Web UI and ran few REST queries. Seems fine. * CLI commands related to refresh are also working fine. Thanks and Regards Sun

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

2015-11-13 Thread Sunil Govind
+1 (non-binding) - Build the tar ball from source and deployed. - Ran few MR jobs successfully along with some basic node label and preemption verification. - Verified RM Web UI, AM UI and Timeline UI. All pages are looking fine. Thanks and Regards Sunil On Thu, Nov 12, 2015 at 10:01 AM Vinod Ku

Re: 2.7.2 release plan

2015-11-13 Thread Sunil Govind
> wrote: > > > YARN-3849 looks like a bit of a non-trivial change this late for 2.7.2, I > > requested Wangda offline to punt it for 2.7.3. > > > > Thanks > > +Vinod > > > > > On Nov 2, 2015, at 12:43 AM, Sunil Govind > > wrote: > > >

Re: [DISCUSS] Looking to a 2.8.0 release

2015-11-12 Thread Sunil Govind
Thank you Vinod for starting this discussion. +1 for getting a beta/alpha version for Application Priority (YARN-1963). Major patches are already in and MAPREDUCE-5870 (making MR also to use app-priority) is in final review stages. This feature is also tested in-house. With 2.8.0 alpha, I feel we

Re: 2.7.2 release plan

2015-11-02 Thread Sunil Govind
Thank you. I will help to backport to 2.7.2. Thank you Sunil On Mon, Nov 2, 2015 at 2:10 PM Wangda Tan wrote: > +1 to back port it to 2.7.2, marked to 2.7.2-candidate. > > On Mon, Nov 2, 2015 at 12:37 AM, Sunil Govind > wrote: > > > Thank you Wangda. Sorry to pitch in

Re: 2.7.2 release plan

2015-11-02 Thread Sunil Govind
Thank you Wangda. Sorry to pitch in late here. I feel YARN-3849 is also a good candidate for 2.7.2. This s a bug fix for DRC and preemption. Thank You Sunil On Thu, Oct 29, 2015 at 12:26 PM Naganarasimha G R (Naga) < garlanaganarasi...@huawei.com> wrote: > Thanks for sharing this important vie

Re: [VOTE] Release Apache Hadoop 2.6.2

2015-10-28 Thread Sunil Govind
+1 (non-binding) - Built tar ball from the source - Installed a 2 node cluster and tested basic MR flows. - Sanity test cases are also running fine. Thanks and regards Sunil On Fri, Oct 23, 2015 at 2:44 AM Sangjin Lee wrote: > Hi all, > > I have created a release candidate (RC0) for Hadoop 2.6

Re: Git is giving read error for hadoop repo

2015-01-08 Thread Sunil Govind
ror is Connection reset by peer > Try git clone http://git.apache.org/hadoop.git > > On Wed, Jan 7, 2015 at 12:02 AM, Sunil Govind > wrote: > > > I am getting below error while I try clone to hadoop git repo. > > Getting same error while pulling to an existing repo

Git is giving read error for hadoop repo

2015-01-06 Thread Sunil Govind
I am getting below error while I try clone to hadoop git repo. Getting same error while pulling to an existing repo which I pulled a week back. $ git clone git://git.apache.org/hadoop.git Cloning into 'hadoop'... fatal: read error: Invalid argument Have anyone experienced similar to this recentl

Resource Manager wasting time in allocating many containers and AM rejecting same under a specific scenario

2013-12-30 Thread Sunil govind
In ResourceManager TaskImpl class, RetroactiveKilledTransition and RetroactiveFailureTransition methods are there. In a specific scenario, like when a Node becomes unstable [bad node] Or when an external signal is raised to kill a Successful task which is completed, Then RetroactiveKilledTransiti