Testing Allocation Tag NameSpace

2019-01-30 Thread Prabhu Josephraj
Hi, Was testing Allocation Tag NameSpace on a single node cluster (Hadoop 3.3.0-SNAPSHOT) with two Distributed Shell Jobs. The first job requests a container with source tag zk. yarn org.apache.hadoop.yarn.applications.distributedshell.Client -jar $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-app

Re: Testing Allocation Tag NameSpace

2019-01-30 Thread Prabhu Josephraj
ng piece. Do you want to open a ticket to > track this? > > Thanks > > Weiwei > Power of Open and Collaborative, Bravo! > On Jan 30, 2019, 9:35 PM +0800, Prabhu Josephraj > , wrote: > > Hi, > > > >Was testing Allocation Tag NameSpace on a single node

Re: [VOTE] Propose to start new Hadoop sub project "submarine"

2019-02-04 Thread Prabhu Josephraj
+1 (non-binding) On Tue, Feb 5, 2019 at 10:30 AM Naganarasimha Garla < naganarasimha...@apache.org> wrote: > +1 > > On Sat, 2 Feb 2019, 09:51 Rohith Sharma K S wrote: > > > +1 > > > > On Sat, Feb 2, 2019, 3:54 AM Wangda Tan wrote: > > > > > Hi all, > > > > > > According to positive feedbacks fr

How Useful YARN Placement Constraint for MapReduce Jobs

2019-02-08 Thread Prabhu Josephraj
Hi, Was thinking on supporting YARN Placement Constraint for MapReduce Applications, but want to check with you on how useful it will be?. Mappers usually runs on Data Local machine and so won't need but Reducers can gain by distributing the reducers to different machine using Anti Affinity.

Re: MapReduce Job fails due to corrupted mapreduce.tar.gz

2019-03-27 Thread Prabhu Josephraj
Hi Kunal, This issue will happen if the mapreduce.tar.gz present in hdfs path (mapreduce.application.framework.path) is corrupted due to some Hdfs issue. Below steps will help to fix the issue 1. Remove all cached and corrupted mapreduce.tar.gz under the NM local directories. 2. Rep

Re: Impact of Not Enabling KerberosDelegationTokenAuthenticationHandler

2019-05-22 Thread Prabhu Josephraj
Hi Vinod, Have a ResourceManager with Secure Http and KerberosAuthenticationHandler. Have disabled yarn.resourcemanager.webapp.delegation-token-auth.filter.enabled (KerberosDelegationTokenAuthenticationHandler). So RM HttpServer will fail the Http Requests having only Delegation Token and not