Thanks Chris.I checked the configuration files and see that these properties are in place.I am trying to connect to hadoop cluster in linux from a windows machine.
On Tue, May 5, 2015 at 1:25 PM, Chris Nauroth <[email protected]> wrote: > Hello Nishanth, > > The job submission was unable to identify the principal to use for renewal > of HDFS delegation tokens. Delegation tokens are subject to a soft > expiration, which can be extended by a renewer requesting an extension > from the NameNode periodically. In the context of MapReduce running on > YARN, the ResourceManager acts as the delegation token renewer. > > Specifically, this exception likely indicates that your configuration is > missing either (or both) of the properties yarn.resourcemanager.address > and yarn.resourcemanager.principal. > > <property> > <description>The address of the applications manager interface in the > RM.</description> > <name>yarn.resourcemanager.address</name> > <value>${yarn.resourcemanager.hostname}:8032</value> > </property> > > <property> > <description>The Kerberos principal for the resource > manager.</description> > <name>yarn.resourcemanager.principal</name> > </property> > > You might want to review the secure mode documentation. It has more > details on this and other relevant configuration properties. > > http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/Secu > reMode.html > > I hope this helps. > > --Chris Nauroth > > > From: Nishanth S <[email protected]> > Reply-To: "[email protected]" <[email protected]> > Date: Tuesday, May 5, 2015 at 12:09 PM > To: "[email protected]" <[email protected]> > Subject: Help with Kerberos > > > Hello , > > I am getting the below exception when trying to run a simple map reduce > from a machine outside the hadoop cluster.This is the kerberos code I am > using.Please help > > > org.apache.hadoop.conf.Configuration conf = new > org.apache.hadoop.conf.Configuration(); > conf.set("hadoop.security.authentication", "Kerberos"); > UserGroupInformation.setConfiguration(conf); > try{ > UserGroupInformation.loginUserFromKeytab("[email protected]", > "C:\\work\\documents\\devkeytab\\abc.keytab"); > > > > Exception in thread "main" java.io.IOException: Can't get Master Kerberos > principal for use as renewer > at > org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInt > ernal(TokenCache.java:116) > at > org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInt > ernal(TokenCache.java:100) > at > org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(To > kenCache.java:80) > at > org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(Fi > leOutputFormat.java:142) > at > org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562) > at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.jav > a:432) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Unknown Source) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.j > ava:1628) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293) > at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1314) > >
