[
https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13788716#comment-13788716
]
Suresh Srinivas commented on HADOOP-10029:
------------------------------------------
13/10/03 20:21:22 INFO client.RMProxy: Connecting to ResourceManager at
namenode/68.142.246.96:8032
Running on 3 nodes to sort from har://...
hdfs://namenode:8020/user/name/archive_tests/dst/archive_11 with 5 reduces.
Job started: Thu Oct 03 20:21:22 UTC 2013
13/10/03 20:21:23 INFO client.RMProxy: Connecting to ResourceManager at
namenode/68.142.246.96:8032
13/10/03 20:21:23 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 174
for name on 68.142.246.96:8020
13/10/03 20:21:23 INFO security.TokenCache: Got dt for hdfs://namenode:8020;
Kind: HDFS_DELEGATION_TOKEN, Service: 68.142.246.96:8020, Ident:
(HDFS_DELEGATION_TOKEN token 174 for name)
13/10/03 20:21:23 INFO mapreduce.JobSubmitter: Cleaning up the staging area
/user/name/.staging/job_1380795041307_0008
java.lang.IllegalArgumentException: java.net.UnknownHostException: hdfs-namenode
at
org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:418)
at
org.apache.hadoop.security.SecurityUtil.buildDTServiceName(SecurityUtil.java:299)
at
org.apache.hadoop.fs.FileSystem.getCanonicalServiceName(FileSystem.java:298)
at
org.apache.hadoop.fs.FileSystem.collectDelegationTokens(FileSystem.java:520)
at
org.apache.hadoop.fs.FileSystem.addDelegationTokens(FileSystem.java:504)
at
org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121)
at
org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
at
org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:235)
at
org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:59)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:340)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:491)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
at org.apache.hadoop.examples.Sort.run(Sort.java:180)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.examples.Sort.main(Sort.java:191)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.net.UnknownHostException: hdfs-namenode
> Specifying har file to MR job fails in secure cluster
> -----------------------------------------------------
>
> Key: HADOOP-10029
> URL: https://issues.apache.org/jira/browse/HADOOP-10029
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Fix For: 2.2.0
>
>
> This is an issue found by [~rramya]. See the exception stack trace in the
> following comment.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
