[
https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Prakash updated MAPREDUCE-3462:
------------------------------------
Attachment: MAPREDUCE-3462.branch-0.23.patch
Inside of Configuration.getStrings(),
getProps().getProperty("mapreduce.job.hdfs-servers") returns
"$fs.default.name".
System.getProperty(fs.default.name) is returning the string
"${fs.default.name}" which continually is tried to be expanded causing the
maximum depth exception.
This patch simply sets mapreduce.job.hdfs-servers to an empty string so that it
doesn't return $fs.default.name (as defined in yarn-default.xml)
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission
> failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20
> ${fs.default.name}
> at
> org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at
> org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at
> org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at
> org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at
> org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
