[
https://issues.apache.org/jira/browse/MAPREDUCE-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424118#comment-13424118
]
Robert Joseph Evans commented on MAPREDUCE-4456:
------------------------------------------------
OK So the test looks like it is bogus. It expects that only URIs with a
fragment will have a symlink created, but that is not how 1.0 works, nor is it
how 2.0 works. If symlink creation is enabled then everything will get a link.
If no fragment is given, then it is the name of the file or directory that is
being downloaded.
I did notice one potential issue, though. mapred.create.symlink and the more
up to date mapreduce.job.cache.symlink.create are now ignored in trunk and 2.0.
symlinks are always created no matter what. I am going to file a separate
JIRA for that. I don't know if it is a concern or not.
> LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating
> symlinks
> ------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4456
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4456
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3, 3.0.0, 2.2.0-alpha
> Reporter: Robert Joseph Evans
> Assignee: Robert Joseph Evans
> Attachments: MR-4456.txt
>
>
> {noformat}
> java.lang.ArrayIndexOutOfBoundsException: 1
> at
> org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:194)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:154)
> at
> org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:620)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385)
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215)
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212)
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:233)
> at java.lang.Thread.run(Thread.java:619)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:260)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
