[ https://issues.apache.org/jira/browse/MAPREDUCE-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424118#comment-13424118 ]
Robert Joseph Evans commented on MAPREDUCE-4456: ------------------------------------------------ OK So the test looks like it is bogus. It expects that only URIs with a fragment will have a symlink created, but that is not how 1.0 works, nor is it how 2.0 works. If symlink creation is enabled then everything will get a link. If no fragment is given, then it is the name of the file or directory that is being downloaded. I did notice one potential issue, though. mapred.create.symlink and the more up to date mapreduce.job.cache.symlink.create are now ignored in trunk and 2.0. symlinks are always created no matter what. I am going to file a separate JIRA for that. I don't know if it is a concern or not. > LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating > symlinks > ------------------------------------------------------------------------------------ > > Key: MAPREDUCE-4456 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-4456 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 > Affects Versions: 0.23.3, 3.0.0, 2.2.0-alpha > Reporter: Robert Joseph Evans > Assignee: Robert Joseph Evans > Attachments: MR-4456.txt > > > {noformat} > java.lang.ArrayIndexOutOfBoundsException: 1 > at > org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:194) > at > org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:154) > at > org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:620) > at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) > at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215) > at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1212) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1212) > at > org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336) > at > org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:233) > at java.lang.Thread.run(Thread.java:619) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:260) > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira