[
https://issues.apache.org/jira/browse/MAPREDUCE-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ahmed Radwan updated MAPREDUCE-2658:
------------------------------------
Attachment: MAPREDUCE-2658.patch
The attached patch resolves the described issue by removing "local" as the
default value for the "mapreduce.jobtracker.address" property from
mapred-default.xml, and also in evaluating the isLocal flag in the ReduceTask
class.
All unit tests ran successfully
> Problem running full map & reduce jobs on mrv2
> ----------------------------------------------
>
> Key: MAPREDUCE-2658
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2658
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Reporter: Ahmed Radwan
> Assignee: Ahmed Radwan
> Attachments: MAPREDUCE-2658.patch
>
>
> Following the installation instructions at:
> https://svn.apache.org/repos/asf/hadoop/common/branches/MR-279/mapreduce/INSTALL
> the randomwriter example runs successfully. However, other full map & reduce
> jobs (e.g. wordcount) fail with the error:
> java.lang.UnsupportedOperationException: Incompatible with LocalRunner
> at
> org.apache.hadoop.mapred.YarnOutputFiles.getInputFile(YarnOutputFiles.java:200)
> at org.apache.hadoop.mapred.ReduceTask.getMapFiles(ReduceTask.java:223)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:412)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1094)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)
> The ReduceTask evaluates the isLocal flag based on the property
> "mapreduce.jobtracker.address", the default value for this property in
> mapred-default.xml is 'local' and this is the cause of the problem.
> Setting "mapreduce.jobtracker.address" in the mapred-site.xml to something
> other than "local" seems to solve the problem.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
