[
https://issues.apache.org/jira/browse/HADOOP-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665329#action_12665329
]
Amareshwari Sriramadasu commented on HADOOP-5002:
-------------------------------------------------
With HADOOP-4847, setting of work output path is moved to method,
initialize(), which is the first method called from run() of Map/Reduce Task,
after starting communication thread.
In branch 0.19, ReduceTask.run() does instantiation of class Reducer in the
beginning of the method. i.e. before initialize() call, which is not necessary.
The patch moves the instantiation of reducer down, where the reducer is
actually called i.e. after shuffle and sort.
> 2 core tests TestFileOutputFormat and TestHarFileSystem are failing in branch
> 19
> --------------------------------------------------------------------------------
>
> Key: HADOOP-5002
> URL: https://issues.apache.org/jira/browse/HADOOP-5002
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.1
> Environment: tests fail on my RHEL desktop in branch 19
> Reporter: Ravi Gummadi
> Assignee: Amareshwari Sriramadasu
> Priority: Blocker
> Fix For: 0.19.1
>
> Attachments: patch-5002.txt
>
>
> I see 2 of the core tests(TestHarFileSystem and TestFileOutputFormat) failing
> in branch 19. These are passing in branch 20 and in trunk.
> I see nullpointer exceptions for the attempts of reducde tasks in the
> logs(for example, see the following):
> 2009-01-09 13:53:34,112 INFO mapred.TaskInProgress
> (TaskInProgress.java:updateStatus(484)) - Error from
> attempt_200901091353_0001_r_000000_0: java.lang.NullPointerException
> at org.apache.hadoop.fs.Path.<init>(Path.java:61)
> at org.apache.hadoop.fs.Path.<init>(Path.java:50)
> at
> org.apache.hadoop.tools.HadoopArchives$HArchivesReducer.configure(HadoopArchives.java:552)
> at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:83)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:337)
> at org.apache.hadoop.mapred.Child.main(Child.java:155)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
