[
https://issues.apache.org/jira/browse/MAPREDUCE-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Gummadi updated MAPREDUCE-1813:
------------------------------------
Attachment: 1813.v1.3.patch
Attaching new patch with the testcases refactoring. Moved the validation of
task status from testStreamingStatus() to testReporting() and removed
testStreamingStatus() method. Modified the perl script of
TestStreamingStatus.java to write to stdout(similar to that is there in
TestStreamingEmptyInpnonemptyOut.java) and removed the file
TestStreamingEmptyInpnonemptyOut.java.
As there are 3 copies of the method readOutput() in different files, removed 2
of the 3 readOutput() methods and kept the one in MapReduceTestUtil.java.
> NPE in PipeMapred.MRErrorThread
> -------------------------------
>
> Key: MAPREDUCE-1813
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1813
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.20.1
> Reporter: Amareshwari Sriramadasu
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: 1813.patch, 1813.v1.2.patch, 1813.v1.3.patch,
> 1813.v1.patch
>
>
> Some reduce tasks fail with following NPE
> java.lang.RuntimeException: java.lang.NullPointerException
> at
> org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:325)
> at
> org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:540)
> at org.apache.hadoop.streaming.PipeReducer.close(PipeReducer.java:137)
> at
> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:474)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:412)
> at org.apache.hadoop.mapred.Child.main(Child.java:159)
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.streaming.PipeMapRed$MRErrorThread.setStatus(PipeMapRed.java:517)
> at
> org.apache.hadoop.streaming.PipeMapRed$MRErrorThread.run(PipeMapRed.java:449)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
