getMapOutput doesn't reliably detect errors and throw to the caller
-------------------------------------------------------------------
Key: HADOOP-552
URL: http://issues.apache.org/jira/browse/HADOOP-552
Project: Hadoop
Issue Type: Bug
Affects Versions: 0.6.2
Reporter: Owen O'Malley
Assigned To: Owen O'Malley
Fix For: 0.7.0
getMapOutput does not reliabily detect errors in transmission, which usually
ends up with an EOFException in the reduce's sort:
java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:178)
at java.io.DataInputStream.readFully(DataInputStream.java:152)
at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:952)
at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:937)
at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:928)
at
org.apache.hadoop.io.SequenceFile$Sorter$SortPass.run(SequenceFile.java:1594)
at
org.apache.hadoop.io.SequenceFile$Sorter.sortPass(SequenceFile.java:1523)
at org.apache.hadoop.io.SequenceFile$Sorter.sort(SequenceFile.java:1496)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:240)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1173)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
