[ https://issues.apache.org/jira/browse/MAPREDUCE-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-838: ---------------------------------------------- Attachment: patch-838-1.txt Patch for trunk > Task succeeds even when committer.commitTask fails with IOException > ------------------------------------------------------------------- > > Key: MAPREDUCE-838 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-838 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: task > Affects Versions: 0.20.1 > Reporter: Koji Noguchi > Assignee: Amareshwari Sriramadasu > Priority: Blocker > Fix For: 0.20.1 > > Attachments: patch-838-0.20.txt, patch-838-1-0.20.txt, > patch-838-1.txt, patch-838.txt > > > In MAPREDUCE-837, job succeeded with empty output even though all the tasks > were throwing IOException at commiter.commitTask. > {noformat} > 2009-08-07 17:51:47,458 INFO org.apache.hadoop.mapred.TaskRunner: Task > attempt_200907301448_8771_r_000000_0 is allowed to commit now > 2009-08-07 17:51:47,466 WARN org.apache.hadoop.mapred.TaskRunner: Failure > committing: java.io.IOException: Can not get the relative path: \ > base = > hdfs://mynamenode:8020/user/knoguchi/test2.har/_temporary/_attempt_200907301448_8771_r_000000_0 > \ > child = > hdfs://mynamenode/user/knoguchi/test2.har/_temporary/_attempt_200907301448_8771_r_000000_0/_index > at > org.apache.hadoop.mapred.FileOutputCommitter.getFinalPath(FileOutputCommitter.java:150) > at > org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(FileOutputCommitter.java:106) > at > org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(FileOutputCommitter.java:126) > at > org.apache.hadoop.mapred.FileOutputCommitter.commitTask(FileOutputCommitter.java:86) > at > org.apache.hadoop.mapred.OutputCommitter.commitTask(OutputCommitter.java:171) > at org.apache.hadoop.mapred.Task.commit(Task.java:768) > at org.apache.hadoop.mapred.Task.done(Task.java:692) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417) > at org.apache.hadoop.mapred.Child.main(Child.java:170) > 2009-08-07 17:51:47,468 WARN org.apache.hadoop.mapred.TaskRunner: Failure > asking whether task can commit: java.io.IOException: \ > Can not get the relative path: base = > hdfs://mynamenode:8020/user/knoguchi/test2.har/_temporary/_attempt_200907301448_8771_r_000000_0 > \ > child = > hdfs://mynamenode/user/knoguchi/test2.har/_temporary/_attempt_200907301448_8771_r_000000_0/_index > at > org.apache.hadoop.mapred.FileOutputCommitter.getFinalPath(FileOutputCommitter.java:150) > at > org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(FileOutputCommitter.java:106) > at > org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(FileOutputCommitter.java:126) > at > org.apache.hadoop.mapred.FileOutputCommitter.commitTask(FileOutputCommitter.java:86) > at > org.apache.hadoop.mapred.OutputCommitter.commitTask(OutputCommitter.java:171) > at org.apache.hadoop.mapred.Task.commit(Task.java:768) > at org.apache.hadoop.mapred.Task.done(Task.java:692) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:417) > at org.apache.hadoop.mapred.Child.main(Child.java:170) > 2009-08-07 17:51:47,469 INFO org.apache.hadoop.mapred.TaskRunner: Task > attempt_200907301448_8771_r_000000_0 is allowed to commit now > 2009-08-07 17:51:47,472 INFO org.apache.hadoop.mapred.TaskRunner: Task > 'attempt_200907301448_8771_r_000000_0' done. > {noformat} -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.