remove temporary output directory of failed tasks
-------------------------------------------------
Key: HADOOP-4654
URL: https://issues.apache.org/jira/browse/HADOOP-4654
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.18.1, 0.17.2
Reporter: Christian Kunz
When dfs is getting full (80+% of reserved space), the rate of write failures
increases, such that more map-reduce tasks can fail. By not cleaning up the
temporary output directory of tasks the situation worsens over the lifetime of
a job, increasing the probability of the whole job failing.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
