[
https://issues.apache.org/jira/browse/HADOOP-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653392#action_12653392
]
Christian Kunz commented on HADOOP-4305:
----------------------------------------
We applied the patch to hadoop-0.18 and verified that two TaskTrackers
repeatedly blacklisted disappeared from the list of active TaskTrackers:
2008-12-04 02:46:04,251 INFO org.apache.hadoop.mapred.JobTracker: Adding
tracker_xxxto the blackList
2008-12-04 08:51:09,957 INFO org.apache.hadoop.mapred.JobTracker: Adding
tracker_yyyto the blackList
These two TaskTrackers indeed had disk problems and the corresponding DataNodes
were not active as well.
Great Job!
> repeatedly blacklisted tasktrackers should get declared dead
> ------------------------------------------------------------
>
> Key: HADOOP-4305
> URL: https://issues.apache.org/jira/browse/HADOOP-4305
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Christian Kunz
> Assignee: Amareshwari Sriramadasu
> Fix For: 0.20.0
>
> Attachments: patch-4305-0.18.txt, patch-4305-1.txt, patch-4305-2.txt,
> patch-4305-3.txt
>
>
> When running a batch of jobs it often happens that the same tasktrackers are
> blacklisted again and again. This can slow job execution considerably, in
> particular, when tasks fail because of timeout.
> It would make sense to no longer assign any tasks to such tasktrackers and to
> declare them dead.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
