[
https://issues.apache.org/jira/browse/HADOOP-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12663526#action_12663526
]
Sharad Agarwal commented on HADOOP-4906:
----------------------------------------
Ran a SleepJob by putting a large dummy property value (20MB) in JobConf.
* Without the patch, the OOM came after running 44 map tasks. This is expected
as the default TT heap size is 1GB so the OOM should come within 50 tasks (20MB
*50) executions.
* With the patch, the no of tasks ran successfully past 1000, then I stopped
it. During the run, monitored the heap size which remains almost steady.
> TaskTracker running out of memory after running several tasks
> -------------------------------------------------------------
>
> Key: HADOOP-4906
> URL: https://issues.apache.org/jira/browse/HADOOP-4906
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Arun C Murthy
> Assignee: Sharad Agarwal
> Priority: Blocker
> Fix For: 0.20.0
>
> Attachments: 4906_v1.patch, 4906_v2.patch, 4906_v3.patch,
> 4906_v4.patch
>
>
> Looks like the TaskTracker isn't cleaning up correctly after completed/failed
> tasks, I suspect that the JobConfs aren't being deallocated. Eventually the
> TaskTracker runs out of memory after running several tasks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
