[
https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-2208:
----------------------------------
Status: Open (was: Patch Available)
I see a potential bug with this patch: the TaskTracker _caches_ counters sent
by the child-task till it's sent out to the JobTracker via the heartbeat.
Hence, we need to *merge* the ones received from the child in
{{TaskStatus.statusUpdate}}, not just over-write them as-is today.
Minor nit: the merge of the counters probably belongs to
{{TaskInProgress.recomputeProgress}} rather than
{{TaskInProgress.updateStatus}} ...
> Reduce frequency of Counter updates in the task tracker status
> --------------------------------------------------------------
>
> Key: HADOOP-2208
> URL: https://issues.apache.org/jira/browse/HADOOP-2208
> Project: Hadoop
> Issue Type: Improvement
> Reporter: Amareshwari Sri Ramadasu
> Assignee: Amareshwari Sri Ramadasu
> Fix For: 0.16.0
>
> Attachments: patch-2208.txt, patch-2208.txt
>
>
> Currently, We have counter updates from task tracker to job tracker on every
> heartbeat. Both counter name and the values are updated for every heartbeat.
> This can be improved by sending names and values for the first time and only
> the values after that.
> The frequency can be reduced by doing update only when the counters got
> changed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
