[
https://issues.apache.org/jira/browse/HADOOP-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661457#action_12661457
]
Amareshwari Sriramadasu commented on HADOOP-4983:
-------------------------------------------------
This happens, because TaskInProgress replaces counters in every status update
and sometimes, status update doesnot have counters.
The code doing the same is in the method, TaskInProgress.recomputeProgress() :
{code}
} else if (status.getRunState() == TaskStatus.State.RUNNING) {
if (status.getProgress() >= bestProgress) {
bestProgress = status.getProgress();
bestState = status.getStateString();
bestCounters = status.getCounters();
}
}
}
{code}
> Job counters sometimes go down as tasks run without task failures
> -----------------------------------------------------------------
>
> Key: HADOOP-4983
> URL: https://issues.apache.org/jira/browse/HADOOP-4983
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Owen O'Malley
> Priority: Critical
>
> As tasks run, the counters seem to back up and move forward again. They
> always seem to be right when the task completes. I suspect this may have been
> introduced in HADOOP-2208.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.