[
https://issues.apache.org/jira/browse/MAPREDUCE-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732412#action_12732412
]
Devaraj Das commented on MAPREDUCE-717:
---------------------------------------
Also disabled speculation for recovered jobs (jobs that are recovered after a
JT restart). That part needs some more thought...
> Fix some corner case issues in speculative execution (post hadoop-2141)
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-717
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-717
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.21.0
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Fix For: 0.21.0
>
> Attachments: 717.patch, 717.patch
>
>
> Some corner case issues can be fixed:
> 1) Setup task should not add anything to the job statistics (since they are
> really fast and might affect the statistics of a job with few tasks)
> 2) The statistics computations should be guarded for cases where things like
> sumOfSquares could become less than zero (due to rounding errors mostly).
> 3) The method TaskInProgress.getCurrentProgressRate() should take into
> account the COMMIT_PENDING state
> 4) The testcase TestSpeculativeExecution.testTaskLATEScheduling could be made
> more robust
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
