[
https://issues.apache.org/jira/browse/MAPREDUCE-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13181276#comment-13181276
]
Karam Singh commented on MAPREDUCE-3620:
----------------------------------------
The issue reported Vinay Kumar Thota does not seems to be MRV2. It is more
related to GridMix statistics which gridmix prints.
The trace is having 1205 jobs, gridmix process 1200 whereas rejecting next 4-5
as those are failed/killed jobs in trace.
In boths runs reported by Vinay number of jobs process were 1200.
But In run 1 :
{
6 jobs failed, 1193 jobs succeeded and one job was lost (as NodeManager on
which AppMaster of that job running lost).
At the GridMix statistics at the end print 1196 jobs processed, 6 jobs failed
and 1190 jobs passed (which is wrong w.r.t actual figure).
}
Whereas In run 2 :
{
4 jobs failed, 1196 jobs succeeded.
At the GridMix statistics at the end print 1200 jobs processed, 4 jobs failed
and 1196 jobs passed (which is correct).
}
So issue clearly belongs GridMix statistics reporting at end not job processing.
And lost jobs was due to AM lost
> Some times all the gridmix jobs are not processing.
> ---------------------------------------------------
>
> Key: MAPREDUCE-3620
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3620
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Ravi Prakash
> Priority: Critical
>
> Courtesy [~vinaythota]
> {quote}
> Job trace contains 1205 jobs and Gridmix start processing 1200 jobs after
> processing. However, after completion of
> gridmix run, execution summary details, it showed 1196 jobs are processed and
> remaining 4 jobs are missing. One log shows 1196 jobs processed and another
> log shows 1200 jobs are processed.
> {quote}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
