[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143964#comment-16143964 ]
Haibo Chen commented on MAPREDUCE-6892: --------------------------------------- Thanks for the update [~pbacsko]! The patch is very close to be ready. But I still think we should give -1 as the default value to stand for unknown in the schema (Events.avpr). In TestJobHistoryParsing.testHistoryParsingForKilledAndFailedAttempts(), let's use // for the comments you've added (/**/ is for class/methods) and remove the nested for loop to assert RACK NAME for each of the tasks (I don't think they are relevant). Otherwise, the patch LGTM. > Issues with the count of failed/killed tasks in the jhist file > -------------------------------------------------------------- > > Key: MAPREDUCE-6892 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6892 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: client, jobhistoryserver > Reporter: Peter Bacsko > Assignee: Peter Bacsko > Attachments: MAPREDUCE-6892-001.patch, MAPREDUCE-6892-002.PATCH, > MAPREDUCE-6892-003.patch, MAPREDUCE-6892-004.patch, MAPREDUCE-6892-005.patch > > > Recently we encountered some issues with the value of failed tasks. After > parsing the jhist file, {{JobInfo.getFailedMaps()}} returned 0, but actually > there were failures. > Another minor thing is that you cannot get the number of killed tasks > (although this can be calculated). > The root cause is that {{JobUnsuccessfulCompletionEvent}} contains only the > successful map/reduce task counts. Number of failed (or killed) tasks are not > stored. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org