[
https://issues.apache.org/jira/browse/HADOOP-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12700878#action_12700878
]
Mac Yang commented on HADOOP-5706:
----------------------------------
Sample output from a normal job,
Job JOBID="job_200904200538_0393" FINISH_TIME="1240248187540"
JOB_STATUS="SUCCESS" FINISHED_MAPS="20" FINISHED_REDUCES="1" FAILED_MAPS="0"
FAILED_REDUCES="0"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters
)[(TOTAL_LAUNCHED_REDUCES)(Launched reduce
tasks)(1)][(RACK_LOCAL_MAPS)(Rack-local map
tasks)(2)][(TOTAL_LAUNCHED_MAPS)(Launched map
tasks)(20)][(DATA_LOCAL_MAPS)(Data-local map
tasks)(1)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(83248)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(2019250)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(948688)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(56630)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce
Framework)[(REDUCE_INPUT_GROUPS)(Reduce input
groups)(5315)][(COMBINE_OUTPUT_RECORDS)(Combine output
records)(0)][(MAP_INPUT_RECORDS)(Map input
records)(72020)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle
bytes)(821560)][(REDUCE_OUTPUT_RECORDS)(Reduce output
records)(5315)][(SPILLED_RECORDS)(Spilled
Records)(1057000)][(MAP_OUTPUT_BYTES)(Map output
bytes)(3373000)][(MAP_INPUT_BYTES)(Map input
bytes)(2965720)][(MAP_OUTPUT_RECORDS)(Map output
records)(528500)][(COMBINE_INPUT_RECORDS)(Combine input
records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(528500)]}" .
Sample output from a killed job,
Job JOBID="job_200904200538_0015" FINISH_TIME="1240209608007"
JOB_STATUS="KILLED" FINISHED_MAPS="1" FINISHED_REDUCES="0" .
> Job history log does not output final counters if job is failed or killed
> -------------------------------------------------------------------------
>
> Key: HADOOP-5706
> URL: https://issues.apache.org/jira/browse/HADOOP-5706
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Mac Yang
>
> The last log entry in job history contains important counters. This
> information is missing if the job is killed or failed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
