[
https://issues.apache.org/jira/browse/HIVE-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wilfong updated HIVE-2479:
--------------------------------
Description:
We should log more of the Hadoop task tracker counters in the MapRedStats
class, in order to make them available to hooks and improve logging.
We should make the counters that are logged configurable, so that if different
Hadoop versions are used, different counters can be collected.
was:
We should log more of the Hadoop task tracker counters in the MapRedStats
class, in order to make them available to hooks and improve logging.
Specifically these are the counters we should add:
MAP_SPILL_CPU,
MAP_SPILL_WALLCLOCK,
MAP_SPILL_NUMBER,
MAP_SPILL_BYTES,
MAP_MEM_SORT_CPU,
MAP_MEM_SORT_WALLCLOCK,
MAP_MERGE_CPU,
MAP_MERGE_WALLCLOCK,
REDUCE_SHUFFLE_BYTES,
REDUCE_COPY_WALLCLOCK,
REDUCE_COPY_CPU,
REDUCE_SORT_WALLCLOCK,
REDUCE_SORT_CPU,
MAP_TASK_WALLCLOCK,
REDUCE_TASK_WALLCLOCK,
MAP_INPUT_BYTES
> Log more Hadoop task counter values in the MapRedStats class.
> -------------------------------------------------------------
>
> Key: HIVE-2479
> URL: https://issues.apache.org/jira/browse/HIVE-2479
> Project: Hive
> Issue Type: Improvement
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2479.1.patch.txt, HIVE-2479.2.patch.txt
>
>
> We should log more of the Hadoop task tracker counters in the MapRedStats
> class, in order to make them available to hooks and improve logging.
> We should make the counters that are logged configurable, so that if
> different Hadoop versions are used, different counters can be collected.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
