[
https://issues.apache.org/jira/browse/HIVE-28789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated HIVE-28789:
--------------------------------
Description:
The proposal aims to implement a mechanism in HS2 to retrieve metrics from Tez
sessions. The actual implementation should be abstracted at the
TezSession/TezSessionState level.
An initial implementation in Hive could introduce a getMetrics abstraction
along with a default implementation that retrieves metrics from the most recent
DagStatus (obtained via dagClient). Later, a dedicated metrics endpoint can be
introduced for Tez AMs to enhance this functionality.
was:The proposal here is to implement a way in HS2 to get metrics from Tez
sessions. The actual implementation should be abstracted on the
TezSession/TezSessionState level. In Tez, there is a notion of unmanaged
sessions (TEZ-3991), which implies that Tez sessions (AMs) would expose metrics
about themselves, however, moving the metrics from the dagClient would be
beneficial for this purpose, as theoretically, metrics can exist outside of a
running DAG's scope too. An initial implementation in Hive might want to
contain the getMetrics abstraction and a default implementation for getting
those from the most recent DagStatus (got from a dagClient), and later, a
metric endpoint can be created for Tez AMs.
> Session-level metrics from Tez sessions
> ---------------------------------------
>
> Key: HIVE-28789
> URL: https://issues.apache.org/jira/browse/HIVE-28789
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
>
> The proposal aims to implement a mechanism in HS2 to retrieve metrics from
> Tez sessions. The actual implementation should be abstracted at the
> TezSession/TezSessionState level.
> An initial implementation in Hive could introduce a getMetrics abstraction
> along with a default implementation that retrieves metrics from the most
> recent DagStatus (obtained via dagClient). Later, a dedicated metrics
> endpoint can be introduced for Tez AMs to enhance this functionality.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
