[
https://issues.apache.org/jira/browse/HIVE-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved HIVE-8574.
----------------------------------
Resolution: Not a Problem
I'll close this as "not a problem" for now. If we decide the overhead is too
much, we can revisit it.
As for the ugly API, currently I couldn't think of a way to avoid it. Spark's
API is just not very friendly in this area.
> Enhance metrics gathering in Spark Client [Spark Branch]
> --------------------------------------------------------
>
> Key: HIVE-8574
> URL: https://issues.apache.org/jira/browse/HIVE-8574
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
>
> The current implementation of metrics gathering in the Spark client is a
> little hacky. First, it's awkward to use (and the implementation is also
> pretty ugly). Second, it will just collect metrics indefinitely, so in the
> long term it turns into a huge memory leak.
> We need a simplified interface and some mechanism for disposing of old
> metrics.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
