[ 
https://issues.apache.org/jira/browse/HADOOP-16435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893250#comment-16893250
 ] 

Akira Ajisaka edited comment on HADOOP-16435 at 7/26/19 2:13 AM:
-----------------------------------------------------------------

[~kgyrtkirk] thank you for the information.
\+1, I confirmed there are 30\+ RpcMetrics retained in the heap dump. Let's 
unregister this.


was (Author: ajisakaa):
[~kgyrtkirk] thank you for the information.
 1, I confirmed there are 30+ RpcMetrics retained in the heap dump. Let's 
unregister this.

> RpcMetrics should not be retained forever
> -----------------------------------------
>
>                 Key: HADOOP-16435
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16435
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: rpc-server
>            Reporter: Zoltan Haindrich
>            Assignee: Zoltan Haindrich
>            Priority: Critical
>         Attachments: HADOOP-16435.01.patch, classes.png, 
> defaultMetricsHoldsRpcMetrics.png, related.jxray.png, rpcm.hprof.xz
>
>
> * RpcMetrics objects are registered into 
> [defaultmetricssystem|https://github.com/apache/hadoop/blob/85d9111a88f94a5e6833cd142272be2c5823e922/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/metrics/RpcMetrics.java#L101]
> * although there is a shutdown() call (which is actually invoked) it doesn't 
> unregisters itself from the 
> [metricssystem|https://github.com/apache/hadoop/blob/85d9111a88f94a5e6833cd142272be2c5823e922/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/metrics/RpcMetrics.java#L185]
> * RpcDetailedMetrics has the same issue
> background
> * hiveserver2 slowly eats up memory when running simple queries in new 
> sessions (select 1)
> * every session opens a tezsession
> * tezsession has rpcmetrics
> * with a 150M heap after around 30 session the jvm gets outofmemmory



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to