[ 
https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14955748#comment-14955748
 ] 

Thejas M Nair commented on HIVE-11768:
--------------------------------------

I agree HIVE-6091 will not fix the memory leak. Also, looks like that patch 
missed the deletion of tmpErrOutputFile.

Thanks for the patch [~navis]! I have added some minor comments in RB .

I also see that there is a call in Context.java and SessionState to 
FileSystem.deleteOnExit  and we don't call cancelDeleteOnExit on those. Looks 
like those Path objects can also consume excess memory in a long running HS2. 
It does not have to be addressed in this jira, we can create a follow up jira 
for that.


> java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-11768
>                 URL: https://issues.apache.org/jira/browse/HIVE-11768
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 1.2.1
>            Reporter: Nemon Lou
>            Assignee: Navis
>            Priority: Minor
>             Fix For: 2.0.0
>
>         Attachments: HIVE-11768.1.patch.txt, HIVE-11768.2.patch.txt, 
> HIVE-11768.3.patch.txt, HIVE-11768.4.patch.txt
>
>
>   More than 490,000 paths was added to java.io.DeleteOnExitHook on one of our 
> long running HiveServer2 instances,taken up more than 100MB on heap.
>   Most of the paths contains a suffix of ".pipeout".



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to