[
https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779135#comment-13779135
]
Alexander Pivovarov commented on HIVE-4501:
-------------------------------------------
I did the fix which solves the problem with open FileSystems. (in case
hive.server2.enable.doAs is true (which is default))
I remember all UGIs created during Statement execution/fetch and then close FSs
for all these UGIs on Statement.close() event (Filesystem CACHE should be
enabled)
I tested it - it looks good. Can you review the fix?
https://github.com/WANdisco/amplab-hive/commit/ef7b4f618323796e730a0a4025455fa3a8fc66d6
> HS2 memory leak - FileSystem objects in FileSystem.CACHE
> --------------------------------------------------------
>
> Key: HIVE-4501
> URL: https://issues.apache.org/jira/browse/HIVE-4501
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 0.11.0
> Reporter: Thejas M Nair
> Assignee: Thejas M Nair
> Priority: Critical
> Attachments: HIVE-4501.1.patch
>
>
> org.apache.hadoop.fs.FileSystem objects are getting accumulated in
> FileSystem.CACHE, with HS2 in unsecure mode.
> As a workaround, it is possible to set fs.hdfs.impl.disable.cache and
> fs.file.impl.disable.cache to true.
> Users should not have to bother with this extra configuration.
> As a workaround disable impersonation by setting hive.server2.enable.doAs to
> false.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
