[ 
https://issues.apache.org/jira/browse/HIVE-23580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17119706#comment-17119706
 ] 

Attila Magyar commented on HIVE-23580:
--------------------------------------

[~ashutoshc], even with disabled cache getFileSystem is still fast:
{code:java}
2020-05-29 15:22:45,968 DEBUG org.apache.hadoop.fs.FileSystem: 
[a4f619d8-d776-4534-bb18-957c4204aa68 HiveServer2-Handler-Pool: Thread-114]: 
Bypassing cache to create filesystem 
hdfs://amagyar-2.amagyar.root.hwx.site:8020/tmp/hive/hive/a4f619d8-d776-4534-bb18-957c4204aa68/hive_2020-05-29_15-22-41_571_7827501270783748141-3
2020-05-29 15:22:45,969 INFO hive.ql.Context: 
[a4f619d8-d776-4534-bb18-957c4204aa68 HiveServer2-Handler-Pool: Thread-114]: 
FileSystem Created: 1 ms {code}

> deleteOnExit set is not cleaned up, causing memory pressure
> -----------------------------------------------------------
>
>                 Key: HIVE-23580
>                 URL: https://issues.apache.org/jira/browse/HIVE-23580
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 4.0.0
>            Reporter: Attila Magyar
>            Assignee: Attila Magyar
>            Priority: Major
>             Fix For: 4.0.0
>
>         Attachments: HIVE-23580.1.patch
>
>
> removeScratchDir doesn't always calls cancelDeleteOnExit() on context::clear



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to