Aihua Xu created HIVE-16455:
-------------------------------

             Summary: ADD JAR command leaks JAR Files
                 Key: HIVE-16455
                 URL: https://issues.apache.org/jira/browse/HIVE-16455
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
            Reporter: Aihua Xu
            Assignee: Aihua Xu


HiveServer2 is leaking file handles when using ADD JAR statement and the JAR 
file added is not used in the query itself.

{noformat}
beeline> !connect jdbc:hive2://localhost:10000 admin
0: jdbc:hive2://localhost:10000> create table test_leak (a int);
0: jdbc:hive2://localhost:10000> insert into test_leak Values (1);

-- Exit beeline terminal; Find PID of HiveServer2

[root@host-10-17-80-111 ~]# lsof -p 29588 | grep "(deleted)" | wc -l
0
[root@host-10-17-80-111 ~]# beeline -u jdbc:hive2://localhost:10000/default -n 
admin

And run the command "ADD JAR hdfs:///tmp/hive-contrib.jar; select * from 
test_leak"
[root@host-10-17-80-111 ~]# lsof -p 29588 | grep "(deleted)" | wc -l
1

java    29588 hive  391u   REG              252,3    125987  2099944 
/tmp/57d98f5b-1e53-44e2-876b-6b4323ac24db_resources/hive-contrib.jar (deleted)
java    29588 hive  392u   REG              252,3    125987  2099946 
/tmp/eb3184ad-7f15-4a77-a10d-87717ae634d1_resources/hive-contrib.jar (deleted)
java    29588 hive  393r   REG              252,3    125987  2099825 
/tmp/e29dccfc-5708-4254-addb-7a8988fc0500_resources/hive-contrib.jar (deleted)
java    29588 hive  394r   REG              252,3    125987  2099833 
/tmp/5153dd4a-a606-4f53-b02c-d606e7e56985_resources/hive-contrib.jar (deleted)
java    29588 hive  395r   REG              252,3    125987  2099827 
/tmp/ff3cdb05-917f-43c0-830a-b293bf397a23_resources/hive-contrib.jar (deleted)
java    29588 hive  396r   REG              252,3    125987  2099822 
/tmp/60531b66-5985-421e-8eb5-eeac31fdf964_resources/hive-contrib.jar (deleted)
java    29588 hive  397r   REG              252,3    125987  2099831 
/tmp/78878921-455c-438c-9735-447566ed8381_resources/hive-contrib.jar (deleted)
java    29588 hive  399r   REG              252,3    125987  2099835 
/tmp/0e5d7990-30cc-4248-9058-587f7f1ff211_resources/hive-contrib.jar (deleted)
{noformat}
You can see the the session directory (and therefore anything in it) is set to 
delete only on exit.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to