[ https://issues.apache.org/jira/browse/SPARK-30096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-30096: --------------------------------- Description: Steps: 1. {{spark-master --master yarn}} 2. {{spark-sql> create function addDoubles AS 'com.huawei.bigdata.hive.example.udf.AddDoublesUDF' using jar 'hdfs://hacluster/user/user1/AddDoublesUDF.jar';}} 3. {{spark-sql> select addDoubles (1,2);}} In the console log user can see Added [/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources/AddDoublesUDF.jar] to class path 19/12/02 13:49:33 INFO SessionState: Added [/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources/AddDoublesUDF.jar] to class path 4. {{spark-sql>drop function AddDoubles;}} Check the tmp folder still session is not clear {code} vm1:/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources # ll total 11696 -rw-r--r-- 1 root root 92660 Dec 2 13:49 .AddDoublesUDF.jar.crc -rwxr-xr-x 1 root root 11859263 Dec 2 13:49 AddDoublesUDF.jar vm1:/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources # {code} was: Steps: 1.spark-master --master yarn 2. spark-sql> create function addDoubles AS 'com.huawei.bigdata.hive.example.udf.AddDoublesUDF' using jar 'hdfs://hacluster/user/user1/AddDoublesUDF.jar'; 3. spark-sql> select addDoubles (1,2); In the console log user can see Added [/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources/AddDoublesUDF.jar] to class path 19/12/02 13:49:33 INFO SessionState: Added [/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources/AddDoublesUDF.jar] to class path 4. spark-sql>drop function AddDoubles; Check the tmp folder still session is not clear vm1:/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources # ll total 11696 -rw-r--r-- 1 root root 92660 Dec 2 13:49 .AddDoublesUDF.jar.crc -rwxr-xr-x 1 root root 11859263 Dec 2 13:49 AddDoublesUDF.jar vm1:/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources # > drop function does not delete the jars file from tmp folder- session is not > getting clear > ----------------------------------------------------------------------------------------- > > Key: SPARK-30096 > URL: https://issues.apache.org/jira/browse/SPARK-30096 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.0.0 > Reporter: ABHISHEK KUMAR GUPTA > Priority: Major > > Steps: > 1. {{spark-master --master yarn}} > 2. {{spark-sql> create function addDoubles AS > 'com.huawei.bigdata.hive.example.udf.AddDoublesUDF' using jar > 'hdfs://hacluster/user/user1/AddDoublesUDF.jar';}} > 3. {{spark-sql> select addDoubles (1,2);}} > In the console log user can see > Added [/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources/AddDoublesUDF.jar] > to class path > 19/12/02 13:49:33 INFO SessionState: Added > [/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources/AddDoublesUDF.jar] to > class path > 4. {{spark-sql>drop function AddDoubles;}} > Check the tmp folder still session is not clear > {code} > vm1:/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources # ll > total 11696 > -rw-r--r-- 1 root root 92660 Dec 2 13:49 .AddDoublesUDF.jar.crc > -rwxr-xr-x 1 root root 11859263 Dec 2 13:49 AddDoublesUDF.jar > vm1:/tmp/23090937-7314-43d8-a859-b35f42d37bdf_resources # > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org