[
https://issues.apache.org/jira/browse/SPARK-21822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141026#comment-16141026
]
lufei commented on SPARK-21822:
-------------------------------
[~sowen]I'm sorry,I didn't get your meaning before, I have already submitted a
pull request(https://github.com/apache/spark/pull/19035).
Thank you for your time.
> When insert Hive Table is finished, it is better to clean out the tmpLocation
> dir
> ---------------------------------------------------------------------------------
>
> Key: SPARK-21822
> URL: https://issues.apache.org/jira/browse/SPARK-21822
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: lufei
> Priority: Minor
>
> When insert Hive Table is finished, it is better to clean out the tmpLocation
> dir(the temp directories like
> ".hive-staging_hive_2017-08-19_10-56-01_540_5448395226195533570-9/-ext-10000"
> or "/tmp/hive/..." for an old spark version).
> Otherwise, when lots of spark job are executed, millions of temporary
> directories are left in HDFS. And these temporary directories can only be
> deleted by the maintainer through the shell script.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
