[
https://issues.apache.org/jira/browse/SPARK-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328738#comment-16328738
]
Marco Gaido commented on SPARK-15401:
-------------------------------------
this should have been fixed in SPARK-22793.
> Spark Thrift server creates empty directories in tmp directory on the driver
> ----------------------------------------------------------------------------
>
> Key: SPARK-15401
> URL: https://issues.apache.org/jira/browse/SPARK-15401
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.1
> Reporter: Christophe Préaud
> Priority: Minor
>
> Each connection to the Spark thrift server (e.g. using beeline) creates two
> empty directories in the tmp directory on the driver which are never removed:
> cd <tmp directory>
> ls -ltd *_resources | wc -l && /opt/spark/bin/beeline -u
> jdbc:hive2://dc1-kdp-prod-hadoop-00.prod.dc1.kelkoo.net:10000 -n kookel -e
> '!quit' && ls -ltd *_resources | wc -l
> 9080
> Connecting to jdbc:hive2://dc1-kdp-prod-hadoop-00.prod.dc1.kelkoo.net:10000
> Connected to: Spark SQL (version 1.6.1)
> Driver: Spark Project Core (version 1.6.1)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> Closing: 0: jdbc:hive2://dc1-kdp-prod-hadoop-00.prod.dc1.kelkoo.net:10000
> Beeline version 1.6.1 by Apache Hive
> 9082
> Those directories accumulates over time and are not removed:
> ls -ld *_resources | wc -l
> 9064
> And they are indeed empty:
> find *_resources -type f | wc -l
> 0
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
