Andrew Or created SPARK-11843:
---------------------------------
Summary: Isolate staging directory across applications on same
YARN cluster
Key: SPARK-11843
URL: https://issues.apache.org/jira/browse/SPARK-11843
Project: Spark
Issue Type: Bug
Components: YARN
Reporter: Andrew Or
Priority: Minor
If multiple clients share the same YARN cluster and file system they may end up
using the same `.sparkStaging` directory. This may be a problem if their jars
are called something similar, for instance. It would be easier to enforce
isolation for both security and user experience if the staging directories are
isolated. We can either:
(1) allow users to configure the directory name
(2) add an identifier to the directory name, which I prefer
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
