Thomas Graves created SPARK-24124: ------------------------------------- Summary: Spark history server should create spark.history.store.path and set permissions properly Key: SPARK-24124 URL: https://issues.apache.org/jira/browse/SPARK-24124 Project: Spark Issue Type: Story Components: Spark Core Affects Versions: 2.3.0 Reporter: Thomas Graves
Current with the new spark history server you can set spark.history.store.path to a location to store the levelDB files. Currently the directory has to be made before it can use that path. We should just have the history server create it and set the file permissions on the leveldb files to be restrictive -> new FsPermission((short) 0700) the shuffle service already does this, this would be much more convenient to use and prevent people from making mistakes with the permissions on the directory and files. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org