[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16458835#comment-16458835 ]
Thomas Graves commented on SPARK-24124: --------------------------------------- [~vanzin] any objections to this? > Spark history server should create spark.history.store.path and set > permissions properly > ---------------------------------------------------------------------------------------- > > Key: SPARK-24124 > URL: https://issues.apache.org/jira/browse/SPARK-24124 > Project: Spark > Issue Type: Story > Components: Spark Core > Affects Versions: 2.3.0 > Reporter: Thomas Graves > Priority: Major > > Current with the new spark history server you can set > spark.history.store.path to a location to store the levelDB files. Currently > the directory has to be made before it can use that path. > We should just have the history server create it and set the file permissions > on the leveldb files to be restrictive -> new FsPermission((short) 0700) > the shuffle service already does this, this would be much more convenient to > use and prevent people from making mistakes with the permissions on the > directory and files. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org