[jira] [Commented] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly
[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16463934#comment-16463934 ] Apache Spark commented on SPARK-24124: -- User 'tgravescs' has created a pull request for this issue: https://github.com/apache/spark/pull/21234 > Spark history server should create spark.history.store.path and set > permissions properly > > > Key: SPARK-24124 > URL: https://issues.apache.org/jira/browse/SPARK-24124 > Project: Spark > Issue Type: Story > Components: Spark Core >Affects Versions: 2.3.0 >Reporter: Thomas Graves >Priority: Major > > Current with the new spark history server you can set > spark.history.store.path to a location to store the levelDB files. Currently > the directory has to be made before it can use that path. > We should just have the history server create it and set the file permissions > on the leveldb files to be restrictive -> new FsPermission((short) 0700) > the shuffle service already does this, this would be much more convenient to > use and prevent people from making mistakes with the permissions on the > directory and files. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly
[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16458904#comment-16458904 ] Marcelo Vanzin commented on SPARK-24124: This should be fine. > Spark history server should create spark.history.store.path and set > permissions properly > > > Key: SPARK-24124 > URL: https://issues.apache.org/jira/browse/SPARK-24124 > Project: Spark > Issue Type: Story > Components: Spark Core >Affects Versions: 2.3.0 >Reporter: Thomas Graves >Priority: Major > > Current with the new spark history server you can set > spark.history.store.path to a location to store the levelDB files. Currently > the directory has to be made before it can use that path. > We should just have the history server create it and set the file permissions > on the leveldb files to be restrictive -> new FsPermission((short) 0700) > the shuffle service already does this, this would be much more convenient to > use and prevent people from making mistakes with the permissions on the > directory and files. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24124) Spark history server should create spark.history.store.path and set permissions properly
[ https://issues.apache.org/jira/browse/SPARK-24124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16458835#comment-16458835 ] Thomas Graves commented on SPARK-24124: --- [~vanzin] any objections to this? > Spark history server should create spark.history.store.path and set > permissions properly > > > Key: SPARK-24124 > URL: https://issues.apache.org/jira/browse/SPARK-24124 > Project: Spark > Issue Type: Story > Components: Spark Core >Affects Versions: 2.3.0 >Reporter: Thomas Graves >Priority: Major > > Current with the new spark history server you can set > spark.history.store.path to a location to store the levelDB files. Currently > the directory has to be made before it can use that path. > We should just have the history server create it and set the file permissions > on the leveldb files to be restrictive -> new FsPermission((short) 0700) > the shuffle service already does this, this would be much more convenient to > use and prevent people from making mistakes with the permissions on the > directory and files. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
