holdenk created SPARK-28905: ------------------------------- Summary: PVs mounted into Spark may not be writable by Spark Key: SPARK-28905 URL: https://issues.apache.org/jira/browse/SPARK-28905 Project: Spark Issue Type: Improvement Components: Kubernetes Affects Versions: 3.0.0 Reporter: holdenk Assignee: holdenk
Right now, for Spark to have write access to the PVs we provide it, they need to be created with UID 185. This _may_ be a feature, but if we wanted to make this more flexible we could set a FsGroup in our security context when setting up the volumes. This would give Spark access provided the PV supports fsgroup (which on minikube does not appear to be the case - [https://github.com/kubernetes/minikube/issues/1990] ) If we did want to do this we could add the securitygroup in MountVolumesFeatureStep but I don't know if we want to do this or if the current behaviour is desired. I ran into this while getting the integration tests to work w/minikube 1.3.1 on OSX. See https://issues.apache.org/jira/browse/SPARK-28904 for details. cc [~ifilonenko] for thoughts -- This message was sent by Atlassian Jira (v8.3.2#803003) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org