holdenk created SPARK-28905:
-------------------------------

             Summary: PVs mounted into Spark may not be writable by Spark
                 Key: SPARK-28905
                 URL: https://issues.apache.org/jira/browse/SPARK-28905
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.0.0
            Reporter: holdenk
            Assignee: holdenk


Right now, for Spark to have write access to the PVs we provide it, they need 
to be created with UID 185. This _may_ be a feature, but if we wanted to make 
this more flexible we could set a FsGroup in our security context when setting 
up the volumes. This would give Spark access provided the PV supports fsgroup 
(which on minikube does not appear to be the case - 
[https://github.com/kubernetes/minikube/issues/1990] )

 

If we did want to do this we could add the securitygroup in 
MountVolumesFeatureStep but I don't know if we want to do this or if the 
current behaviour is desired.

I ran into this while getting the integration tests to work w/minikube 1.3.1 on 
OSX. See https://issues.apache.org/jira/browse/SPARK-28904 for details.

 

cc [~ifilonenko] for thoughts



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to