Ilan Filonenko created SPARK-30160:
--------------------------------------

             Summary: Extend ExecutorPodAllocator for arbitrary CRDs
                 Key: SPARK-30160
                 URL: https://issues.apache.org/jira/browse/SPARK-30160
             Project: Spark
          Issue Type: New Feature
          Components: Kubernetes
    Affects Versions: 2.4.4, 3.0.0
            Reporter: Ilan Filonenko


There are internal use-cases at companies that require for executor creation to 
be done by privileged resources (like admin controllers / operators who would 
receive events or updates) that would create the Kubernetes Executor pods 
on-behalf of the user. In essence, the assumption that the driver has the 
appropriate service-account to create pods is not a guarantee in various 
organizations.

This proposed JIRA looks to create a pluggable interface for pod creation and 
deletion to allow for customizable allocation libraries to exist i.e. CRDs that 
scale up and down



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to