Ilan Filonenko created SPARK-30160: -------------------------------------- Summary: Extend ExecutorPodAllocator for arbitrary CRDs Key: SPARK-30160 URL: https://issues.apache.org/jira/browse/SPARK-30160 Project: Spark Issue Type: New Feature Components: Kubernetes Affects Versions: 2.4.4, 3.0.0 Reporter: Ilan Filonenko
There are internal use-cases at companies that require for executor creation to be done by privileged resources (like admin controllers / operators who would receive events or updates) that would create the Kubernetes Executor pods on-behalf of the user. In essence, the assumption that the driver has the appropriate service-account to create pods is not a guarantee in various organizations. This proposed JIRA looks to create a pluggable interface for pod creation and deletion to allow for customizable allocation libraries to exist i.e. CRDs that scale up and down -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org