[ https://issues.apache.org/jira/browse/SPARK-25220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marcelo Vanzin resolved SPARK-25220. ------------------------------------ Resolution: Duplicate Seems like this is covered by SPARK-24434 (pod templates). > [K8S] Split out node selector config between driver and executors. > ------------------------------------------------------------------ > > Key: SPARK-25220 > URL: https://issues.apache.org/jira/browse/SPARK-25220 > Project: Spark > Issue Type: Improvement > Components: Kubernetes > Affects Versions: 2.4.0 > Reporter: Jonathan A Weaver > Priority: Trivial > Labels: Kubernetes > > Seperated node selector config option between executors and driver. > This removes the spark.kubernetes.node.selector config option and seperates > it to > spark.kubernetes.driver.selector and spark.kubernetes.executor.selector > to allow seperate node selectors on drivers and executors. > My personal use case for this change is that on AWS we have cheap > spotinstances that can terminate at any moment which is okay for executors > but not the driver. > With a single node selector option I am unable to use the spot instances to > save costs on the executor nodes. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org