[ https://issues.apache.org/jira/browse/SPARK-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated SPARK-3460: ----------------------------------- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-3174) > Under YARN, discard executors that have been idle > -------------------------------------------------- > > Key: SPARK-3460 > URL: https://issues.apache.org/jira/browse/SPARK-3460 > Project: Spark > Issue Type: Bug > Components: YARN > Reporter: Patrick Wendell > Assignee: Andrew Or > > This is a simpler case of the more general ideas discussed in SPARK-3174. If > we have a YARN session that is no longer submitting tasks and has no in-scope > shuffle data or cached blocks, then we should scale down the cluster and give > up containers. > This general behavior could be enabled/disabled with a config setting. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org