[ https://issues.apache.org/jira/browse/SPARK-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558752#comment-14558752 ]
Sean Owen commented on SPARK-7699: ---------------------------------- Hm, waiting for x seconds also seems suboptimal since, in the case where the executors aren't needed, you're just delaying releasing them. Does it make sense to wait 1 heartbeat? x heartbeats? to start changing the allocation? > Number of executors can be reduced from initial before work is scheduled > ------------------------------------------------------------------------ > > Key: SPARK-7699 > URL: https://issues.apache.org/jira/browse/SPARK-7699 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Reporter: meiyoula > Priority: Minor > > spark.dynamicAllocation.minExecutors 2 > spark.dynamicAllocation.initialExecutors 3 > spark.dynamicAllocation.maxExecutors 4 > Just run the spark-shell with above configurations, the initial executor > number is 2. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org