[
https://issues.apache.org/jira/browse/SPARK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21834:
------------------------------------
Assignee: Apache Spark
> Incorrect executor request in case of dynamic allocation
> --------------------------------------------------------
>
> Key: SPARK-21834
> URL: https://issues.apache.org/jira/browse/SPARK-21834
> Project: Spark
> Issue Type: Bug
> Components: Scheduler
> Affects Versions: 2.2.0
> Reporter: Sital Kedia
> Assignee: Apache Spark
>
> killExecutor api currently does not allow killing an executor without
> updating the total number of executors needed. In case of dynamic allocation
> is turned on and the allocator tries to kill an executor, the scheduler
> reduces the total number of executors needed ( see
> https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala#L635)
> which is incorrect because the allocator already takes care of setting the
> required number of executors itself.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
