Zhongwei Zhu created SPARK-43086:
------------------------------------
Summary: Support bin pack task scheduling on executors
Key: SPARK-43086
URL: https://issues.apache.org/jira/browse/SPARK-43086
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.3.2
Reporter: Zhongwei Zhu
Dynamic allocation only remove or decommission an idle executor. The default
task scheduling use round robin to do task assignment on executors.
For example, we have 4 tasks to run, 4 executors(each has 4 cpu cores). Default
task scheduling will assign 1 task per executors. With bin pack, one executor
could assign 4 tasks, then dynamic allocation could remove other 3 executors to
reduce resource waste.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
