Andrew Or created SPARK-4139:
--------------------------------
Summary: Start the number of executors at the max if dynamic
allocation is enabled
Key: SPARK-4139
URL: https://issues.apache.org/jira/browse/SPARK-4139
Project: Spark
Issue Type: Improvement
Components: YARN
Affects Versions: 1.2.0
Reporter: Andrew Or
Assignee: Andrew Or
SPARK-3795 allows us to dynamically scale the number of executors up and down.
We should start the number at the max instead of from 0 in the beginning,
because the first job will likely run immediately after the SparkContext is set
up.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
