Saisai Shao created SPARK-11082:
-----------------------------------
Summary: Cores per executor is wrong when response vcore number is
less than requested number
Key: SPARK-11082
URL: https://issues.apache.org/jira/browse/SPARK-11082
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.6.0
Reporter: Saisai Shao
When DefaultResourceCalculator is set (by default) for Yarn capacity scheduler,
the response container resource vcore number is always 1, which may be less
than the requested vcore number, ExecutorRunnable should honor this returned
vcore number (not the requested number) to pass to each executor. Otherwise,
actual allocated vcore number is different from Spark's managed CPU cores per
executor.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
