Saisai Shao created SPARK-11082: ----------------------------------- Summary: Cores per executor is wrong when response vcore number is less than requested number Key: SPARK-11082 URL: https://issues.apache.org/jira/browse/SPARK-11082 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.6.0 Reporter: Saisai Shao
When DefaultResourceCalculator is set (by default) for Yarn capacity scheduler, the response container resource vcore number is always 1, which may be less than the requested vcore number, ExecutorRunnable should honor this returned vcore number (not the requested number) to pass to each executor. Otherwise, actual allocated vcore number is different from Spark's managed CPU cores per executor. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org