Repository: spark Updated Branches: refs/heads/branch-1.3 528dd34fe -> 540f474cf
[SPARK-2945][YARN][Doc]add doc for spark.executor.instances https://issues.apache.org/jira/browse/SPARK-2945 spark.executor.instances works. As this JIRA recommended, we should add docs for this common config. Author: WangTaoTheTonic <wangtao...@huawei.com> Closes #4350 from WangTaoTheTonic/SPARK-2945 and squashes the following commits: 4c3913a [WangTaoTheTonic] not compatible with dynamic allocation 5fa9c46 [WangTaoTheTonic] add doc for spark.executor.instances (cherry picked from commit d34f79c8db79ae461fadae190446ebc19091bec9) Signed-off-by: Andrew Or <and...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/540f474c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/540f474c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/540f474c Branch: refs/heads/branch-1.3 Commit: 540f474cfcc355b031c285bb0a9663f9050bd062 Parents: 528dd34 Author: WangTaoTheTonic <wangtao...@huawei.com> Authored: Fri Feb 6 11:57:02 2015 -0800 Committer: Andrew Or <and...@databricks.com> Committed: Fri Feb 6 11:58:28 2015 -0800 ---------------------------------------------------------------------- docs/running-on-yarn.md | 7 +++++++ 1 file changed, 7 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/540f474c/docs/running-on-yarn.md ---------------------------------------------------------------------- diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 68ab127..2b93eef 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -105,6 +105,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </td> </tr> <tr> + <td><code>spark.executor.instances</code></td> + <td>2</td> + <td> + The number of executors. Note that this property is incompatible with <code>spark.dynamicAllocation.enabled</code>. + </td> +</tr> +<tr> <td><code>spark.yarn.executor.memoryOverhead</code></td> <td>executorMemory * 0.07, with minimum of 384 </td> <td> --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
