spark git commit: [SPARK-12805][MESOS] Fixes documentation on Mesos run modes
Repository: spark Updated Branches: refs/heads/branch-1.6 dcdc864cf -> f9ecd3a39 [SPARK-12805][MESOS] Fixes documentation on Mesos run modes The default run has changed, but the documentation didn't fully reflect the change. Author: Luc Bourlier Closes #10740 from skyluc/issue/mesos-modes-doc. (cherry picked from commit cc91e21879e031bcd05316eabb856e67a51b191d) Signed-off-by: Reynold Xin Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f9ecd3a3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f9ecd3a3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f9ecd3a3 Branch: refs/heads/branch-1.6 Commit: f9ecd3a3942e3acc2e0f8f8082186f1aca71d40f Parents: dcdc864 Author: Luc Bourlier Authored: Wed Jan 13 11:45:13 2016 -0800 Committer: Reynold Xin Committed: Wed Jan 13 11:45:30 2016 -0800 -- docs/running-on-mesos.md | 12 +--- 1 file changed, 5 insertions(+), 7 deletions(-) -- http://git-wip-us.apache.org/repos/asf/spark/blob/f9ecd3a3/docs/running-on-mesos.md -- diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 3193e17..ed720f1 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -202,7 +202,7 @@ where each application gets more or fewer machines as it ramps up and down, but additional overhead in launching each task. This mode may be inappropriate for low-latency requirements like interactive queries or serving web requests. -To run in coarse-grained mode, set the `spark.mesos.coarse` property to false in your +To run in fine-grained mode, set the `spark.mesos.coarse` property to false in your [SparkConf](configuration.html#spark-properties): {% highlight scala %} @@ -266,13 +266,11 @@ See the [configuration page](configuration.html) for information on Spark config Property NameDefaultMeaning spark.mesos.coarse - false + true -If set to true, runs over Mesos clusters in -"coarse-grained" sharing mode, -where Spark acquires one long-lived Mesos task on each machine instead of one Mesos task per -Spark task. This gives lower-latency scheduling for short queries, but leaves resources in use -for the whole duration of the Spark job. +If set to true, runs over Mesos clusters in "coarse-grained" sharing mode, where Spark acquires one long-lived Mesos task on each machine. +If set to false, runs over Mesos cluster in "fine-grained" sharing mode, where one Mesos task is created per Spark task. +Detailed information in 'Mesos Run Modes'. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
spark git commit: [SPARK-12805][MESOS] Fixes documentation on Mesos run modes
Repository: spark Updated Branches: refs/heads/master 63eee86cc -> cc91e2187 [SPARK-12805][MESOS] Fixes documentation on Mesos run modes The default run has changed, but the documentation didn't fully reflect the change. Author: Luc Bourlier Closes #10740 from skyluc/issue/mesos-modes-doc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cc91e218 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cc91e218 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/cc91e218 Branch: refs/heads/master Commit: cc91e21879e031bcd05316eabb856e67a51b191d Parents: 63eee86 Author: Luc Bourlier Authored: Wed Jan 13 11:45:13 2016 -0800 Committer: Reynold Xin Committed: Wed Jan 13 11:45:13 2016 -0800 -- docs/running-on-mesos.md | 12 +--- 1 file changed, 5 insertions(+), 7 deletions(-) -- http://git-wip-us.apache.org/repos/asf/spark/blob/cc91e218/docs/running-on-mesos.md -- diff --git a/docs/running-on-mesos.md b/docs/running-on-mesos.md index 3193e17..ed720f1 100644 --- a/docs/running-on-mesos.md +++ b/docs/running-on-mesos.md @@ -202,7 +202,7 @@ where each application gets more or fewer machines as it ramps up and down, but additional overhead in launching each task. This mode may be inappropriate for low-latency requirements like interactive queries or serving web requests. -To run in coarse-grained mode, set the `spark.mesos.coarse` property to false in your +To run in fine-grained mode, set the `spark.mesos.coarse` property to false in your [SparkConf](configuration.html#spark-properties): {% highlight scala %} @@ -266,13 +266,11 @@ See the [configuration page](configuration.html) for information on Spark config Property NameDefaultMeaning spark.mesos.coarse - false + true -If set to true, runs over Mesos clusters in -"coarse-grained" sharing mode, -where Spark acquires one long-lived Mesos task on each machine instead of one Mesos task per -Spark task. This gives lower-latency scheduling for short queries, but leaves resources in use -for the whole duration of the Spark job. +If set to true, runs over Mesos clusters in "coarse-grained" sharing mode, where Spark acquires one long-lived Mesos task on each machine. +If set to false, runs over Mesos cluster in "fine-grained" sharing mode, where one Mesos task is created per Spark task. +Detailed information in 'Mesos Run Modes'. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org