[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164891234 Last but not least, should we go ahead and make a JIRA for this? it's pretty minor but not trivial --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164779770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47741/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164779603 **[Test build #47741 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47741/consoleFull)** for PR 10086 at commit [`7f8d7b6`](https://github.com/apache/spark/commit/7f8d7b6697dd32f864a5c9b20f2ff8c078e25d1c). * This patch passes all tests. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_:\n * `If you like to run the `MesosClusterDispatcher` with Marathon, you need to run the `MesosClusterDispatcher` in the foreground (i.e: `bin/spark-class org.apache.spark.deploy.mesos.MesosClusterDispatcher`).`\n --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164779769 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164776052 **[Test build #47741 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47741/consoleFull)** for PR 10086 at commit [`7f8d7b6`](https://github.com/apache/spark/commit/7f8d7b6697dd32f864a5c9b20f2ff8c078e25d1c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164772992 @srowen @andrewor14 sorry for the delay, it's updated now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user 3ourroom commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164741026 NAVER - http://www.naver.com/ 3ourr...@naver.com ëê» ë³´ë´ì ë©ì¼ ì´ ë¤ìê³¼ ê°ì ì´ì ë¡ ì ì¡ ì¤í¨íìµëë¤. ë°ë ì¬ëì´ íìëì ë©ì¼ì ìì ì°¨ë¨ íììµëë¤. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164738755 Ping @tnachen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10086#discussion_r47391278 --- Diff: docs/running-on-mesos.md --- @@ -151,13 +151,27 @@ Spark on Mesos also supports cluster mode, where the driver is launched in the c can find the results of the driver from the Mesos Web UI. To use cluster mode, you must start the MesosClusterDispatcher in your cluster via the `sbin/start-mesos-dispatcher.sh` script, -passing in the Mesos master url (e.g: mesos://host:5050). +passing in the Mesos master url (e.g: mesos://host:5050). This starts the MesosClusterDispatcher as an daemon running on the host. + +If you like to run the MesosClusterDispatcher with Marathon, you need to run the MesosClusterDispatcher in the foreground (i.e: `bin/spark-class org.apache.spark.deploy.mesos.MesosClusterDispatcher`). --- End diff -- yeah, I would backtick the dispatcher --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-164019717 @tnachen can you address the comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/10086#discussion_r46946121
--- Diff: docs/running-on-mesos.md ---
@@ -151,13 +151,27 @@ Spark on Mesos also supports cluster mode, where the
driver is launched in the c
can find the results of the driver from the Mesos Web UI.
To use cluster mode, you must start the MesosClusterDispatcher in your
cluster via the `sbin/start-mesos-dispatcher.sh` script,
-passing in the Mesos master url (e.g: mesos://host:5050).
+passing in the Mesos master url (e.g: mesos://host:5050). This starts the
MesosClusterDispatcher as an daemon running on the host.
+
+If you like to run the MesosClusterDispatcher with Marathon, you need to
run the MesosClusterDispatcher in the foreground (i.e: `bin/spark-class
org.apache.spark.deploy.mesos.MesosClusterDispatcher`).
From the client, you can submit a job to Mesos cluster by running
`spark-submit` and specifying the master url
to the url of the MesosClusterDispatcher (e.g: mesos://dispatcher:7077).
You can view driver statuses on the
Spark cluster Web UI.
-Note that jars or python files that are passed to spark-submit should be
URIs reachable by Mesos slaves.
+For example:
+./bin/spark-submit \
+ --class org.apache.spark.examples.SparkPi \
+ --master mesos://207.184.161.138:7077 \
+ --deploy-mode cluster
+ --supervise
+ --executor-memory 20G \
+ --total-executor-cores 100 \
+ http://path/to/examples.jar \
+ 1000
+
+
+Note that jars or python files that are passed to spark-submit should be
URIs reachable by Mesos slaves, as Spark driver doesn't automatically upload
local jars.
--- End diff --
Does the code block need to be in `{% highlight bash %}`? also "as Spark
driver" -> "as the Spark driver"
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/10086#discussion_r46946072 --- Diff: docs/running-on-mesos.md --- @@ -151,13 +151,27 @@ Spark on Mesos also supports cluster mode, where the driver is launched in the c can find the results of the driver from the Mesos Web UI. To use cluster mode, you must start the MesosClusterDispatcher in your cluster via the `sbin/start-mesos-dispatcher.sh` script, -passing in the Mesos master url (e.g: mesos://host:5050). +passing in the Mesos master url (e.g: mesos://host:5050). This starts the MesosClusterDispatcher as an daemon running on the host. + +If you like to run the MesosClusterDispatcher with Marathon, you need to run the MesosClusterDispatcher in the foreground (i.e: `bin/spark-class org.apache.spark.deploy.mesos.MesosClusterDispatcher`). --- End diff -- Nits: "an daemon" -> "a daemon", url -> URL, "i.e" -> "i.e.". You might back-tick MesosClusterDispatcher too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user dragos commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-162818586 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-162807873 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47318/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-162807869 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-162807762 **[Test build #47318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47318/consoleFull)** for PR 10086 at commit [`952f116`](https://github.com/apache/spark/commit/952f1163254eddf1a3dd0b36761a7f7f0978964f). * This patch passes all tests. * This patch merges cleanly. * This patch adds the following public classes _(experimental)_:\n * `If you like to run the MesosClusterDispatcher with Marathon, you need to run the MesosClusterDispatcher in the foreground (i.e: `bin/spark-class org.apache.spark.deploy.mesos.MesosClusterDispatcher`).`\n --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-162801479 **[Test build #47318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47318/consoleFull)** for PR 10086 at commit [`952f116`](https://github.com/apache/spark/commit/952f1163254eddf1a3dd0b36761a7f7f0978964f). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-162799550 @dragos just updated the docs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user dragos commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161977181 @andrewor14 the issue in the other PR is not due to missing docs, unfortunately. I will post my errors in that PR (I reached out to Tim via Slack earlier, but maybe it makes sense to have such discussions in the open) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user dragos commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161976703 Thanks, this is a good example! Can you please update also `running-on-mesos.md`, that part is where most people running on Mesos will look first. I think an example like this one, and one showing how to start the dispatcher would be great. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161880528 @andrewor14 pushed an update today, PTAL --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161766927 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47158/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161766925 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161766776 **[Test build #47158 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47158/consoleFull)** for PR 10086 at commit [`5d612d0`](https://github.com/apache/spark/commit/5d612d0e498eae6a188df62f7868dfc2c467e01c). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161757156 **[Test build #47158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47158/consoleFull)** for PR 10086 at commit [`5d612d0`](https://github.com/apache/spark/commit/5d612d0e498eae6a188df62f7868dfc2c467e01c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161754931 @andrewor14 I don't tihnk this doc helps his problem, he's running into issues where Spark configuration is not being passed down. I'm pushing a new update here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161743578 @dragos you mentioned you had difficulty running mesos in cluster mode. Does this additional documentation help? What were the issues you ran into? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10086#discussion_r46592394 --- Diff: docs/submitting-applications.md --- @@ -132,9 +144,10 @@ The master URL passed to Spark can be in one of the following formats: mesos://HOST:PORT Connect to the given Mesos cluster. The port must be whichever one your is configured to use, which is 5050 by default. Or, for a Mesos cluster using ZooKeeper, use mesos://zk:// +To submit with --deploy-mode cluster, the HOST:PORT should be configured to connect to the MesosClusterDispatcher. --- End diff -- @tnachen can you update this assuming the user doesn't know anything about the dispatcher? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161156485 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161156487 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/47028/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161156391 **[Test build #47028 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47028/consoleFull)** for PR 10086 at commit [`448d706`](https://github.com/apache/spark/commit/448d70642b233f9c8cc9d7fdff66795d5b4dead8). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161153063 looks alright --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161153030 **[Test build #47028 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47028/consoleFull)** for PR 10086 at commit [`448d706`](https://github.com/apache/spark/commit/448d70642b233f9c8cc9d7fdff66795d5b4dead8). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10086#discussion_r46368028 --- Diff: docs/submitting-applications.md --- @@ -132,9 +144,10 @@ The master URL passed to Spark can be in one of the following formats: mesos://HOST:PORT Connect to the given Mesos cluster. The port must be whichever one your is configured to use, which is 5050 by default. Or, for a Mesos cluster using ZooKeeper, use mesos://zk:// +To submit with --deploy-mode cluster, the HOST:PORT should be configured to connect to the MesosClusterDispatcher. --- End diff -- do they know at this point what a `MesosClusterDispatcher` is? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [MESOS]Add documentation about submitting Spar...
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/10086#issuecomment-161152431 @andrewor14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
