though, running it in Standalone
mode, but adding Mesos should not be that difficult I think.
Regards
Venkat
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/dockerized-spark-executor-on-mesos-tp20276p20603.html
Sent from the Apache Spark User List
use Mesos though, running it in Standalone
mode, but adding Mesos should not be that difficult I think.
Regards
Venkat
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/dockerized-spark-executor-on-mesos-tp20276p20603.html
Sent from the Apache Spark User
and are using it
in
our dev environment. We don't use Mesos though, running it in Standalone
mode, but adding Mesos should not be that difficult I think.
Regards
Venkat
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/dockerized-spark-executor-on-mesos
.1001560.n3.nabble.com/dockerized-spark-executor-on-mesos-tp20276p20603.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands
Just wondered if anyone had managed to start spark
jobs on mesos wrapped in a docker container?
At present (i.e. very early testing) I'm able to submit executors
to mesos via spark-submit easily enough, but they fall over
as we don't have a JVM on our slaves out of the box.
I can push one out
I'd suggest asking about this on the Mesos list (CCed). As far as I know, there
was actually some ongoing work for this.
Matei
On Dec 3, 2014, at 9:46 AM, Dick Davies d...@hellooperator.net wrote:
Just wondered if anyone had managed to start spark
jobs on mesos wrapped in a docker
I'd like to tag a question onto this; has anybody attempted to deploy spark
under Kubernetes
https://github.com/googlecloudplatform/kubernetes or Kubernetes mesos (
https://github.com/mesosphere/kubernetes-mesos ) .
On Wednesday, December 3, 2014, Matei Zaharia matei.zaha...@gmail.com
wrote:
I'd
Oh great, thanks Tim - I'll give that a whirl then.
A Spark rollout isn't in our immediate future, I'm just looking for a good
framework for compute alongside our marathon deployment. So a good
time to experiment!
On 4 December 2014 at 02:36, Tim Chen t...@mesosphere.io wrote:
Hi Dick,
There
