Hi Tim
Do you have any materials/blog for running Spark in a container in Mesos
cluster environment? I have googled it but couldn't find info on it. Spark
documentation says it is possible, but no details provided.. Please help
Thanks
Sathish
On Mon, Sep 21, 2015 at 11:54 AM Tim Chen
Hi Sathish,
Sorry about that, I think that's a good idea and I'll write up a section in
the Spark documentation page to explain how it can work. We (Mesosphere)
have been doing this for our DCOS spark for our past releases and has been
working well so far.
Thanks!
Tim
On Tue, Jan 19, 2016 at
Thank you! Looking forward for it..
On Tue, Jan 19, 2016 at 4:03 PM Tim Chen wrote:
> Hi Sathish,
>
> Sorry about that, I think that's a good idea and I'll write up a section
> in the Spark documentation page to explain how it can work. We (Mesosphere)
> have been doing
9/2016 7:00 PM (GMT-05:00)
To: Tim Chen <t...@mesosphere.io>
Cc: John Omernik <j...@omernik.com>, user <user@spark.apache.org>
Subject: Re: Docker/Mesos with Spark
Thank you! Looking forward for it..
On Tue, Jan 19, 2016 at 4:03 PM Tim Chen <t...@mesosphere.io>
...@omernik.com<mailto:j...@omernik.com>>, user
<user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: Re: Docker/Mesos with Spark
I also would be interested in some best practice for making this work.
Where will the writeup be posted? On mesosphere website?
Sent fr
Hi John,
There is no other blog post yet, I'm thinking to do a series of posts but
so far haven't get time to do that yet.
Running Spark in docker containers makes distributing spark versions easy,
it's simple to upgrade and automatically caches on the slaves so the same
image just runs right
I was searching in the 1.5.0 docs on the Docker on Mesos capabilities and
just found you CAN run it this way. Are there any user posts, blog posts,
etc on why and how you'd do this?
Basically, at first I was questioning why you'd run spark in a docker
container, i.e., if you run with tar balled