Just throwing this out here, there is existing PR to add docker support for spark framework to launch executors with docker image.
https://github.com/apache/spark/pull/3074 Hopefully this will be merged sometime. Tim On Thu, Jan 15, 2015 at 9:18 AM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > The AMPLab maintains a bunch of Docker files for Spark here: > https://github.com/amplab/docker-scripts > > Hasn't been updated since 1.0.0, but might be a good starting point. > > On Wed Jan 14 2015 at 12:14:13 PM Josh J <joshjd...@gmail.com> wrote: > >> We have dockerized Spark Master and worker(s) separately and are using it >>> in >>> our dev environment. >> >> >> Is this setup available on github or dockerhub? >> >> On Tue, Dec 9, 2014 at 3:50 PM, Venkat Subramanian <vsubr...@gmail.com> >> wrote: >> >>> We have dockerized Spark Master and worker(s) separately and are using >>> it in >>> our dev environment. We don't use Mesos though, running it in Standalone >>> mode, but adding Mesos should not be that difficult I think. >>> >>> Regards >>> >>> Venkat >>> >>> >>> >>> -- >>> View this message in context: >>> http://apache-spark-user-list.1001560.n3.nabble.com/dockerized-spark-executor-on-mesos-tp20276p20603.html >>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >>
