Similar to what Dean called out, we build Puppet manifests so we could do the automation - its a bit of work to setup, but well worth the effort.
On Fri, Apr 24, 2015 at 11:27 AM Dean Wampler <deanwamp...@gmail.com> wrote: > It's mostly manual. You could try automating with something like Chef, of > course, but there's nothing already available in terms of automation. > > dean > > Dean Wampler, Ph.D. > Author: Programming Scala, 2nd Edition > <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly) > Typesafe <http://typesafe.com> > @deanwampler <http://twitter.com/deanwampler> > http://polyglotprogramming.com > > On Fri, Apr 24, 2015 at 10:33 AM, James King <jakwebin...@gmail.com> > wrote: > >> Thanks Dean, >> >> Sure I have that setup locally and testing it with ZK. >> >> But to start my multiple Masters do I need to go to each host and start >> there or is there a better way to do this. >> >> Regards >> jk >> >> On Fri, Apr 24, 2015 at 5:23 PM, Dean Wampler <deanwamp...@gmail.com> >> wrote: >> >>> The convention for standalone cluster is to use Zookeeper to manage >>> master failover. >>> >>> http://spark.apache.org/docs/latest/spark-standalone.html >>> >>> Dean Wampler, Ph.D. >>> Author: Programming Scala, 2nd Edition >>> <http://shop.oreilly.com/product/0636920033073.do> (O'Reilly) >>> Typesafe <http://typesafe.com> >>> @deanwampler <http://twitter.com/deanwampler> >>> http://polyglotprogramming.com >>> >>> On Fri, Apr 24, 2015 at 5:01 AM, James King <jakwebin...@gmail.com> >>> wrote: >>> >>>> I'm trying to find out how to setup a resilient Spark cluster. >>>> >>>> Things I'm thinking about include: >>>> >>>> - How to start multiple masters on different hosts? >>>> - there isn't a conf/masters file from what I can see >>>> >>>> >>>> Thank you. >>>> >>> >>> >> >
