Re: Adding more slaves to a running cluster

ser @spark" <user@spark.apache.org> Subject: Re: Adding more slaves to a running cluster > spark-ec2 does not directly support adding instances to an existing cluster, > apart from the special case of adding slaves to a cluster with a master but no > slaves. There is an open issue to

Re: Adding more slaves to a running cluster

It appears start-slave.sh works on a running cluster. I'm surprised I can't find more info on this. Maybe I'm not looking hard enough? Using AWS and spot instances is incredibly more efficient, which begs for the need of dynamically adding more nodes while the cluster is up, yet everything I've

Re: Adding more slaves to a running cluster

spark-ec2 does not directly support adding instances to an existing cluster, apart from the special case of adding slaves to a cluster with a master but no slaves. There is an open issue to track adding this support, SPARK-2008 , but it doesn't

Adding more slaves to a running cluster

What's the current status on adding slaves to a running cluster? I want to leverage spark-ec2 and autoscaling groups. I want to launch slaves as spot instances when I need to do some heavy lifting, but I don't want to bring down my cluster in order to add nodes. Can this be done by just running