Addind and subtracting workers on Spark EC2 cluster

2014-07-06 Thread Robert James
If I've created a Spark EC2 cluster, how can I add or take away workers? Also: If I use EC2 spot instances, what happens when Amazon removes them? Will my computation be saved in any way, or will I need to restart from scratch? Finally: The spark-ec2 scripts seem to use Hadoop 1. How can I

Re: Addind and subtracting workers on Spark EC2 cluster

2014-07-06 Thread Nicholas Chammas
On Sun, Jul 6, 2014 at 10:10 AM, Robert James srobertja...@gmail.com wrote: If I've created a Spark EC2 cluster, how can I add or take away workers? There is a manual process by which this is possible, but I’m not sure of the procedure. There is also SPARK-2008