If I've created a Spark EC2 cluster, how can I add or take away workers? Also: If I use EC2 spot instances, what happens when Amazon removes them? Will my computation be saved in any way, or will I need to restart from scratch?
Finally: The spark-ec2 scripts seem to use Hadoop 1. How can I configure them to use Hadoop 2?