Hi, I'm very new to Spark, but experienced with AWS - so take that in to account with my suggestions.
I started with an AWS base image and then added the pre-built Spark-1.2. I then added made a 'Master' version and a 'Worker' versions and then made AMIs for them. The Master comes up with a static IP and the Worker image has this baked in. I haven't completed everything I am planning to do but so far I can bring up the Master and a bunch of Workers inside and ASG and run spark code successfully. cheers On Mon, Feb 9, 2015 at 10:06 PM, Guodong Wang <wangg...@gmail.com> wrote: > Hi guys, > > I want to launch spark cluster in AWS. And I know there is a spark_ec2.py > script. > > I am using the AWS service in China. But I can not find the AMI in the > region of China. > > So, I have to build one. My question is > 1. Where is the bootstrap script to create the Spark AMI? Is it here( > https://github.com/mesos/spark-ec2/blob/branch-1.3/create_image.sh) ? > 2. What is the base image of the Spark AMI? Eg, the base image of this ( > https://github.com/mesos/spark-ec2/blob/branch-1.3/ami-list/us-west-1/hvm) > 3. Shall I install scala during building the AMI? > > > Thanks. > > Guodong > -- *Franc Carter* | Systems Architect | Rozetta Technology franc.car...@rozettatech.com <franc.car...@rozettatech.com>| www.rozettatechnology.com Tel: +61 2 8355 2515 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215 AUSTRALIA
