GitHub user mag- opened a pull request:
https://github.com/apache/incubator-spark/pull/620
Enhance ec2 scripts, add vpc support
I made a few changes to ec2 scripts, they now support launching clusters
inside specified VPC and subnet.
Also added support for placement groups, and a list of "secure ips" that
are added to security groups so your cluster won't be open for a whole world.
Ephemeral disks were not always properly attached ( sometimes I got only
two on cc2.8xlarge when I should have 4 ) - fixed that
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mag-/incubator-spark add_vpc_support
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-spark/pull/620.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #620
----
commit 0ed50ec5e7a9e6bdd1a8b1c0c5a6a9aca2e98923
Author: Rafal ^^MAg^^ Kwasny <[email protected]>
Date: 2014-02-19T16:24:58Z
add support for VPC
commit 867c6f610c0fb03aae2ed99bb1a1cc1e7095f73c
Author: Rafal ^^MAg^^ Kwasny <[email protected]>
Date: 2014-02-19T18:22:56Z
add support for placement groups, and multipple secure ips
commit 523837d863925797e4de645f715a4b284f86797a
Author: Rafal ^^MAg^^ Kwasny <[email protected]>
Date: 2014-02-20T16:45:08Z
ensure all ephemeral disks are added to instance
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. To do so, please top-post your response.
If your project does not have this feature enabled and wishes so, or if the
feature is enabled but not working, please contact infrastructure at
[email protected] or file a JIRA ticket with INFRA.
---