Michelangelo D'Agostino created SPARK-10157:
-----------------------------------------------
Summary: Add ability to specify s3 bootstrap script to spark-ec2
Key: SPARK-10157
URL: https://issues.apache.org/jira/browse/SPARK-10157
Project: Spark
Issue Type: Improvement
Components: EC2
Reporter: Michelangelo D'Agostino
Priority: Minor
One of the nice features of using EMR to start spark clusters is that you can
specify bootstrap actions to run on each node. This is useful for installing
custom libraries, etc. However, you pay a per-node/per-hour premium for using
EMR (https://aws.amazon.com/elasticmapreduce/pricing/).
This pull request adds the --bootstrap-script flag to the spark-ec2 script.
This flag specifies an s3 path to a shell script. The script is downloaded and
run on each node during the setup process. The flag can be specified multiple
times for multiple bootstrap actions.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
