Hi,
Please take a look at
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/creating-an-ami-ebs.html
Cheers
Gen
On Mon, Feb 9, 2015 at 6:41 AM, Chengi Liu chengi.liu...@gmail.com wrote:
Hi I am very new both in spark and aws stuff..
Say, I want to install pandas on ec2.. (pip install
Hi,
You can make a image of ec2 with all the python libraries installed and
create a bash script to export python_path in the /etc/init.d/ directory.
Then you can launch the cluster with this image and ec2.py
Hope this can be helpful
Cheers
Gen
On Sun, Feb 8, 2015 at 9:46 AM, Chengi Liu
Hi I am very new both in spark and aws stuff..
Say, I want to install pandas on ec2.. (pip install pandas)
How do I create the image and the above library which would be used from
pyspark.
Thanks
On Sun, Feb 8, 2015 at 3:03 AM, gen tang gen.tan...@gmail.com wrote:
Hi,
You can make a image of
You can basically add one function call to install the stuffs you want. If
you look at the spark-ec2 script, there's a function which does all the
setup named: setup_cluster(..)
https://github.com/apache/spark/blob/master/ec2/spark_ec2.py#L625. Now,
if you want to install a python library (
