problem with spark-ec2 launch script Re: spark-ec2 ERROR: Line magic function `%matplotlib` not found

2014-09-26 Thread Andy Davidson
the correct version on all the machines in my cluster Thanks Andy From: Davies Liu dav...@databricks.com Date: Thursday, September 25, 2014 at 9:58 PM To: Andrew Davidson a...@santacruzintegration.com Cc: user@spark.apache.org user@spark.apache.org Subject: Re: spark-ec2 ERROR: Line magic function

Re: problem with spark-ec2 launch script Re: spark-ec2 ERROR: Line magic function `%matplotlib` not found

2014-09-26 Thread Nicholas Chammas
Liu dav...@databricks.com Date: Thursday, September 25, 2014 at 9:58 PM To: Andrew Davidson a...@santacruzintegration.com Cc: user@spark.apache.org user@spark.apache.org Subject: Re: spark-ec2 ERROR: Line magic function `%matplotlib` not found Maybe you have Python 2.7 on master but Python 2.6

Re: problem with spark-ec2 launch script Re: spark-ec2 ERROR: Line magic function `%matplotlib` not found

2014-09-26 Thread Andy Davidson
script Re: spark-ec2 ERROR: Line magic function `%matplotlib` not found Are you able to use the regular PySpark shell on your EC2 cluster? That would be the first thing to confirm is working. I don’t know whether the version of Python on the cluster would affect whether IPython works

spark-ec2 ERROR: Line magic function `%matplotlib` not found

2014-09-25 Thread Andy Davidson
Hi I am running into trouble using iPython notebook on my cluster. Use the following command to set the cluster up $ ./spark-ec2 --key-pair=$KEY_PAIR --identity-file=$KEY_FILE --region=$REGION --slaves=$NUM_SLAVES launch $CLUSTER_NAME On master I launch python as follows $

Re: spark-ec2 ERROR: Line magic function `%matplotlib` not found

2014-09-25 Thread Davies Liu
Maybe you have Python 2.7 on master but Python 2.6 in cluster, you should upgrade python to 2.7 in cluster, or use python 2.6 in master by set PYSPARK_PYTHON=python2.6 On Thu, Sep 25, 2014 at 5:11 PM, Andy Davidson a...@santacruzintegration.com wrote: Hi I am running into trouble using iPython