[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099089#comment-14099089 ]
Josh Rosen commented on SPARK-922: ---------------------------------- Yeah, you still need to set PYSPARK_PYTHON since this doesn't overwrite the system Python. I was updating this to brain-dump the script I'm using for a Python 2.6 vs Python 2.7 benchmark. > Update Spark AMI to Python 2.7 > ------------------------------ > > Key: SPARK-922 > URL: https://issues.apache.org/jira/browse/SPARK-922 > Project: Spark > Issue Type: Task > Components: EC2, PySpark > Affects Versions: 0.9.0, 0.9.1, 1.0.0 > Reporter: Josh Rosen > Fix For: 1.1.0 > > > Many Python libraries only support Python 2.7+, so we should make Python 2.7 > the default Python on the Spark AMIs. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org