[ https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell resolved SPARK-2109. ------------------------------------ Resolution: Fixed Fixed in master and 1.0 via https://github.com/apache/spark/pull/1050/files > Setting SPARK_MEM for bin/pyspark does not work. > ------------------------------------------------- > > Key: SPARK-2109 > URL: https://issues.apache.org/jira/browse/SPARK-2109 > Project: Spark > Issue Type: Bug > Affects Versions: 1.0.0 > Reporter: Prashant Sharma > Assignee: Prashant Sharma > Priority: Critical > Fix For: 1.0.1, 1.1.0 > > > prashant@sc:~/work/spark$ SPARK_MEM=10G bin/pyspark > Python 2.7.6 (default, Mar 22 2014, 22:59:56) > [GCC 4.8.2] on linux2 > Type "help", "copyright", "credits" or "license" for more information. > Traceback (most recent call last): > File "/home/prashant/work/spark/python/pyspark/shell.py", line 43, in > <module> > sc = SparkContext(appName="PySparkShell", pyFiles=add_files) > File "/home/prashant/work/spark/python/pyspark/context.py", line 94, in > __init__ > SparkContext._ensure_initialized(self, gateway=gateway) > File "/home/prashant/work/spark/python/pyspark/context.py", line 190, in > _ensure_initialized > SparkContext._gateway = gateway or launch_gateway() > File "/home/prashant/work/spark/python/pyspark/java_gateway.py", line 51, > in launch_gateway > gateway_port = int(proc.stdout.readline()) > ValueError: invalid literal for int() with base 10: 'Warning: SPARK_MEM is > deprecated, please use a more specific config option\n' -- This message was sent by Atlassian JIRA (v6.2#6252)