[ 
https://issues.apache.org/jira/browse/SPARK-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiangrui Meng updated SPARK-3071:
---------------------------------
    Assignee: Ilya Ganelin

> Increase default driver memory
> ------------------------------
>
>                 Key: SPARK-3071
>                 URL: https://issues.apache.org/jira/browse/SPARK-3071
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Xiangrui Meng
>            Assignee: Ilya Ganelin
>
> The current default is 512M, which is usually too small because user also 
> uses driver to do some computation. In local mode, executor memory setting is 
> ignored while only driver memory is used, which provides more incentive to 
> increase the default driver memory.
> I suggest
> 1. 2GB in local mode and warn users if executor memory is set a bigger value
> 2. same as worker memory on an EC2 standalone server



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to