[
https://issues.apache.org/jira/browse/SPARK-19522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-19522:
------------------------------
Description:
{code}
bin/spark-shell --master local-cluster[2,1,2048]
{code}
doesn't do what you think it does. You'll end up getting executors with 1GB
each because that's the default. This is because the executor memory flag isn't
actually read in local mode.
was:
{code}
bin/spark-shell --master local-cluster[2,1,2048] --executor-memory 2G
{code}
doesn't do what you think it does. You'll end up getting executors with 1GB
each because that's the default. This is because the executor memory flag isn't
actually read in local mode.
> --executor-memory flag doesn't work in local-cluster mode
> ---------------------------------------------------------
>
> Key: SPARK-19522
> URL: https://issues.apache.org/jira/browse/SPARK-19522
> Project: Spark
> Issue Type: Bug
> Components: Deploy
> Affects Versions: 2.0.0
> Reporter: Andrew Or
> Assignee: Andrew Or
>
> {code}
> bin/spark-shell --master local-cluster[2,1,2048]
> {code}
> doesn't do what you think it does. You'll end up getting executors with 1GB
> each because that's the default. This is because the executor memory flag
> isn't actually read in local mode.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
