[
https://issues.apache.org/jira/browse/SPARK-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129026#comment-14129026
]
Thomas Graves commented on SPARK-3476:
--------------------------------------
note https://github.com/apache/spark/pull/2253 fixes up the am memory
calculations.
> Yarn ClientBase.validateArgs memory checks wrong
> ------------------------------------------------
>
> Key: SPARK-3476
> URL: https://issues.apache.org/jira/browse/SPARK-3476
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.2.0
> Reporter: Thomas Graves
>
> The yarn ClientBase.validateArgs memory checks are no longer valid. It used
> to be that the overhead was taken out of what the user specified, now we add
> it on top of what the user specifies. We can probably just remove these.
> (args.amMemory <= memoryOverhead) -> ("Error: AM memory size must be" +
> "greater than: " + memoryOverhead),
> (args.executorMemory <= memoryOverhead) -> ("Error: Executor memory
> size" +
> "must be greater than: " + memoryOverhead.toString)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
