[ https://issues.apache.org/jira/browse/SPARK-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129026#comment-14129026 ]
Thomas Graves commented on SPARK-3476: -------------------------------------- note https://github.com/apache/spark/pull/2253 fixes up the am memory calculations. > Yarn ClientBase.validateArgs memory checks wrong > ------------------------------------------------ > > Key: SPARK-3476 > URL: https://issues.apache.org/jira/browse/SPARK-3476 > Project: Spark > Issue Type: Bug > Components: YARN > Affects Versions: 1.2.0 > Reporter: Thomas Graves > > The yarn ClientBase.validateArgs memory checks are no longer valid. It used > to be that the overhead was taken out of what the user specified, now we add > it on top of what the user specifies. We can probably just remove these. > (args.amMemory <= memoryOverhead) -> ("Error: AM memory size must be" + > "greater than: " + memoryOverhead), > (args.executorMemory <= memoryOverhead) -> ("Error: Executor memory > size" + > "must be greater than: " + memoryOverhead.toString) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org