[ https://issues.apache.org/jira/browse/SPARK-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147180#comment-14147180 ]
Apache Spark commented on SPARK-3476: ------------------------------------- User 'andrewor14' has created a pull request for this issue: https://github.com/apache/spark/pull/2528 > Yarn ClientBase.validateArgs memory checks wrong > ------------------------------------------------ > > Key: SPARK-3476 > URL: https://issues.apache.org/jira/browse/SPARK-3476 > Project: Spark > Issue Type: Bug > Components: YARN > Affects Versions: 1.2.0 > Reporter: Thomas Graves > > The yarn ClientBase.validateArgs memory checks are no longer valid. It used > to be that the overhead was taken out of what the user specified, now we add > it on top of what the user specifies. We can probably just remove these. > (args.amMemory <= memoryOverhead) -> ("Error: AM memory size must be" + > "greater than: " + memoryOverhead), > (args.executorMemory <= memoryOverhead) -> ("Error: Executor memory > size" + > "must be greater than: " + memoryOverhead.toString) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org