Thomas Graves created SPARK-3476: ------------------------------------ Summary: Yarn ClientBase.validateArgs memory checks wrong Key: SPARK-3476 URL: https://issues.apache.org/jira/browse/SPARK-3476 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.2.0 Reporter: Thomas Graves
The yarn ClientBase.validateArgs memory checks are no longer valid. It used to be that the overhead was taken out of what the user specified, now we add it on top of what the user specifies. We can probably just remove these. (args.amMemory <= memoryOverhead) -> ("Error: AM memory size must be" + "greater than: " + memoryOverhead), (args.executorMemory <= memoryOverhead) -> ("Error: Executor memory size" + "must be greater than: " + memoryOverhead.toString) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org