Thomas Graves created SPARK-3476:
------------------------------------
Summary: Yarn ClientBase.validateArgs memory checks wrong
Key: SPARK-3476
URL: https://issues.apache.org/jira/browse/SPARK-3476
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.2.0
Reporter: Thomas Graves
The yarn ClientBase.validateArgs memory checks are no longer valid. It used
to be that the overhead was taken out of what the user specified, now we add it
on top of what the user specifies. We can probably just remove these.
(args.amMemory <= memoryOverhead) -> ("Error: AM memory size must be" +
"greater than: " + memoryOverhead),
(args.executorMemory <= memoryOverhead) -> ("Error: Executor memory size"
+
"must be greater than: " + memoryOverhead.toString)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
