[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marcelo Vanzin resolved SPARK-27959. ------------------------------------ Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24989 [https://github.com/apache/spark/pull/24989] > Change YARN resource configs to use .amount > ------------------------------------------- > > Key: SPARK-27959 > URL: https://issues.apache.org/jira/browse/SPARK-27959 > Project: Spark > Issue Type: Story > Components: YARN > Affects Versions: 3.0.0 > Reporter: Thomas Graves > Assignee: Thomas Graves > Priority: Major > Fix For: 3.0.0 > > > we are adding in generic resource support into spark where we have suffix for > the amount of the resource so that we could support other configs. > Spark on yarn already had added configs to request resources via the configs > spark.yarn.\{executor/driver/am}.resource=<some amount>, where the <some > amont> is value and unit together. We should change those configs to have a > .amount suffix on them to match the spark configs and to allow future configs > to be more easily added. YARN itself already supports tags and attributes so > if we want the user to be able to pass those from spark at some point having > a suffix makes sense. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org