Thomas Graves created SPARK-27959:
-------------------------------------

             Summary: Change YARN resource configs to use .amount
                 Key: SPARK-27959
                 URL: https://issues.apache.org/jira/browse/SPARK-27959
             Project: Spark
          Issue Type: Story
          Components: YARN
    Affects Versions: 3.0.0
            Reporter: Thomas Graves


we are adding in generic resource support into spark where we have suffix for 
the amount of the resource so that we could support other configs. 

Spark on yarn already had added configs to request resources via the configs 
spark.yarn.\{executor/driver/am}.resource=<some amount>, where the <some amont> 
is value and unit together.  We should change those configs to have a .amount 
suffix on them to match the spark configs and to allow future configs to be 
more easily added. YARN itself already supports tags and attributes so if we 
want the user to be able to pass those from spark at some point having a suffix 
makes sense.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to