[
https://issues.apache.org/jira/browse/MAPREDUCE-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheng Pan reassigned MAPREDUCE-7538:
------------------------------------
Component/s: (was: mapreduce)
Key: MAPREDUCE-7538 (was: HADOOP-19835)
Target Version/s: (was: 3.4.4)
Affects Version/s: 3.4.3
(was: 3.4.3)
Assignee: (was: Lewis John McGibbney)
Issue Type: New Feature (was: Bug)
Project: Hadoop Map/Reduce (was: Hadoop Common)
> Make MapReduce Application Master class configurable in YARNRunner
> ------------------------------------------------------------------
>
> Key: MAPREDUCE-7538
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7538
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Affects Versions: 3.4.3
> Reporter: Lewis John McGibbney
> Priority: Minor
> Labels: patch, pull-request-available
>
> YARNRunner currently always uses {{MRJobConfig.APPLICATION_MASTER_CLASS}}
> when building the command to start the Application Master, and does not read
> {{{}yarn.app.mapreduce.am{}}}. As a result, custom AM classes (e.g.
> Celeborn’s {{{}MRAppMasterWithCeleborn{}}}) are never used when submitting
> jobs via the standard job client.
> This patch changes YARNRunner to take the AM class from configuration: it
> uses {{jobConf.get("yarn.app.mapreduce.am",
> MRJobConfig.APPLICATION_MASTER_CLASS)}} and passes that value into the launch
> arguments. If {{yarn.app.mapreduce.am}} is set, that class is used; otherwise
> behavior is unchanged (default AM class). This allows remote shuffle and
> other custom AMs to be used without forking the job client.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
