[ 
https://issues.apache.org/jira/browse/HADOOP-19835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18064108#comment-18064108
 ] 

ASF GitHub Bot commented on HADOOP-19835:
-----------------------------------------

lewismc opened a new pull request, #8331:
URL: https://github.com/apache/hadoop/pull/8331

   ### Description of PR
   See [HADOOP-19835](https://issues.apache.org/jira/browse/HADOOP-19835)
   
   ### How was this patch tested?
   Tested with Hadoop 3.4.3 and Celeborn 0.6.2 and Nutch 1.23-SNAPSHOT. Nutch 
MapReduce smoke tests were run.
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   ### AI Tooling
   
   If an AI tool was used:
   
   - [ ] The PR includes the phrase "Contains content generated by <tool>"
         where <tool> is the name of the AI tool used.
   - [ ] My use of AI contributions follows the ASF legal policy
         https://www.apache.org/legal/generative-tooling.html




> Make MapReduce Application Master class configurable in YARNRunner
> ------------------------------------------------------------------
>
>                 Key: HADOOP-19835
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19835
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 3.4.3
>            Reporter: Lewis John McGibbney
>            Priority: Minor
>              Labels: patch, pull-request-available
>             Fix For: 3.4.4
>
>
> YARNRunner currently always uses {{MRJobConfig.APPLICATION_MASTER_CLASS}} 
> when building the command to start the Application Master, and does not read 
> {{{}yarn.app.mapreduce.am{}}}. As a result, custom AM classes (e.g. 
> Celeborn’s {{{}MRAppMasterWithCeleborn{}}}) are never used when submitting 
> jobs via the standard job client.
> This patch changes YARNRunner to take the AM class from configuration: it 
> uses {{jobConf.get("yarn.app.mapreduce.am", 
> MRJobConfig.APPLICATION_MASTER_CLASS)}} and passes that value into the launch 
> arguments. If {{yarn.app.mapreduce.am}} is set, that class is used; otherwise 
> behavior is unchanged (default AM class). This allows remote shuffle and 
> other custom AMs to be used without forking the job client.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to