[
https://issues.apache.org/jira/browse/MAPREDUCE-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gera Shegalov updated MAPREDUCE-5813:
-------------------------------------
Attachment: MAPREDUCE-5813.v02.patch
Thanks for catching this, [~sjlee0]. This makes sure that Limits and UGI are
also properly configured.
Adding v02.patch with a unit test.
> YarnChild does not load job.xml with mapreduce.job.classloader=true
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-5813
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5813
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, task
> Affects Versions: 2.3.0
> Reporter: Gera Shegalov
> Assignee: Gera Shegalov
> Priority: Blocker
> Attachments: MAPREDUCE-5813.v01.patch, MAPREDUCE-5813.v02.patch
>
>
> {{YarnChild.main}} uses {{JobConf.addResource(String)}} to load {{job.xml}}
> that relies on class loading. When {{mapreduce.job.classloader=true}} the
> job-speicific part of the class path is separated from {{CLASSPATH}} into
> {{APP_CLASSPATH}}. Therefore {{job.xml}} is inaccessible for the default
> class loader. Later {{writeLocalJobFile}} overwrites the correct localized
> {{job.xml}} on disk as well.
> This problem is easily avoided by using {{JobConf.addResource(Path)}} to
> read the localized {{job.xml}} without relying on class loading.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
