[
https://issues.apache.org/jira/browse/MAPREDUCE-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435553#comment-13435553
]
Alejandro Abdelnur commented on MAPREDUCE-4421:
-----------------------------------------------
Let me explain in more detail what I was thinking (along the lines of Oozie's
sharelib for actions):
*1* OPS maintains a {{/user/am/share/lib/}} directory under this directory you
have a sub-directory for each AM, ie: {{mapred}}, {{distributedshell}}
*2* {{yarn-site.xml}} (or an {{am-site.xml}}) defines the following properties:
{code}
yarn.am.lib=/user/am/share/lib
mapred.am.lib=${yarn.am.lib}/mapred
distributedshell.am.lib=${yarn.am.lib}/distributedshell
{code}
*3* AM client injects to the configuration, via DistributedCache, all the JARs
in the directory of the corresponding {{####.am.lib}} property.
Note that this mechanism allows to support multiple versions of AMs, to OPs to
define the default version, to even fix it with final, and to users to use
alternate ones.
> Remove dependency on deployed MR jars
> -------------------------------------
>
> Key: MAPREDUCE-4421
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4421
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Affects Versions: 2.0.0-alpha
> Reporter: Arun C Murthy
> Assignee: Arun C Murthy
>
> Currently MR AM depends on MR jars being deployed on all nodes via implicit
> dependency on YARN_APPLICATION_CLASSPATH.
> We should stop adding mapreduce jars to YARN_APPLICATION_CLASSPATH and,
> probably, just rely on adding a shaded MR jar along with job.jar to the
> dist-cache.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
