[
https://issues.apache.org/jira/browse/TEZ-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-3390:
---------------------------------
Attachment: TEZ-3390.2.patch
Posting a patch that allows a shaded uber-jar of the tez shuffle handler. One
thing that had to be done to allow this to work properly was to keep the hadoop
dependencies as provide and not include them in the uber-jar at this point. The
container manager AuxServices requires shuffle handlers to extend
AuxiliaryService which can't be relocated. Opted to mark this dependency as
provided to prevent this interaction so as to not pollute the node manager
classpath.
> Packaging Shuffle Handler as an uber-jar
> ----------------------------------------
>
> Key: TEZ-3390
> URL: https://issues.apache.org/jira/browse/TEZ-3390
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Attachments: TEZ-3390.1.patch, TEZ-3390.2.patch
>
>
> This jira aims to isolate the shuffle handler dependencies from the yarn
> dependencies of the nodemanager by packaging the shaded dependencies in an
> uber jar.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
