[
https://issues.apache.org/jira/browse/TEZ-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390208#comment-15390208
]
Siddharth Seth commented on TEZ-3338:
-------------------------------------
I think it's sufficient to define a system classpath - so $PWD/tezlib/* becomes
this. Other parts of the classpath would be user specific, or is there a reason
to define userclasspath to be a single location?
bq. Is there a "uber" mode in tez (like MR) where the user tasks can run
in-process in the AM? What would be the place to look at for the uber mode?
Thanks in advance.
There is; but it isn't officially supported yet (there's no single flag to
enable uber, and this hasn't been extensively tested). To do this - external
plugins need to be used (TEZ-2003). As an example - you can look at the usage
of TestExternalTezService.EXECUTION_CONTEXT_IN_AM. Also LocalContainerLauncher.
A local mode is supported - similar to MR, where the entire dag runs in process
along with the AM.
> Support classloader isolation
> -----------------------------
>
> Key: TEZ-3338
> URL: https://issues.apache.org/jira/browse/TEZ-3338
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ming Ma
>
> HADOOP-10893 and MAPREDUCE-1700 provide classloader isolation at both client
> side and container side for MR. We should add the same support for Tez. Given
> we use hadoop command to launch Tez, it appears the client side has been
> taken care of. Only the container side support is needed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
