[
https://issues.apache.org/jira/browse/TEZ-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-1300:
--------------------------------
Attachment: TEZ-1300.1.txt
First version of the patch.
Makes the following changes.
--- tez.lib.uris semantics changed
--Specifying a single .tar.gz or .tgz assumes that a compressed version of the
tez libs is being used. This is uncompressed into a tezlibs directory when
running containers, and tezlibs/*;tezlibs/lib/* are added to the classpath
(after . and .*)
--If multiple files are specified - files are localized as regular files,
contents of directories are localized as regular files (non-recursive).
--- When building tez
-- There's one less directory in the dist builds. e.g.
tez-dist-0.5.0-incubating/tez-dist-0.5.0-SNAPSHOT/* is now
tez-dist-0.5.0-SNAPSHOT/*
-- One additional target - tez-archive-0.5.0-SNAPSHOT.tar.gz is always built,
which is a full build of tez - including hadoop libs
-- tez-dist-full removed.
-- tez-dist is now a full set of jars including hadoop
-- tez-dist-partial is a new taget build which does not include hadoop libs
-- Some minor fixes in prewarm environment setup
-- Changes the FileSystem API used to get file info to not pull block locations.
-- INSTALL notes updated. I'm guessing I need to change this elsewhere as well.
Will find other references and update in another revision of the patch.
[~hitesh] - review please
One more change which I'm likely to make in an updated patch - rename tez-dist
to tez-dist-withHadoopLibs, and tez-dist-partial to tez-dist-withoutHadoopLibs
Rename to "withHadoopLibs" / "withoutHadoopLibs".
> Change default tez classpath to not include hadoop jars from the cluster
> ------------------------------------------------------------------------
>
> Key: TEZ-1300
> URL: https://issues.apache.org/jira/browse/TEZ-1300
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-1300.1.txt
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
