[
https://issues.apache.org/jira/browse/TEZ-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072447#comment-14072447
]
Hitesh Shah commented on TEZ-1300:
----------------------------------
Comments:
- website should have the install page updated
- please rename the current install page to a 0.4 specific install page
for users downloading the 0.4.x release
- tez.use.cluster.hadoop-libs - this should not be needed to be set for the
recommended install approach.
- Not sure as to why the partial approach does not use a tarball?
- After this patch, why do we still need to support a partial install? Also,
does the partial install continue to have the mapreduce jars that are needed
directly by Tez?
{code}
+5) set HADOOP_CLASSPATH to have the following paths in it:
- TEZ_CONF_DIR - location of tez-site.xml
- TEZ_JARS and TEZ_JARS/libs - location of the tez jars and dependencies.
- The command to set up the classpath should be something like:
"export HADOOP_CLASSPATH=${TEZ_CONF_DIR}:${TEZ_JARS}/*:${TEZ_JARS}/lib/*".
- Please note the "*" which is an important requirement when setting up
classpaths for directories container jar files.
{code}
- how will this work for a full tarball as this will create a mix of hadoop
jars ( some from the hadoop install and some from the tez install)
{code}
+ // KKK Check what this does if the specified entity is a file instead of
a directory
{code}
- is this to be addressed in a follow up jira?
{code}
+ if (!uri.isAbsolute()) {
+ String message = "Non-absolute URI defined in configuration for"
+ + " location of TEZ jars. providedURI=" + fileName;
+ LOG.error(message);
+ throw new TezUncheckedException(message);
+ }
{code}
- should this leverage the default fs if not absolute?
- public static String getFrameworkClasspath - shouldn't the tez jars be at
the front of the classpath i.e before PWD.
- TezConfiguration.TEZ_USE_CLUSTER_HADOOP_LIBS - does this make sense if the
full tarball is used?
- javadocs in TezConf mention tez but code seems to be using tezlib
> Change default tez classpath to not include hadoop jars from the cluster
> ------------------------------------------------------------------------
>
> Key: TEZ-1300
> URL: https://issues.apache.org/jira/browse/TEZ-1300
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-1300.1.txt
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
