[
https://issues.apache.org/jira/browse/TEZ-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065825#comment-14065825
]
Hitesh Shah edited comment on TEZ-1295 at 7/18/14 12:32 AM:
------------------------------------------------------------
Looking at the generated tarball:
- /tests/ is present and contains tez-tests test jar.
As for lib, it contains:
{code}
aopalliance-1.0.jar commons-math3-3.1.1.jar
httpclient-4.2.5.jar jsr305-2.0.3.jar
asm-3.1.jar commons-net-3.1.jar
httpcore-4.2.4.jar log4j-1.2.17.jar
avro-1.7.4.jar guava-11.0.2.jar
jackson-core-asl-1.8.8.jar netty-3.6.2.Final.jar
commons-beanutils-1.7.0.jar guice-3.0.jar
jackson-jaxrs-1.8.3.jar paranamer-2.3.jar
commons-beanutils-core-1.8.0.jar guice-servlet-3.0.jar
jackson-mapper-asl-1.8.8.jar protobuf-java-2.5.0.jar
commons-cli-1.2.jar hadoop-annotations-2.4.0.jar
jackson-xc-1.8.3.jar servlet-api-2.5.jar
commons-codec-1.4.jar hadoop-auth-2.4.0.jar
javax.inject-1.jar slf4j-api-1.7.5.jar
commons-collections-3.2.1.jar hadoop-common-2.4.0.jar
jaxb-impl-2.2.3-1.jar slf4j-log4j12-1.7.5.jar
commons-collections4-4.0.jar hadoop-hdfs-2.4.0.jar
jersey-client-1.9.jar snappy-java-1.0.4.1.jar
commons-compress-1.4.1.jar
hadoop-mapreduce-client-common-2.4.0.jar jersey-core-1.9.jar
stax-api-1.0.1.jar
commons-configuration-1.6.jar
hadoop-mapreduce-client-core-2.4.0.jar jersey-guice-1.9.jar
xmlenc-0.52.jar
commons-digester-1.8.jar
hadoop-mapreduce-client-jobclient-2.4.0.jar jersey-json-1.9.jar
xz-1.0.jar
commons-io-2.4.jar hadoop-yarn-api-2.4.0.jar
jersey-server-1.9.jar zookeeper-3.4.5.jar
commons-lang-2.6.jar hadoop-yarn-client-2.4.0.jar
jettison-1.3.4.jar
commons-logging-1.1.3.jar hadoop-yarn-common-2.4.0.jar
jetty-util-6.1.26.jar
{code}
The above seems fine for the most part. jackson seems to be a mix of 1.8.3 and
1.8.8. Did you try running the full tarball ( compiled against 2.4.0 ) deployed
on a 2.5.0 cluster?
Patch looks fine except for the tests directory ( is it still present due to
MiniTezCluster ? ) and the unrelated change in
tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/security/SecureShuffleUtils.java.
was (Author: hitesh):
Looking at the generated tarball:
- /tests/ is present and contains tez-tests test jar.
As for lib, it contains:
{code}
aopalliance-1.0.jar commons-math3-3.1.1.jar
httpclient-4.2.5.jar jsr305-2.0.3.jar
asm-3.1.jar commons-net-3.1.jar
httpcore-4.2.4.jar log4j-1.2.17.jar
avro-1.7.4.jar guava-11.0.2.jar
jackson-core-asl-1.8.8.jar netty-3.6.2.Final.jar
commons-beanutils-1.7.0.jar guice-3.0.jar
jackson-jaxrs-1.8.3.jar paranamer-2.3.jar
commons-beanutils-core-1.8.0.jar guice-servlet-3.0.jar
jackson-mapper-asl-1.8.8.jar protobuf-java-2.5.0.jar
commons-cli-1.2.jar hadoop-annotations-2.4.0.jar
jackson-xc-1.8.3.jar servlet-api-2.5.jar
commons-codec-1.4.jar hadoop-auth-2.4.0.jar
javax.inject-1.jar slf4j-api-1.7.5.jar
commons-collections-3.2.1.jar hadoop-common-2.4.0.jar
jaxb-impl-2.2.3-1.jar slf4j-log4j12-1.7.5.jar
commons-collections4-4.0.jar hadoop-hdfs-2.4.0.jar
jersey-client-1.9.jar snappy-java-1.0.4.1.jar
commons-compress-1.4.1.jar
hadoop-mapreduce-client-common-2.4.0.jar jersey-core-1.9.jar
stax-api-1.0.1.jar
commons-configuration-1.6.jar
hadoop-mapreduce-client-core-2.4.0.jar jersey-guice-1.9.jar
xmlenc-0.52.jar
commons-digester-1.8.jar
hadoop-mapreduce-client-jobclient-2.4.0.jar jersey-json-1.9.jar
xz-1.0.jar
commons-io-2.4.jar hadoop-yarn-api-2.4.0.jar
jersey-server-1.9.jar zookeeper-3.4.5.jar
commons-lang-2.6.jar hadoop-yarn-client-2.4.0.jar
jettison-1.3.4.jar
commons-logging-1.1.3.jar hadoop-yarn-common-2.4.0.jar
jetty-util-6.1.26.jar
{code}
The above seems fine for the most part. jackson seems to be a mix of 1.8.3 and
1.8.8. Did you try running the full tarball ( compiled against 2.4.0 ) deployed
on a 2.5.0 cluster?
Patch looks fine except for the unrelated change in
tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/security/SecureShuffleUtils.java.
> Create a build target containing hadoop libraries
> -------------------------------------------------
>
> Key: TEZ-1295
> URL: https://issues.apache.org/jira/browse/TEZ-1295
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-1295.1.txt
>
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)
