[
https://issues.apache.org/jira/browse/HDFS-6200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350995#comment-14350995
]
Haohui Mai commented on HDFS-6200:
----------------------------------
Here is the list of dependency when I run {{mvn dependency:tree}} in
{{hadoop-hdfs}}:
{noformat}
$ mvn dependency:tree|grep -v ":test"
...
[INFO] --- maven-dependency-plugin:2.2:tree (default-cli) @ hadoop-hdfs ---
[INFO] org.apache.hadoop:hadoop-hdfs:jar:3.0.0-SNAPSHOT
[INFO] +- org.apache.hadoop:hadoop-annotations:jar:3.0.0-SNAPSHOT:provided
[INFO] | \- jdk.tools:jdk.tools:jar:1.8:system
[INFO] +- org.apache.hadoop:hadoop-auth:jar:3.0.0-SNAPSHOT:provided
[INFO] | +- org.slf4j:slf4j-api:jar:1.7.10:provided
[INFO] | +- org.apache.httpcomponents:httpclient:jar:4.2.5:provided
[INFO] | | \- org.apache.httpcomponents:httpcore:jar:4.2.5:provided (version
managed from 4.2.4)
[INFO] | +-
org.apache.directory.server:apacheds-kerberos-codec:jar:2.0.0-M15:provided
[INFO] | | +- org.apache.directory.server:apacheds-i18n:jar:2.0.0-M15:provided
[INFO] | | +- org.apache.directory.api:api-asn1-api:jar:1.0.0-M20:provided
[INFO] | | \- org.apache.directory.api:api-util:jar:1.0.0-M20:provided
[INFO] | +- org.apache.zookeeper:zookeeper:jar:3.4.6:provided
[INFO] | \- org.apache.curator:curator-framework:jar:2.7.1:provided
[INFO] +- org.apache.hadoop:hadoop-common:jar:3.0.0-SNAPSHOT:provided
[INFO] | +- org.apache.commons:commons-math3:jar:3.1.1:provided
[INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:provided
[INFO] | +- commons-net:commons-net:jar:3.1:provided
[INFO] | +- commons-collections:commons-collections:jar:3.2.1:provided
[INFO] | +- javax.servlet.jsp:jsp-api:jar:2.1:provided
[INFO] | +- com.sun.jersey:jersey-json:jar:1.9:provided
[INFO] | | +- org.codehaus.jettison:jettison:jar:1.1:provided
[INFO] | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:provided
[INFO] | | | \- javax.xml.bind:jaxb-api:jar:2.2.2:provided
[INFO] | | | +- javax.xml.stream:stax-api:jar:1.0-2:provided
[INFO] | | | \- javax.activation:activation:jar:1.1:provided
[INFO] | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.13:provided (version
managed from 1.8.3)
[INFO] | | \- org.codehaus.jackson:jackson-xc:jar:1.9.13:provided (version
managed from 1.8.3)
[INFO] | +- net.java.dev.jets3t:jets3t:jar:0.9.0:provided
[INFO] | | \- com.jamesmurty.utils:java-xmlbuilder:jar:0.4:provided
[INFO] | +- commons-configuration:commons-configuration:jar:1.6:provided
[INFO] | | +- commons-digester:commons-digester:jar:1.8:provided
[INFO] | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:provided
[INFO] | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:provided
[INFO] | +- org.apache.avro:avro:jar:1.7.4:provided
[INFO] | | +- com.thoughtworks.paranamer:paranamer:jar:2.3:provided
[INFO] | | \- org.xerial.snappy:snappy-java:jar:1.0.4.1:provided
[INFO] | +- com.google.code.gson:gson:jar:2.2.4:provided
[INFO] | +- com.jcraft:jsch:jar:0.1.42:provided
[INFO] | +- org.apache.curator:curator-client:jar:2.7.1:provided
[INFO] | +- org.apache.curator:curator-recipes:jar:2.7.1:provided
[INFO] | \- org.apache.commons:commons-compress:jar:1.4.1:provided
[INFO] | \- org.tukaani:xz:jar:1.0:provided
[INFO] +- com.google.guava:guava:jar:11.0.2:compile
[INFO] | \- com.google.code.findbugs:jsr305:jar:3.0.0:compile
[INFO] +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] +- com.sun.jersey:jersey-core:jar:1.9:compile
[INFO] +- com.sun.jersey:jersey-server:jar:1.9:compile
[INFO] | \- asm:asm:jar:3.2:compile (version managed from 3.1)
[INFO] +- commons-cli:commons-cli:jar:1.2:compile
[INFO] +- commons-codec:commons-codec:jar:1.4:compile
[INFO] +- commons-io:commons-io:jar:2.4:compile
[INFO] +- commons-lang:commons-lang:jar:2.6:compile
[INFO] +- commons-logging:commons-logging:jar:1.1.3:compile
[INFO] +- commons-daemon:commons-daemon:jar:1.0.13:compile
[INFO] +- log4j:log4j:jar:1.2.17:compile
[INFO] +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] +- javax.servlet:servlet-api:jar:2.5:compile
[INFO] +- org.slf4j:slf4j-log4j12:jar:1.7.10:provided
[INFO] +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile
[INFO] +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile
[INFO] +- xmlenc:xmlenc:jar:0.52:compile
[INFO] +- io.netty:netty-all:jar:4.0.23.Final:compile
[INFO] +- xerces:xercesImpl:jar:2.9.1:compile
[INFO] | \- xml-apis:xml-apis:jar:1.3.04:compile
[INFO] +- org.apache.htrace:htrace-core:jar:3.1.0-incubating:compile
[INFO] +- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:compile
{noformat}
As I mentioned earlier I plan to keep the dependency of {{hadoop-common}} /
{{hadoop-auth}} for the first phase, which would allow us to get rid of the
following dependency in the client jar:
{noformat}
[INFO] +- com.google.guava:guava:jar:11.0.2:compile
[INFO] | \- com.google.code.findbugs:jsr305:jar:3.0.0:compile
[INFO] +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile
[INFO] +- com.sun.jersey:jersey-core:jar:1.9:compile
[INFO] +- com.sun.jersey:jersey-server:jar:1.9:compile
[INFO] | \- asm:asm:jar:3.2:compile (version managed from 3.1)
[INFO] +- commons-cli:commons-cli:jar:1.2:compile
[INFO] +- commons-codec:commons-codec:jar:1.4:compile
[INFO] +- commons-io:commons-io:jar:2.4:compile
[INFO] +- commons-lang:commons-lang:jar:2.6:compile
[INFO] +- commons-logging:commons-logging:jar:1.1.3:compile
[INFO] +- commons-daemon:commons-daemon:jar:1.0.13:compile
[INFO] +- log4j:log4j:jar:1.2.17:compile
[INFO] +- com.google.protobuf:protobuf-java:jar:2.5.0:compile
[INFO] +- javax.servlet:servlet-api:jar:2.5:compile
[INFO] +- xmlenc:xmlenc:jar:0.52:compile
[INFO] +- io.netty:netty-all:jar:4.0.23.Final:compile
[INFO] +- xerces:xercesImpl:jar:2.9.1:compile
[INFO] | \- xml-apis:xml-apis:jar:1.3.04:compile
[INFO] +- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:compile
{noformat}
These dependency will be kept in addition to {{hadoop-common}} and
{{hadoop-auth}}:
{noformat}
[INFO] +- org.slf4j:slf4j-log4j12:jar:1.7.10:provided -- (for logging)
[INFO] +- org.codehaus.jackson:jackson-core-asl:jar:1.9.13:compile (parsing
JSON for webhdfs)
[INFO] +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13:compile (might not
be needed for parsing JSON for webhdfs, need to double check)
[INFO] +- org.apache.htrace:htrace-core:jar:3.1.0-incubating:compile (for
htrace in DFSClient)
{noformat}
> Create a separate jar for hdfs-client
> -------------------------------------
>
> Key: HDFS-6200
> URL: https://issues.apache.org/jira/browse/HDFS-6200
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Haohui Mai
> Assignee: Haohui Mai
> Attachments: HDFS-6200.000.patch, HDFS-6200.001.patch,
> HDFS-6200.002.patch, HDFS-6200.003.patch, HDFS-6200.004.patch,
> HDFS-6200.005.patch, HDFS-6200.006.patch, HDFS-6200.007.patch
>
>
> Currently the hadoop-hdfs jar contain both the hdfs server and the hdfs
> client. As discussed in the hdfs-dev mailing list
> (http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201404.mbox/browser),
> downstream projects are forced to bring in additional dependency in order to
> access hdfs. The additional dependency sometimes can be difficult to manage
> for projects like Apache Falcon and Apache Oozie.
> This jira proposes to create a new project, hadoop-hdfs-cliient, which
> contains the client side of the hdfs code. Downstream projects can use this
> jar instead of the hadoop-hdfs to avoid unnecessary dependency.
> Note that it does not break the compatibility of downstream projects. This is
> because old downstream projects implicitly depend on hadoop-hdfs-client
> through the hadoop-hdfs jar.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
