[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253895#comment-16253895
]
Andras Piros commented on OOZIE-2973:
-------------------------------------
Following {{hadoop-common}} transitive dependencies are for
{{oozie-sharelib-pig}}:
{noformat}
org.apache.hadoop:hadoop-minicluster:jar:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-common:test-jar:tests:3.0.0-beta1:test
| +- javax.servlet:javax.servlet-api:jar:3.1.0:test
| +- org.eclipse.jetty:jetty-server:jar:9.3.19.v20170502:test
| | +- org.eclipse.jetty:jetty-http:jar:9.3.19.v20170502:test
| | \- org.eclipse.jetty:jetty-io:jar:9.3.19.v20170502:test
| +- org.eclipse.jetty:jetty-util:jar:9.3.19.v20170502:test
| +- com.sun.jersey:jersey-core:jar:1.19:test
| | \- javax.ws.rs:jsr311-api:jar:1.1.1:test
| +- com.sun.jersey:jersey-json:jar:1.19:test
| | +- org.codehaus.jettison:jettison:jar:1.1:test
| | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:test
| | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.2:test
| | \- org.codehaus.jackson:jackson-xc:jar:1.9.2:test
| +- com.sun.jersey:jersey-server:jar:1.19:test
| +- org.slf4j:slf4j-log4j12:jar:1.6.6:test (version managed from 1.7.25)
| +- com.jcraft:jsch:jar:0.1.54:test
| \- org.apache.zookeeper:zookeeper:jar:3.4.9:test
| \- jline:jline:jar:0.9.94:test
+- org.apache.hadoop:hadoop-hdfs:test-jar:tests:3.0.0-beta1:test
| +- org.eclipse.jetty:jetty-util-ajax:jar:9.3.19.v20170502:test
| +- commons-daemon:commons-daemon:jar:1.0.13:test
| +- io.netty:netty:jar:3.10.5.Final:test
| +- io.netty:netty-all:jar:4.0.23.Final:test
| \- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:test
+- org.apache.hadoop:hadoop-yarn-server-tests:test-jar:tests:3.0.0-beta1:test
| +- org.apache.hadoop:hadoop-yarn-server-common:jar:3.0.0-beta1:test
| | +- org.apache.geronimo.specs:geronimo-jcache_1.0_spec:jar:1.0-alpha-1:test
| | +- org.ehcache:ehcache:jar:3.3.1:test
| | +- com.zaxxer:HikariCP-java7:jar:2.4.12:test
| | \- com.microsoft.sqlserver:mssql-jdbc:jar:6.2.1.jre7:test
| +- org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:3.0.0-beta1:test
| | +- org.apache.hadoop:hadoop-yarn-registry:jar:3.0.0-beta1:test
| | +- com.codahale.metrics:metrics-core:jar:3.0.1:test
| | +- com.google.inject:guice:jar:3.0:test
| | | +- javax.inject:javax.inject:jar:1:test
| | | \- aopalliance:aopalliance:jar:1.0:test
| | \- com.sun.jersey.contribs:jersey-guice:jar:1.19:test
| +- org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:3.0.0-beta1:test
| | \-
org.apache.hadoop:hadoop-yarn-server-applicationhistoryservice:jar:3.0.0-beta1:test
| | \- de.ruedigermoeller:fst:jar:2.50:test
| | \- com.cedarsoftware:java-util:jar:1.9.0:test
| | \- com.cedarsoftware:json-io:jar:2.5.1:test
| \- org.apache.hadoop:hadoop-yarn-server-timelineservice:jar:3.0.0-beta1:test
| \- org.apache.commons:commons-csv:jar:1.0:test
+-
org.apache.hadoop:hadoop-mapreduce-client-jobclient:test-jar:tests:3.0.0-beta1:test
| \- com.google.inject.extensions:guice-servlet:jar:4.0:test
+- org.apache.hadoop:hadoop-hdfs:jar:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.0.0-beta1:test
| +- org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-beta1:test
\- org.apache.hadoop:hadoop-mapreduce-client-hs:jar:3.0.0-beta1:test
{noformat}
But for {{oozie-core}} we have way less transitive dependencies on
{{hadoop-common}}:
{noformat}
org.apache.hadoop:hadoop-minicluster:jar:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-common:test-jar:tests:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-hdfs:test-jar:tests:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-yarn-server-tests:test-jar:tests:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:3.0.0-beta1:test
| +- org.apache.hadoop:hadoop-yarn-registry:jar:3.0.0-beta1:test
| \- com.codahale.metrics:metrics-core:jar:3.0.1:test
+-
org.apache.hadoop:hadoop-mapreduce-client-jobclient:test-jar:tests:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-beta1:test
\- org.apache.hadoop:hadoop-mapreduce-client-hs:jar:3.0.0-beta1:test
{noformat}
> Make sure Oozie works with Hadoop 3
> ------------------------------------
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
> Reporter: Attila Sasvari
> Assignee: Peter Cseh
> Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-2973.001.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
