Instead of exclusion, would it be better to use the version in the cloudera
repo?
Please do consider contributing these changes back to Zeppelin source. Thanks!
_____________________________
From: Ruslan Dautkhanov <dautkha...@gmail.com>
Sent: Monday, December 11, 2017 3:42 PM
Subject: Re: zeppelin build fails with DependencyConvergence error
To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
Looks like master branch of Zeppelin still has compatibility issue with
Cloudera dependencies.
When built using
mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
-Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
maven fails on jackson convergence error - see below email for more details.
Looks like there was a change in Zeppelin that upgraded Jackson's version?
So now it conflicts with older jackson library as referenced by cloudera repo.
workaround: Zeppelin builds fine with pom change [1] - the question is now
would somebody expect Zeppelin would still be functioning correctly with these
exclusions?
[1]
--- a/zeppelin-zengine/pom.xml
+++ b/zeppelin-zengine/pom.xml
@@ -364,6 +364,30 @@
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
</exclusion>
+ <exclusion>
+ <groupId>com.fasterxml.jackson.core</groupId>
+ <artifactId>jackson-core</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>com.fasterxml.jackson.core</groupId>
+ <artifactId>jackson-annotations</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>com.fasterxml.jackson.core</groupId>
+ <artifactId>jackson-databind</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-core-asl</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.apache.zookeeper</groupId>
+ <artifactId>zookeeper</artifactId>
+ </exclusion>
</exclusions>
</dependency>
On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov
<dautkha...@gmail.com<mailto:dautkha...@gmail.com>> wrote:
Building from a current Zeppelin snapshot fails with
zeppelin build fails with
org.apache.maven.plugins.enforcer.DependencyConvergence
see details below.
Build command
/opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
-Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
-Psparkr -pl '!..excluded certain modules..' -e
maven 3.5.0
jdk 1.8.0_141
RHEL 7.3
npm.x86_64 1:3.10.10-1.6.11.1.1.el7
nodejs.x86_64 1:6.11.1-1.el7 @epel
latest zeppelin snapshot
Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen this
problem before.
Thanks,
Ruslan
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin
com.googlecode.maven-download-plugin:download-maven-plugin @ line 940, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin
com.googlecode.maven-download-plugin:download-maven-plugin @ line 997, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin org.scala-tools:maven-scala-plugin @ line 467,
column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
@ line 475, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin
@ line 486, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin org.scala-tools:maven-scala-plugin @ line 496,
column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found
duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
@ line 504, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten
the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support
building such malformed projects.
[WARNING]
[WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses
prerequisites which is only intended for maven-plugin projects but not for non
maven-plugin projects. For such purposes you should use the
maven-enforcer-plugin. See
https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html
... [skip]
[INFO] ------------------------------------------------------------------------
[INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ zeppelin-zengine ---
[INFO]
[INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ zeppelin-zengine
---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
zeppelin-zengine ---
[INFO]
[INFO]
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @
zeppelin-zengine ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 17 resources
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ zeppelin-zengine ---
[WARNING]
Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3
paths to dependency are:
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-com.amazonaws:aws-java-sdk-s3:1.10.62
+-com.amazonaws:aws-java-sdk-core:1.10.62
+-com.fasterxml.jackson.core:jackson-databind:2.5.3
+-com.fasterxml.jackson.core:jackson-core:2.5.3
and
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
+-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
+-com.fasterxml.jackson.core:jackson-core:2.2.3
[WARNING]
Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13
paths to dependency are:
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-com.github.eirslett:frontend-maven-plugin:1.3
+-com.github.eirslett:frontend-plugin-core:1.3
+-org.codehaus.jackson:jackson-mapper-asl:1.9.13
and
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
+-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
+-org.codehaus.jackson:jackson-mapper-asl:1.8.8
and
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
+-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
+-org.codehaus.jackson:jackson-mapper-asl:1.9.13
... [skipped a number of other version convergence errors for dependencies]
