We're now looking at shading option. Talking to Cloudera Support even minor upgrades to jackson known have caused issues in the past. They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but this will be released mid-next year. So we're not waiting for that to happen.
Yes, we will contribute back to the project when we find solution. Thanks for the suggestion Felix. Is this known if Zeppelin can work fine with jasckson 2.*2*.3? (certain dependencies currently list jackson 2.*5*.3) -- Ruslan Dautkhanov On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixcheun...@hotmail.com> wrote: > Instead of exclusion, would it be better to use the version in the > cloudera repo? > > Please do consider contributing these changes back to Zeppelin source. > Thanks! > > _____________________________ > From: Ruslan Dautkhanov <dautkha...@gmail.com> > Sent: Monday, December 11, 2017 3:42 PM > Subject: Re: zeppelin build fails with DependencyConvergence error > To: Zeppelin Users <us...@zeppelin.incubator.apache.org> > > > > Looks like master branch of Zeppelin still has compatibility issue with > Cloudera dependencies. > > When built using > > mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1 > -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e > > maven fails on jackson convergence error - see below email for more > details. > Looks like there was a change in Zeppelin that upgraded Jackson's version? > So now it conflicts with older jackson library as referenced by cloudera > repo. > > workaround: Zeppelin builds fine with pom change [1] - the question is now > would somebody expect Zeppelin would still be functioning correctly with > these exclusions? > > > > [1] > > --- a/zeppelin-zengine/pom.xml >> +++ b/zeppelin-zengine/pom.xml >> @@ -364,6 +364,30 @@ >> <groupId>com.google.guava</groupId> >> <artifactId>guava</artifactId> >> </exclusion> >> + <exclusion> >> + <groupId>com.fasterxml.jackson.core</groupId> >> + <artifactId>jackson-core</artifactId> >> + </exclusion> >> + <exclusion> >> + <groupId>com.fasterxml.jackson.core</groupId> >> + <artifactId>jackson-annotations</artifactId> >> + </exclusion> >> + <exclusion> >> + <groupId>com.fasterxml.jackson.core</groupId> >> + <artifactId>jackson-databind</artifactId> >> + </exclusion> >> + <exclusion> >> + <groupId>org.codehaus.jackson</groupId> >> + <artifactId>jackson-mapper-asl</artifactId> >> + </exclusion> >> + <exclusion> >> + <groupId>org.codehaus.jackson</groupId> >> + <artifactId>jackson-core-asl</artifactId> >> + </exclusion> >> + <exclusion> >> + <groupId>org.apache.zookeeper</groupId> >> + <artifactId>zookeeper</artifactId> >> + </exclusion> >> </exclusions> >> </dependency> >> > > > > On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <dautkha...@gmail.com> > wrote: > >> Building from a current Zeppelin snapshot fails with >> zeppelin build fails with org.apache.maven.plugins.enfor >> cer.DependencyConvergence >> see details below. >> >> Build command >> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 >> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10 >> -Psparkr -pl '!*..excluded certain modules..*' -e >> >> maven 3.5.0 >>> jdk 1.8.0_141 >>> RHEL 7.3 >>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7 >>> nodejs.x86_64 1:6.11.1-1.el7 @epel >>> latest zeppelin snapshot >> >> >> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen >> this problem before. >> >> Thanks, >> Ruslan >> >> >> >> [INFO] Scanning for projects... >> [WARNING] >> [WARNING] Some problems were encountered while building the effective >> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8 >> .0-SNAPSHOT >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin >> com.googlecode.maven-download-plugin:download-maven-plugin >> @ line 940, column 15 >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin >> com.googlecode.maven-download-plugin:download-maven-plugin >> @ line 997, column 15 >> [WARNING] >> [WARNING] Some problems were encountered while building the effective >> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin >> @ line 467, column 15 >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin >> org.apache.maven.plugins:maven-surefire-plugin >> @ line 475, column 15 >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin >> org.apache.maven.plugins:maven-compiler-plugin >> @ line 486, column 15 >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin >> @ line 496, column 15 >> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but >> found duplicate declaration of plugin >> org.apache.maven.plugins:maven-surefire-plugin >> @ line 504, column 15 >> [WARNING] >> [WARNING] It is highly recommended to fix these problems because they >> threaten the stability of your build. >> [WARNING] >> [WARNING] For this reason, future Maven versions might no longer support >> building such malformed projects. >> [WARNING] >> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT >> uses prerequisites which is only intended for maven-plugin projects but not >> for non maven-plugin projects. For such purposes you should use the >> maven-enforcer-plugin. See https://maven.apache.org/enfor >> cer/enforcer-rules/requireMavenVersion.html >> >> >> ... [skip] >> >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT >> [INFO] ------------------------------------------------------------ >> ------------ >> [INFO] >> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ >> zeppelin-zengine --- >> [INFO] >> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ >> zeppelin-zengine --- >> [INFO] >> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @ >> zeppelin-zengine --- >> [INFO] >> [INFO] >> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ >> zeppelin-zengine --- >> [INFO] Using 'UTF-8' encoding to copy filtered resources. >> [INFO] Copying 17 resources >> [INFO] >> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ >> zeppelin-zengine --- >> [WARNING] >> Dependency convergence error for >> com.fasterxml.jackson.core:jackson-core:2.5.3 >> paths to dependency are: >> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >> +-com.amazonaws:aws-java-sdk-s3:1.10.62 >> +-com.amazonaws:aws-java-sdk-core:1.10.62 >> +-com.fasterxml.jackson.core:jackson-databind:2.5.3 >> +-com.fasterxml.jackson.core:jackson-core:2.5.3 >> and >> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0 >> +-com.fasterxml.jackson.core:jackson-core:2.2.3 >> >> [WARNING] >> Dependency convergence error for >> org.codehaus.jackson:jackson-mapper-asl:1.9.13 >> paths to dependency are: >> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >> +-com.github.eirslett:frontend-maven-plugin:1.3 >> +-com.github.eirslett:frontend-plugin-core:1.3 >> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >> and >> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0 >> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8 >> and >> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0 >> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >> >> ... [skipped a number of other version convergence errors for >> dependencies] >> >> >> > > >
