ZEPPELIN-3119 will fix this. Will update this thread once it is done
Ruslan Dautkhanov <dautkha...@gmail.com>于2017年12月29日周五 上午6:04写道： > The build failure messages all point to the zeppelin-zengine module in the > source code. In this commit: > https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47 > , a dependency change was made to add the org.apache.hadoop:hadoop-client > which points to both org.apache.hadoop:hadoop-common and > org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different > versions (at least for the Cloudera version of them) of the > org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13 > respectively. > > Was anyone able to build zeppelin with cloudera repo after > ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client jar) > PR #2455 > was committed ? > > > On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <dautkha...@gmail.com> > wrote: > >> We're now looking at shading option. >> >> Talking to Cloudera Support even minor upgrades to jackson known have >> caused issues in the past. >> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but >> this will be released mid-next year. >> So we're not waiting for that to happen. >> >> Yes, we will contribute back to the project when we find solution. >> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine >> with jasckson 2.*2*.3? >> (certain dependencies currently list jackson 2.*5*.3) >> >> >> >> -- >> Ruslan Dautkhanov >> >> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixcheun...@hotmail.com> >> wrote: >> >>> Instead of exclusion, would it be better to use the version in the >>> cloudera repo? >>> >>> Please do consider contributing these changes back to Zeppelin source. >>> Thanks! >>> >>> _____________________________ >>> From: Ruslan Dautkhanov <dautkha...@gmail.com> >>> Sent: Monday, December 11, 2017 3:42 PM >>> Subject: Re: zeppelin build fails with DependencyConvergence error >>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org> >>> >>> >>> >>> Looks like master branch of Zeppelin still has compatibility issue with >>> Cloudera dependencies. >>> >>> When built using >>> >>> mvn clean package -DskipTests -Pspark-2.2 >>> -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list >>> of excluded packages' -e >>> >>> maven fails on jackson convergence error - see below email for more >>> details. >>> Looks like there was a change in Zeppelin that upgraded Jackson's >>> version? >>> So now it conflicts with older jackson library as referenced by cloudera >>> repo. >>> >>> workaround: Zeppelin builds fine with pom change [1] - the question is >>> now >>> would somebody expect Zeppelin would still be functioning correctly with >>> these exclusions? >>> >>> >>> >>> [1] >>> >>> --- a/zeppelin-zengine/pom.xml >>>> +++ b/zeppelin-zengine/pom.xml >>>> @@ -364,6 +364,30 @@ >>>> <groupId>com.google.guava</groupId> >>>> <artifactId>guava</artifactId> >>>> </exclusion> >>>> + <exclusion> >>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>> + <artifactId>jackson-core</artifactId> >>>> + </exclusion> >>>> + <exclusion> >>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>> + <artifactId>jackson-annotations</artifactId> >>>> + </exclusion> >>>> + <exclusion> >>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>> + <artifactId>jackson-databind</artifactId> >>>> + </exclusion> >>>> + <exclusion> >>>> + <groupId>org.codehaus.jackson</groupId> >>>> + <artifactId>jackson-mapper-asl</artifactId> >>>> + </exclusion> >>>> + <exclusion> >>>> + <groupId>org.codehaus.jackson</groupId> >>>> + <artifactId>jackson-core-asl</artifactId> >>>> + </exclusion> >>>> + <exclusion> >>>> + <groupId>org.apache.zookeeper</groupId> >>>> + <artifactId>zookeeper</artifactId> >>>> + </exclusion> >>>> </exclusions> >>>> </dependency> >>>> >>> >>> >>> >>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <dautkha...@gmail.com >>> > wrote: >>> >>>> Building from a current Zeppelin snapshot fails with >>>> zeppelin build fails with >>>> org.apache.maven.plugins.enforcer.DependencyConvergence >>>> see details below. >>>> >>>> Build command >>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 >>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10 >>>> -Psparkr -pl '!*..excluded certain modules..*' -e >>>> >>>> maven 3.5.0 >>>>> jdk 1.8.0_141 >>>>> RHEL 7.3 >>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7 >>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel >>>>> latest zeppelin snapshot >>>> >>>> >>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen >>>> this problem before. >>>> >>>> Thanks, >>>> Ruslan >>>> >>>> >>>> >>>> [INFO] Scanning for projects... >>>> [WARNING] >>>> [WARNING] Some problems were encountered while building the effective >>>> model for >>>> org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 940, >>>> column 15 >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 997, >>>> column 15 >>>> [WARNING] >>>> [WARNING] Some problems were encountered while building the effective >>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> org.scala-tools:maven-scala-plugin @ line 467, column 15 >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15 >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15 >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> org.scala-tools:maven-scala-plugin @ line 496, column 15 >>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>> but found duplicate declaration of plugin >>>> org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15 >>>> [WARNING] >>>> [WARNING] It is highly recommended to fix these problems because they >>>> threaten the stability of your build. >>>> [WARNING] >>>> [WARNING] For this reason, future Maven versions might no longer >>>> support building such malformed projects. >>>> [WARNING] >>>> [WARNING] The project >>>> org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites >>>> which is only intended for maven-plugin projects but not for non >>>> maven-plugin projects. For such purposes you should use the >>>> maven-enforcer-plugin. See >>>> https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html >>>> >>>> >>>> ... [skip] >>>> >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] >>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ >>>> zeppelin-zengine --- >>>> [INFO] >>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ >>>> zeppelin-zengine --- >>>> [INFO] >>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @ >>>> zeppelin-zengine --- >>>> [INFO] >>>> [INFO] >>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ >>>> zeppelin-zengine --- >>>> [INFO] Using 'UTF-8' encoding to copy filtered resources. >>>> [INFO] Copying 17 resources >>>> [INFO] >>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ >>>> zeppelin-zengine --- >>>> [WARNING] >>>> Dependency convergence error for >>>> com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are: >>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62 >>>> +-com.amazonaws:aws-java-sdk-core:1.10.62 >>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3 >>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3 >>>> and >>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0 >>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3 >>>> >>>> [WARNING] >>>> Dependency convergence error for >>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are: >>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>> +-com.github.eirslett:frontend-maven-plugin:1.3 >>>> +-com.github.eirslett:frontend-plugin-core:1.3 >>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>> and >>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0 >>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8 >>>> and >>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0 >>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>> >>>> ... [skipped a number of other version convergence errors for >>>> dependencies] >>>> >>>> >>>> >>> >>> >>> >> >
