[ https://issues.apache.org/jira/browse/FLINK-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492912#comment-14492912 ]
Alexander Alexandrov commented on FLINK-1829: --------------------------------------------- The client project includes (with provided scope) flink-scala, flink-java, and flink-clients. Here is the dependency tree for the problematic `emma-examples` project: {{{ [INFO] ------------------------------------------------------------------------ [INFO] Building emma-sketchbook 1.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-dependency-plugin:2.1:tree (default-cli) @ emma-sketchbook --- [INFO] eu.stratosphere:emma-sketchbook:jar:1.0-SNAPSHOT [INFO] +- org.scala-lang:scala-library:jar:2.11.4:compile [INFO] +- org.scala-lang:scala-reflect:jar:2.11.4:compile [INFO] +- org.scala-lang:scala-compiler:jar:2.11.4:compile [INFO] | +- org.scala-lang.modules:scala-xml_2.11:jar:1.0.2:compile [INFO] | \- org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.2:compile [INFO] +- eu.stratosphere:emma-language:jar:1.0-SNAPSHOT:compile [INFO] | +- com.assembla.scala-incubator:graph-core_2.11:jar:1.9.0:compile [INFO] | +- eu.stratosphere:emma-backend:jar:1.0-SNAPSHOT:compile [INFO] | +- eu.stratosphere:emma-common:jar:1.0-SNAPSHOT:compile [INFO] | | +- eu.stratosphere:emma-common-macros:jar:1.0-SNAPSHOT:compile [INFO] | | +- net.sf.opencsv:opencsv:jar:2.3:compile [INFO] | | \- com.typesafe.scala-logging:scala-logging-slf4j_2.11:jar:2.1.2:compile [INFO] | | \- com.typesafe.scala-logging:scala-logging-api_2.11:jar:2.1.2:compile [INFO] | +- org.apache.hadoop:hadoop-common:jar:2.2.0:compile [INFO] | | +- org.apache.hadoop:hadoop-annotations:jar:2.2.0:compile [INFO] | | | \- jdk.tools:jdk.tools:jar:1.7:system [INFO] | | +- commons-cli:commons-cli:jar:1.2:compile [INFO] | | +- org.apache.commons:commons-math:jar:2.1:compile [INFO] | | +- xmlenc:xmlenc:jar:0.52:compile [INFO] | | +- commons-httpclient:commons-httpclient:jar:3.1:compile [INFO] | | +- commons-codec:commons-codec:jar:1.4:compile [INFO] | | +- commons-io:commons-io:jar:2.4:compile [INFO] | | +- commons-net:commons-net:jar:2.2:compile [INFO] | | +- javax.servlet:servlet-api:jar:2.5:compile [INFO] | | +- org.mortbay.jetty:jetty:jar:6.1.26:compile [INFO] | | +- org.mortbay.jetty:jetty-util:jar:6.1.26:compile [INFO] | | +- com.sun.jersey:jersey-core:jar:1.9:compile [INFO] | | +- com.sun.jersey:jersey-json:jar:1.9:compile [INFO] | | | +- org.codehaus.jettison:jettison:jar:1.1:compile [INFO] | | | | \- stax:stax-api:jar:1.0.1:compile [INFO] | | | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:compile [INFO] | | | | \- javax.xml.bind:jaxb-api:jar:2.2.2:compile [INFO] | | | | \- javax.activation:activation:jar:1.1:compile [INFO] | | | +- org.codehaus.jackson:jackson-jaxrs:jar:1.8.3:compile [INFO] | | | \- org.codehaus.jackson:jackson-xc:jar:1.8.3:compile [INFO] | | +- com.sun.jersey:jersey-server:jar:1.9:compile [INFO] | | | \- asm:asm:jar:3.1:compile [INFO] | | +- tomcat:jasper-compiler:jar:5.5.23:runtime [INFO] | | +- commons-logging:commons-logging:jar:1.1.1:compile [INFO] | | +- net.java.dev.jets3t:jets3t:jar:0.7.1:compile [INFO] | | +- commons-lang:commons-lang:jar:2.5:compile [INFO] | | +- commons-configuration:commons-configuration:jar:1.6:compile [INFO] | | | +- commons-collections:commons-collections:jar:3.2.1:compile [INFO] | | | +- commons-digester:commons-digester:jar:1.8:compile [INFO] | | | | \- commons-beanutils:commons-beanutils:jar:1.7.0:compile [INFO] | | | \- commons-beanutils:commons-beanutils-core:jar:1.8.0:compile [INFO] | | +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile [INFO] | | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile [INFO] | | +- org.apache.avro:avro:jar:1.7.6:compile [INFO] | | | +- com.thoughtworks.paranamer:paranamer:jar:2.3:compile [INFO] | | | \- org.xerial.snappy:snappy-java:jar:1.1.1.6:compile [INFO] | | +- com.google.protobuf:protobuf-java:jar:2.5.0:compile [INFO] | | +- org.apache.hadoop:hadoop-auth:jar:2.2.0:compile [INFO] | | +- com.jcraft:jsch:jar:0.1.42:compile [INFO] | | +- org.apache.zookeeper:zookeeper:jar:3.4.5:compile [INFO] | | \- org.apache.commons:commons-compress:jar:1.4.1:compile [INFO] | | \- org.tukaani:xz:jar:1.0:compile [INFO] | \- org.apache.hadoop:hadoop-hdfs:jar:2.2.0:compile [INFO] | +- commons-daemon:commons-daemon:jar:1.0.13:compile [INFO] | +- javax.servlet.jsp:jsp-api:jar:2.1:compile [INFO] | \- tomcat:jasper-runtime:jar:5.5.23:compile [INFO] | \- commons-el:commons-el:jar:1.0:compile [INFO] +- eu.stratosphere:emma-flink:jar:1.0-SNAPSHOT:compile [INFO] +- eu.stratosphere:emma-common:test-jar:tests:1.0-SNAPSHOT:test [INFO] +- eu.stratosphere:emma-language:test-jar:tests:1.0-SNAPSHOT:test [INFO] +- eu.stratosphere:flink-scala:jar:0.9-SNAPSHOT:provided [INFO] | +- eu.stratosphere:flink-core:jar:0.9-SNAPSHOT:provided [INFO] | +- eu.stratosphere:flink-optimizer:jar:0.9-SNAPSHOT:provided [INFO] | \- org.apache.commons:commons-lang3:jar:3.3.2:provided [INFO] +- eu.stratosphere:flink-java:jar:0.9-SNAPSHOT:provided [INFO] | +- eu.stratosphere:flink-shaded-include-yarn:jar:0.9-SNAPSHOT:provided [INFO] | +- com.esotericsoftware.kryo:kryo:jar:2.24.0:provided [INFO] | | +- com.esotericsoftware.minlog:minlog:jar:1.2:provided [INFO] | | \- org.objenesis:objenesis:jar:2.1:provided [INFO] | +- com.twitter:chill_2.11:jar:0.5.2:provided [INFO] | +- com.twitter:chill-avro_2.11:jar:0.5.2:provided [INFO] | | +- com.twitter:chill-bijection_2.11:jar:0.5.2:provided [INFO] | | | \- com.twitter:bijection-core_2.11:jar:0.7.2:provided [INFO] | | \- com.twitter:bijection-avro_2.11:jar:0.7.2:provided [INFO] | +- com.twitter:chill-protobuf:jar:0.5.2:provided [INFO] | +- com.twitter:chill-thrift:jar:0.5.2:provided [INFO] | +- org.apache.thrift:libthrift:jar:0.6.1:provided [INFO] | +- de.javakaffee:kryo-serializers:jar:0.27:provided [INFO] | \- joda-time:joda-time:jar:2.5:provided [INFO] +- eu.stratosphere:flink-clients:jar:0.9-SNAPSHOT:provided [INFO] | +- eu.stratosphere:flink-runtime:jar:0.9-SNAPSHOT:provided [INFO] | | +- com.amazonaws:aws-java-sdk:jar:1.8.1:provided [INFO] | | | \- org.apache.httpcomponents:httpclient:jar:4.2:provided [INFO] | | | \- org.apache.httpcomponents:httpcore:jar:4.2:provided [INFO] | | +- com.typesafe.akka:akka-actor_2.11:jar:2.3.7:provided [INFO] | | | \- com.typesafe:config:jar:1.2.1:provided [INFO] | | +- com.typesafe.akka:akka-remote_2.11:jar:2.3.7:provided [INFO] | | +- com.typesafe.akka:akka-slf4j_2.11:jar:2.3.7:provided [INFO] | | +- com.github.scopt:scopt_2.11:jar:3.2.0:provided [INFO] | | +- io.dropwizard.metrics:metrics-core:jar:3.1.0:provided [INFO] | | +- io.dropwizard.metrics:metrics-jvm:jar:3.1.0:provided [INFO] | | \- io.dropwizard.metrics:metrics-json:jar:3.1.0:provided [INFO] | +- org.eclipse.jetty:jetty-server:jar:8.0.0.M1:provided [INFO] | | +- org.mortbay.jetty:servlet-api:jar:3.0.20100224:provided [INFO] | | +- org.eclipse.jetty:jetty-continuation:jar:8.0.0.M1:provided [INFO] | | \- org.eclipse.jetty:jetty-http:jar:8.0.0.M1:provided [INFO] | | \- org.eclipse.jetty:jetty-io:jar:8.0.0.M1:provided [INFO] | +- org.eclipse.jetty:jetty-security:jar:8.0.0.M1:provided [INFO] | +- org.eclipse.jetty:jetty-servlet:jar:8.0.0.M1:provided [INFO] | \- commons-fileupload:commons-fileupload:jar:1.3.1:provided [INFO] +- com.fasterxml.jackson.core:jackson-core:jar:2.2.1:provided [INFO] +- com.fasterxml.jackson.core:jackson-databind:jar:2.2.1:provided [INFO] +- com.fasterxml.jackson.core:jackson-annotations:jar:2.2.1:provided [INFO] +- org.apache.spark:spark-core_2.11:jar:1.2.1:provided [INFO] | +- com.twitter:chill-java:jar:0.5.0:provided [INFO] | +- org.apache.hadoop:hadoop-client:jar:2.2.0:provided [INFO] | | +- org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.2.0:provided [INFO] | | | +- org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0:provided [INFO] | | | | +- org.apache.hadoop:hadoop-yarn-client:jar:2.2.0:provided [INFO] | | | | \- org.apache.hadoop:hadoop-yarn-server-common:jar:2.2.0:provided [INFO] | | | \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.2.0:provided [INFO] | | +- org.apache.hadoop:hadoop-yarn-api:jar:2.2.0:provided [INFO] | | +- org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0:provided [INFO] | | | \- org.apache.hadoop:hadoop-yarn-common:jar:2.2.0:provided [INFO] | | \- org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.2.0:provided [INFO] | +- org.apache.spark:spark-network-common_2.11:jar:1.2.1:provided [INFO] | +- org.apache.spark:spark-network-shuffle_2.11:jar:1.2.1:provided [INFO] | +- org.apache.curator:curator-recipes:jar:2.4.0:provided [INFO] | | \- org.apache.curator:curator-framework:jar:2.4.0:provided [INFO] | | \- org.apache.curator:curator-client:jar:2.4.0:provided [INFO] | +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:provided [INFO] | | +- org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:provided [INFO] | | +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:provided [INFO] | | | \- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:provided [INFO] | | \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:provided [INFO] | | \- org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:provided [INFO] | | \- org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:provided [INFO] | +- org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031:provided [INFO] | +- org.apache.commons:commons-math3:jar:3.1.1:provided [INFO] | +- org.slf4j:jul-to-slf4j:jar:1.7.5:provided [INFO] | +- org.slf4j:jcl-over-slf4j:jar:1.7.5:provided [INFO] | +- com.ning:compress-lzf:jar:1.0.0:provided [INFO] | +- net.jpountz.lz4:lz4:jar:1.2.0:provided [INFO] | +- org.roaringbitmap:RoaringBitmap:jar:0.4.5:provided [INFO] | +- org.spark-project.akka:akka-remote_2.11:jar:2.3.4-spark:provided [INFO] | | +- org.spark-project.akka:akka-actor_2.11:jar:2.3.4-spark:provided [INFO] | | +- io.netty:netty:jar:3.8.0.Final:provided [INFO] | | +- org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark:provided [INFO] | | \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:provided [INFO] | +- org.spark-project.akka:akka-slf4j_2.11:jar:2.3.4-spark:provided [INFO] | +- org.json4s:json4s-jackson_2.11:jar:3.2.10:provided [INFO] | | \- org.json4s:json4s-core_2.11:jar:3.2.10:provided [INFO] | | +- org.json4s:json4s-ast_2.11:jar:3.2.10:provided [INFO] | | \- org.scala-lang:scalap:jar:2.11.0:provided [INFO] | +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:provided [INFO] | +- io.netty:netty-all:jar:4.0.23.Final:provided [INFO] | +- com.clearspring.analytics:stream:jar:2.7.0:provided [INFO] | +- com.codahale.metrics:metrics-core:jar:3.0.0:provided [INFO] | +- com.codahale.metrics:metrics-jvm:jar:3.0.0:provided [INFO] | +- com.codahale.metrics:metrics-json:jar:3.0.0:provided [INFO] | +- com.codahale.metrics:metrics-graphite:jar:3.0.0:provided [INFO] | +- org.tachyonproject:tachyon-client:jar:0.5.0:provided [INFO] | | \- org.tachyonproject:tachyon:jar:0.5.0:provided [INFO] | +- org.spark-project:pyrolite:jar:2.0.1:provided [INFO] | +- net.sf.py4j:py4j:jar:0.8.2.1:provided [INFO] | \- org.spark-project.spark:unused:jar:1.0.0:provided [INFO] +- log4j:log4j:jar:1.2.17:compile [INFO] +- org.slf4j:slf4j-api:jar:1.7.9:compile [INFO] +- org.slf4j:slf4j-log4j12:jar:1.7.9:compile [INFO] +- junit:junit:jar:4.11:test [INFO] | \- org.hamcrest:hamcrest-core:jar:1.3:test [INFO] +- org.specs2:specs2_2.11:jar:2.3.11:test [INFO] | +- org.scalacheck:scalacheck_2.11:jar:1.11.3:test [INFO] | | \- org.scala-sbt:test-interface:jar:1.0:test [INFO] | +- org.specs2:classycle:jar:1.4.3:test [INFO] | +- org.mockito:mockito-core:jar:1.9.5:test [INFO] | +- org.pegdown:pegdown:jar:1.2.1:test [INFO] | | \- org.parboiled:parboiled-java:jar:1.1.4:test [INFO] | | +- org.parboiled:parboiled-core:jar:1.1.4:test [INFO] | | +- org.ow2.asm:asm:jar:4.1:test [INFO] | | +- org.ow2.asm:asm-tree:jar:4.1:test [INFO] | | +- org.ow2.asm:asm-analysis:jar:4.1:test [INFO] | | \- org.ow2.asm:asm-util:jar:4.1:test [INFO] | +- org.scalaz:scalaz-core_2.11:jar:7.0.6:test [INFO] | \- org.scalaz:scalaz-concurrent_2.11:jar:7.0.6:test [INFO] | \- org.scalaz:scalaz-effect_2.11:jar:7.0.6:test [INFO] +- org.scalatest:scalatest_2.11:jar:2.1.5:test [INFO] +- net.sourceforge.argparse4j:argparse4j:jar:0.4.4:compile [INFO] \- org.reflections:reflections:jar:0.9.9:compile [INFO] +- com.google.guava:guava:jar:15.0:compile [INFO] +- org.javassist:javassist:jar:3.18.2-GA:compile [INFO] \- com.google.code.findbugs:annotations:jar:2.0.1:compile }}} > Conflicting Jackson version in the Flink POMs > --------------------------------------------- > > Key: FLINK-1829 > URL: https://issues.apache.org/jira/browse/FLINK-1829 > Project: Flink > Issue Type: Bug > Components: Build System > Affects Versions: 0.9 > Reporter: Alexander Alexandrov > Assignee: Robert Metzger > Fix For: 0.9 > > > The current POM setup transitively includes multiple conflicting versions of > the Jackson library over > * {{com.amazonaws:aws-java-sdk}} (v. 2.1.1) > * {{org.apache.avro:avro}} (v. 1.9.13) > * {{org.apache.hbase:hbase-client}} (v. 1.8.8) > When running jobs against a Flink local runtime embedded with: > {code:xml} > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-scala</artifactId> > <version>${flink.version}</version> > <scope>provided</scope> > </dependency> > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-java</artifactId> > <version>${flink.version}</version> > <scope>provided</scope> > </dependency> > <dependency> > <groupId>org.apache.flink</groupId> > <artifactId>flink-clients</artifactId> > <version>${flink.version}</version> > <scope>provided</scope> > </dependency> > {code} > I get the following error: > {noformat} > 15-04-04 15:52:04 ERROR exception during creation > akka.actor.ActorInitializationException: exception during creation > at akka.actor.ActorInitializationException$.apply(Actor.scala:164) > at akka.actor.ActorCell.create(ActorCell.scala:596) > at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456) > at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478) > at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:279) > at akka.dispatch.Mailbox.run(Mailbox.scala:220) > at akka.dispatch.Mailbox.exec(Mailbox.scala:231) > at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > at > scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) > at > scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > at > scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at akka.util.Reflect$.instantiate(Reflect.scala:66) > at akka.actor.ArgsReflectConstructor.produce(Props.scala:352) > at akka.actor.Props.newActor(Props.scala:252) > at akka.actor.ActorCell.newActor(ActorCell.scala:552) > at akka.actor.ActorCell.create(ActorCell.scala:578) > ... 9 more > Caused by: java.lang.NoSuchMethodError: > com.fasterxml.jackson.core.JsonFactory.requiresPropertyOrdering()Z > at > com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:445) > at > com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:366) > at > org.apache.flink.runtime.taskmanager.TaskManager.<init>(TaskManager.scala:134) > ... 18 more > {noformat} > Fixing the Jackson version on the client side, e.g, with the following snippet > {code:xml} > <dependency> > <groupId>com.fasterxml.jackson.core</groupId> > <artifactId>jackson-core</artifactId> > <version>2.2.1</version> > <scope>provided</scope> > </dependency> > <dependency> > <groupId>com.fasterxml.jackson.core</groupId> > <artifactId>jackson-databind</artifactId> > <version>2.2.1</version> > <scope>provided</scope> > </dependency> > <dependency> > <groupId>com.fasterxml.jackson.core</groupId> > <artifactId>jackson-annotations</artifactId> > <version>2.2.1</version> > <scope>provided</scope> > </dependency> > {code} > solves the problem, but I guess it will be better if we can stick with one > version in the build artifacts. -- This message was sent by Atlassian JIRA (v6.3.4#6332)