Re: Spark 1.0.0 Maven dependencies problems.
Thanks for the hint. I removed signature info from same jar and JVM is happy now. But problem remains, several same jar's but different versions, not good. Spark itself is very, very promising, I am very excited Thank you all toivo -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247p7309.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Spark 1.0.0 Maven dependencies problems.
Hi, (Apparently Google Mail is quite eager to send out mails when Ctrl+Enter is hit by accident. Sorry for the previous email.) I remembered I saw this as well and found this ugly comment in my build.sbt file: /* * [...], there is still a problem with some classes * in javax.servlet (from org.eclipse.jetty.orbit) being signed, while others * (from org.mortbay.jetty) are not. When using "sbt run", this is not a * problem, but IntelliJ IDEA refuses to run the main classes, raising a * SecurityException. In order to deal with that, remove the signature from * org.eclipse.jetty.orbit/javax.servlet/jars/javax.servlet-3.0.0.v201112011016.jar * file manually. */ Tobias On Tue, Jun 10, 2014 at 10:47 AM, Tobias Pfeiffer wrote: > Hi, > > I remembered I saw this as well and found this ugly comment in my > build.sbt file: > > > On Mon, Jun 9, 2014 at 11:37 PM, Sean Owen wrote: >> Looks like this crept in again from the shaded Akka dependency. I'll >> propose a PR to remove it. I believe that remains the way we have to >> deal with the differing Netty/Jetty dependencies floating around. >> >> On Mon, Jun 9, 2014 at 9:53 AM, toivoa wrote: >>> I am using Maven from Eclipse >>> >>> dependency:tree shows >>> >>> >>> [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile >>> [INFO] | +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime >>> [INFO] | +- org.apache.curator:curator-recipes:jar:2.4.0:compile >>> [INFO] | | +- org.apache.curator:curator-framework:jar:2.4.0:compile >>> [INFO] | | | \- org.apache.curator:curator-client:jar:2.4.0:compile >>> [INFO] | | \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile >>> [INFO] | | \- jline:jline:jar:0.9.94:compile >>> [INFO] | +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile >>> [INFO] | | +- >>> org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile >>> [INFO] | | +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile >>> [INFO] | | | +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile >>> [INFO] | | | \- >>> org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile >>> [INFO] | | \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile >>> [INFO] | | \- >>> org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile >>> [INFO] | |\- >>> org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile >>> [INFO] | +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile >>> [INFO] | +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile >>> [INFO] | | +- >>> org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile >>> [INFO] | | +- >>> org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile >>> [INFO] | | \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile >>> [INFO] | | \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile >>> [INFO] | +- com.google.guava:guava:jar:14.0.1:compile >>> [INFO] | +- org.apache.commons:commons-lang3:jar:3.3.2:compile >>> [INFO] | +- com.google.code.findbugs:jsr305:jar:1.3.9:compile >>> [INFO] | +- org.slf4j:slf4j-api:jar:1.7.5:compile >>> [INFO] | +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile >>> [INFO] | +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile >>> [INFO] | +- log4j:log4j:jar:1.2.17:compile >>> [INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile >>> [INFO] | +- com.ning:compress-lzf:jar:1.0.0:compile >>> [INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.5:compile >>> [INFO] | +- com.twitter:chill_2.10:jar:0.3.6:compile >>> [INFO] | | \- com.esotericsoftware.kryo:kryo:jar:2.21:compile >>> [INFO] | | +- >>> com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile >>> [INFO] | | +- com.esotericsoftware.minlog:minlog:jar:1.2:compile >>> [INFO] | | \- org.objenesis:objenesis:jar:1.2:compile >>> [INFO] | +- com.twitter:chill-java:jar:0.3.6:compile >>> [INFO] | +- commons-net:commons-net:jar:2.2:compile >>> [INFO] | +- >>> org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile >>> [INFO] | | +- >>> org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile >>> [INFO] | | | \- com.typesafe:config:jar:1.0.2:compile >>> [INFO] | | +- io.netty:netty:jar:3.6.6.Final:compile >>> [INFO] | | +- >>> org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile >>> [INFO] | | \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile >>> [INFO] | +- >>> org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile >>> [INFO] | +- org.scala-lang:scala-library:jar:2.10.4:compile >>> [INFO] | +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile >>> [INFO] | | +- org.json4s:json4s-core_2.10:jar:3.2.6:compile >>> [INFO] | | | +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile >>> [INFO] | | | +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile >>> [INFO] | | | \- org.scala-lang:scalap:jar:2.10.0:compile >>> [INFO] | | | \- org.scala-lang:scala-comp
Re: Spark 1.0.0 Maven dependencies problems.
Hi, I remembered I saw this as well and found this ugly comment in my build.sbt file: On Mon, Jun 9, 2014 at 11:37 PM, Sean Owen wrote: > Looks like this crept in again from the shaded Akka dependency. I'll > propose a PR to remove it. I believe that remains the way we have to > deal with the differing Netty/Jetty dependencies floating around. > > On Mon, Jun 9, 2014 at 9:53 AM, toivoa wrote: >> I am using Maven from Eclipse >> >> dependency:tree shows >> >> >> [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile >> [INFO] | +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime >> [INFO] | +- org.apache.curator:curator-recipes:jar:2.4.0:compile >> [INFO] | | +- org.apache.curator:curator-framework:jar:2.4.0:compile >> [INFO] | | | \- org.apache.curator:curator-client:jar:2.4.0:compile >> [INFO] | | \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile >> [INFO] | | \- jline:jline:jar:0.9.94:compile >> [INFO] | +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile >> [INFO] | | +- >> org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile >> [INFO] | | +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile >> [INFO] | | | +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile >> [INFO] | | | \- >> org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile >> [INFO] | | \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile >> [INFO] | | \- >> org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile >> [INFO] | |\- >> org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile >> [INFO] | +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile >> [INFO] | +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile >> [INFO] | | +- >> org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile >> [INFO] | | +- >> org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile >> [INFO] | | \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile >> [INFO] | | \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile >> [INFO] | +- com.google.guava:guava:jar:14.0.1:compile >> [INFO] | +- org.apache.commons:commons-lang3:jar:3.3.2:compile >> [INFO] | +- com.google.code.findbugs:jsr305:jar:1.3.9:compile >> [INFO] | +- org.slf4j:slf4j-api:jar:1.7.5:compile >> [INFO] | +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile >> [INFO] | +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile >> [INFO] | +- log4j:log4j:jar:1.2.17:compile >> [INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile >> [INFO] | +- com.ning:compress-lzf:jar:1.0.0:compile >> [INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.5:compile >> [INFO] | +- com.twitter:chill_2.10:jar:0.3.6:compile >> [INFO] | | \- com.esotericsoftware.kryo:kryo:jar:2.21:compile >> [INFO] | | +- >> com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile >> [INFO] | | +- com.esotericsoftware.minlog:minlog:jar:1.2:compile >> [INFO] | | \- org.objenesis:objenesis:jar:1.2:compile >> [INFO] | +- com.twitter:chill-java:jar:0.3.6:compile >> [INFO] | +- commons-net:commons-net:jar:2.2:compile >> [INFO] | +- >> org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile >> [INFO] | | +- >> org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile >> [INFO] | | | \- com.typesafe:config:jar:1.0.2:compile >> [INFO] | | +- io.netty:netty:jar:3.6.6.Final:compile >> [INFO] | | +- >> org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile >> [INFO] | | \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile >> [INFO] | +- >> org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile >> [INFO] | +- org.scala-lang:scala-library:jar:2.10.4:compile >> [INFO] | +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile >> [INFO] | | +- org.json4s:json4s-core_2.10:jar:3.2.6:compile >> [INFO] | | | +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile >> [INFO] | | | +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile >> [INFO] | | | \- org.scala-lang:scalap:jar:2.10.0:compile >> [INFO] | | | \- org.scala-lang:scala-compiler:jar:2.10.0:compile >> [INFO] | | |\- org.scala-lang:scala-reflect:jar:2.10.0:compile >> [INFO] | | \- >> com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile >> [INFO] | | +- >> com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile >> [INFO] | | \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile >> [INFO] | +- colt:colt:jar:1.2.0:compile >> [INFO] | | \- concurrent:concurrent:jar:1.3.4:compile >> [INFO] | +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile >> [INFO] | +- io.netty:netty-all:jar:4.0.17.Final:compile >> [INFO] | +- com.clearspring.analytics:stream:jar:2.5.1:compile >> [INFO] | +- com.codahale.metrics:metrics-core:jar:3.0.0:compile >> [INFO] | +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile >> [INFO] | +- com.codahale.metr
Re: Spark 1.0.0 Maven dependencies problems.
Looks like this crept in again from the shaded Akka dependency. I'll propose a PR to remove it. I believe that remains the way we have to deal with the differing Netty/Jetty dependencies floating around. On Mon, Jun 9, 2014 at 9:53 AM, toivoa wrote: > I am using Maven from Eclipse > > dependency:tree shows > > > [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile > [INFO] | +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime > [INFO] | +- org.apache.curator:curator-recipes:jar:2.4.0:compile > [INFO] | | +- org.apache.curator:curator-framework:jar:2.4.0:compile > [INFO] | | | \- org.apache.curator:curator-client:jar:2.4.0:compile > [INFO] | | \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile > [INFO] | | \- jline:jline:jar:0.9.94:compile > [INFO] | +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile > [INFO] | | +- > org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile > [INFO] | | +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile > [INFO] | | | +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile > [INFO] | | | \- > org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile > [INFO] | | \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile > [INFO] | | \- > org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile > [INFO] | |\- > org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile > [INFO] | +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile > [INFO] | +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile > [INFO] | | +- > org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile > [INFO] | | +- > org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile > [INFO] | | \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile > [INFO] | | \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile > [INFO] | +- com.google.guava:guava:jar:14.0.1:compile > [INFO] | +- org.apache.commons:commons-lang3:jar:3.3.2:compile > [INFO] | +- com.google.code.findbugs:jsr305:jar:1.3.9:compile > [INFO] | +- org.slf4j:slf4j-api:jar:1.7.5:compile > [INFO] | +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile > [INFO] | +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile > [INFO] | +- log4j:log4j:jar:1.2.17:compile > [INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile > [INFO] | +- com.ning:compress-lzf:jar:1.0.0:compile > [INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.5:compile > [INFO] | +- com.twitter:chill_2.10:jar:0.3.6:compile > [INFO] | | \- com.esotericsoftware.kryo:kryo:jar:2.21:compile > [INFO] | | +- > com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile > [INFO] | | +- com.esotericsoftware.minlog:minlog:jar:1.2:compile > [INFO] | | \- org.objenesis:objenesis:jar:1.2:compile > [INFO] | +- com.twitter:chill-java:jar:0.3.6:compile > [INFO] | +- commons-net:commons-net:jar:2.2:compile > [INFO] | +- > org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile > [INFO] | | +- > org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile > [INFO] | | | \- com.typesafe:config:jar:1.0.2:compile > [INFO] | | +- io.netty:netty:jar:3.6.6.Final:compile > [INFO] | | +- > org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile > [INFO] | | \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile > [INFO] | +- > org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile > [INFO] | +- org.scala-lang:scala-library:jar:2.10.4:compile > [INFO] | +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile > [INFO] | | +- org.json4s:json4s-core_2.10:jar:3.2.6:compile > [INFO] | | | +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile > [INFO] | | | +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile > [INFO] | | | \- org.scala-lang:scalap:jar:2.10.0:compile > [INFO] | | | \- org.scala-lang:scala-compiler:jar:2.10.0:compile > [INFO] | | |\- org.scala-lang:scala-reflect:jar:2.10.0:compile > [INFO] | | \- > com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile > [INFO] | | +- > com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile > [INFO] | | \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile > [INFO] | +- colt:colt:jar:1.2.0:compile > [INFO] | | \- concurrent:concurrent:jar:1.3.4:compile > [INFO] | +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile > [INFO] | +- io.netty:netty-all:jar:4.0.17.Final:compile > [INFO] | +- com.clearspring.analytics:stream:jar:2.5.1:compile > [INFO] | +- com.codahale.metrics:metrics-core:jar:3.0.0:compile > [INFO] | +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile > [INFO] | +- com.codahale.metrics:metrics-json:jar:3.0.0:compile > [INFO] | +- com.codahale.metrics:metrics-graphite:jar:3.0.0:compile > [INFO] | +- org.tachyonproject:tachyon:jar:0.4.1-thrift:compile > [INFO] | | +- org.apache.ant:ant:jar:1.9.0:compile > [
Re: Spark 1.0.0 Maven dependencies problems.
I am using Maven from Eclipse dependency:tree shows [INFO] +- org.apache.spark:spark-core_2.10:jar:1.0.0:compile [INFO] | +- net.java.dev.jets3t:jets3t:jar:0.7.1:runtime [INFO] | +- org.apache.curator:curator-recipes:jar:2.4.0:compile [INFO] | | +- org.apache.curator:curator-framework:jar:2.4.0:compile [INFO] | | | \- org.apache.curator:curator-client:jar:2.4.0:compile [INFO] | | \- org.apache.zookeeper:zookeeper:jar:3.4.5:compile [INFO] | | \- jline:jline:jar:0.9.94:compile [INFO] | +- org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031:compile [INFO] | | +- org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645:compile [INFO] | | +- org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031:compile [INFO] | | | +- org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031:compile [INFO] | | | \- org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031:compile [INFO] | | \- org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031:compile [INFO] | | \- org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020:compile [INFO] | |\- org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233:compile [INFO] | +- org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031:compile [INFO] | +- org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031:compile [INFO] | | +- org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016:compile [INFO] | | +- org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031:compile [INFO] | | \- org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031:compile [INFO] | | \- org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031:compile [INFO] | +- com.google.guava:guava:jar:14.0.1:compile [INFO] | +- org.apache.commons:commons-lang3:jar:3.3.2:compile [INFO] | +- com.google.code.findbugs:jsr305:jar:1.3.9:compile [INFO] | +- org.slf4j:slf4j-api:jar:1.7.5:compile [INFO] | +- org.slf4j:jul-to-slf4j:jar:1.7.5:compile [INFO] | +- org.slf4j:jcl-over-slf4j:jar:1.7.5:compile [INFO] | +- log4j:log4j:jar:1.2.17:compile [INFO] | +- org.slf4j:slf4j-log4j12:jar:1.7.5:compile [INFO] | +- com.ning:compress-lzf:jar:1.0.0:compile [INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.5:compile [INFO] | +- com.twitter:chill_2.10:jar:0.3.6:compile [INFO] | | \- com.esotericsoftware.kryo:kryo:jar:2.21:compile [INFO] | | +- com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile [INFO] | | +- com.esotericsoftware.minlog:minlog:jar:1.2:compile [INFO] | | \- org.objenesis:objenesis:jar:1.2:compile [INFO] | +- com.twitter:chill-java:jar:0.3.6:compile [INFO] | +- commons-net:commons-net:jar:2.2:compile [INFO] | +- org.spark-project.akka:akka-remote_2.10:jar:2.2.3-shaded-protobuf:compile [INFO] | | +- org.spark-project.akka:akka-actor_2.10:jar:2.2.3-shaded-protobuf:compile [INFO] | | | \- com.typesafe:config:jar:1.0.2:compile [INFO] | | +- io.netty:netty:jar:3.6.6.Final:compile [INFO] | | +- org.spark-project.protobuf:protobuf-java:jar:2.4.1-shaded:compile [INFO] | | \- org.uncommons.maths:uncommons-maths:jar:1.2.2a:compile [INFO] | +- org.spark-project.akka:akka-slf4j_2.10:jar:2.2.3-shaded-protobuf:compile [INFO] | +- org.scala-lang:scala-library:jar:2.10.4:compile [INFO] | +- org.json4s:json4s-jackson_2.10:jar:3.2.6:compile [INFO] | | +- org.json4s:json4s-core_2.10:jar:3.2.6:compile [INFO] | | | +- org.json4s:json4s-ast_2.10:jar:3.2.6:compile [INFO] | | | +- com.thoughtworks.paranamer:paranamer:jar:2.6:compile [INFO] | | | \- org.scala-lang:scalap:jar:2.10.0:compile [INFO] | | | \- org.scala-lang:scala-compiler:jar:2.10.0:compile [INFO] | | |\- org.scala-lang:scala-reflect:jar:2.10.0:compile [INFO] | | \- com.fasterxml.jackson.core:jackson-databind:jar:2.3.0:compile [INFO] | | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0:compile [INFO] | | \- com.fasterxml.jackson.core:jackson-core:jar:2.3.0:compile [INFO] | +- colt:colt:jar:1.2.0:compile [INFO] | | \- concurrent:concurrent:jar:1.3.4:compile [INFO] | +- org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1:compile [INFO] | +- io.netty:netty-all:jar:4.0.17.Final:compile [INFO] | +- com.clearspring.analytics:stream:jar:2.5.1:compile [INFO] | +- com.codahale.metrics:metrics-core:jar:3.0.0:compile [INFO] | +- com.codahale.metrics:metrics-jvm:jar:3.0.0:compile [INFO] | +- com.codahale.metrics:metrics-json:jar:3.0.0:compile [INFO] | +- com.codahale.metrics:metrics-graphite:jar:3.0.0:compile [INFO] | +- org.tachyonproject:tachyon:jar:0.4.1-thrift:compile [INFO] | | +- org.apache.ant:ant:jar:1.9.0:compile [INFO] | | | \- org.apache.ant:ant-launcher:jar:1.9.0:compile [INFO] | | \- commons-io:commons-io:jar:2.4:compile [INFO] | +- org.spark-project:pyrolite:jar:2.0.1:compile [INFO] | \- net.sf.py4j:py4j:jar:0.8.1:compile [INFO] +- org.apache.hadoop:hadoop-client:jar:2.4.0:compile [INFO] | +- org.apache.hadoop:hadoop-common:jar:2.4.0:compile [INFO] | | +- org.apache.commons:commons-math3:jar:3.1.1:compile [INFO]
Re: Spark 1.0.0 Maven dependencies problems.
On the surface it sounds again like https://issues.apache.org/jira/browse/SPARK-1949 but not sure it's exactly the same problem. The build exclusions are intended to remove dependency on the old Netty artifact. I think the Maven build has it sorted out though. Are you using Maven? if so what do you see in mvn dependency:tree -- where does it turn up? On Mon, Jun 9, 2014 at 9:34 AM, toivoa wrote: > Using > > org.apache.spark > spark-core_2.10 > 1.0.0 > > > I can create simple test and run under Eclipse. > But when I try to deploy on test server I have dependencies problems. > > 1. Spark requires > akka-remote_2.10 > 2.2.3-shaded-protobuf > > And this in turn requires > > > io.netty > netty > 3.6.6.Final > > > 2. At the same time Spark itself requires > netty-parent > 4.0.17.Final > > So now I have different Netty versions and I get either > > Exception in thread "main" java.lang.SecurityException: class > "javax.servlet.FilterRegistration"'s signer information does not match > signer information of other classes in the same package > > When using 3.6.6.Final > > > Or > > 14/06/09 16:08:10 ERROR ActorSystemImpl: Uncaught fatal error from thread > [spark-akka.actor.default-dispatcher-4] shutting down ActorSystem [spark] > java.lang.NoClassDefFoundError: org/jboss/netty/util/Timer > > When using 4.0.17.Final > > > > What I am doing wrong and how to solve problem? > > Thanks > toivo > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-0-0-Maven-dependencies-problems-tp7247.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.