Hi, What is your SBT command and the parameters?
Arthur On 10 Sep, 2014, at 6:46 pm, Thorsten Bergler <[email protected]> wrote: > Hello, > > I am writing a Spark App which is already working so far. > Now I started to build also some UnitTests, but I am running into some > dependecy problems and I cannot find a solution right now. Perhaps someone > could help me. > > I build my Spark Project with SBT and it seems to be configured well, because > compiling, assembling and running the built jar with spark-submit are working > well. > > Now I started with the UnitTests, which I located under /src/test/scala. > > When I call "test" in sbt, I get the following: > > 14/09/10 12:22:06 INFO storage.BlockManagerMaster: Registered BlockManager > 14/09/10 12:22:06 INFO spark.HttpServer: Starting HTTP Server > [trace] Stack trace suppressed: run last test:test for the full output. > [error] Could not run test test.scala.SetSuite: > java.lang.NoClassDefFoundError: javax/servlet/http/HttpServletResponse > [info] Run completed in 626 milliseconds. > [info] Total number of tests run: 0 > [info] Suites: completed 0, aborted 0 > [info] Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0 > [info] All tests passed. > [error] Error during tests: > [error] test.scala.SetSuite > [error] (test:test) sbt.TestsFailedException: Tests unsuccessful > [error] Total time: 3 s, completed 10.09.2014 12:22:06 > > last test:test gives me the following: > > > last test:test > [debug] Running TaskDef(test.scala.SetSuite, > org.scalatest.tools.Framework$$anon$1@6e5626c8, false, [SuiteSelector]) > java.lang.NoClassDefFoundError: javax/servlet/http/HttpServletResponse > at org.apache.spark.HttpServer.start(HttpServer.scala:54) > at > org.apache.spark.broadcast.HttpBroadcast$.createServer(HttpBroadcast.scala:156) > at > org.apache.spark.broadcast.HttpBroadcast$.initialize(HttpBroadcast.scala:127) > at > org.apache.spark.broadcast.HttpBroadcastFactory.initialize(HttpBroadcastFactory.scala:31) > at > org.apache.spark.broadcast.BroadcastManager.initialize(BroadcastManager.scala:48) > at > org.apache.spark.broadcast.BroadcastManager.<init>(BroadcastManager.scala:35) > at org.apache.spark.SparkEnv$.create(SparkEnv.scala:218) > at org.apache.spark.SparkContext.<init>(SparkContext.scala:202) > at test.scala.SetSuite.<init>(SparkTest.scala:16) > > I also noticed right now, that sbt run is also not working: > > 14/09/10 12:44:46 INFO spark.HttpServer: Starting HTTP Server > [error] (run-main-2) java.lang.NoClassDefFoundError: > javax/servlet/http/HttpServletResponse > java.lang.NoClassDefFoundError: javax/servlet/http/HttpServletResponse > at org.apache.spark.HttpServer.start(HttpServer.scala:54) > at > org.apache.spark.broadcast.HttpBroadcast$.createServer(HttpBroadcast.scala:156) > at > org.apache.spark.broadcast.HttpBroadcast$.initialize(HttpBroadcast.scala:127) > at > org.apache.spark.broadcast.HttpBroadcastFactory.initialize(HttpBroadcastFactory.scala:31) > at > org.apache.spark.broadcast.BroadcastManager.initialize(BroadcastManager.scala:48) > at > org.apache.spark.broadcast.BroadcastManager.<init>(BroadcastManager.scala:35) > at org.apache.spark.SparkEnv$.create(SparkEnv.scala:218) > at org.apache.spark.SparkContext.<init>(SparkContext.scala:202) > at > main.scala.PartialDuplicateScanner$.main(PartialDuplicateScanner.scala:29) > at main.scala.PartialDuplicateScanner.main(PartialDuplicateScanner.scala) > > Here is my Testprojekt.sbt file: > > name := "Testprojekt" > > version := "1.0" > > scalaVersion := "2.10.4" > > libraryDependencies ++= { > Seq( > "org.apache.lucene" % "lucene-core" % "4.9.0", > "org.apache.lucene" % "lucene-analyzers-common" % "4.9.0", > "org.apache.lucene" % "lucene-queryparser" % "4.9.0", > ("org.apache.spark" %% "spark-core" % "1.0.2"). > exclude("org.mortbay.jetty", "servlet-api"). > exclude("commons-beanutils", "commons-beanutils-core"). > exclude("commons-collections", "commons-collections"). > exclude("commons-collections", "commons-collections"). > exclude("com.esotericsoftware.minlog", "minlog"). > exclude("org.eclipse.jetty.orbit", "javax.mail.glassfish"). > exclude("org.eclipse.jetty.orbit", "javax.transaction"). > exclude("org.eclipse.jetty.orbit", "javax.servlet") > ) > } > > resolvers += "Akka Repository" at "http://repo.akka.io/releases/"; > > > > > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
