Hi all, I had some trouble compiling an application (Shark) against Spark 1.0, where Shark had a runtime exception (at the bottom of this message) because it couldn't find the javax.servlet classes. SBT seemed to have trouble downloading the servlet APIs that are dependencies of Jetty (used by the Spark web UI), so I had to manually add them to the application's build file:
libraryDependencies += "org.mortbay.jetty" % "servlet-api" % "3.0.20100224" Not exactly sure why this happens but thought it might be useful in case others run into the same problem. -Kay ------------- Exception in thread "main" java.lang.NoClassDefFoundError: javax/servlet/FilterRegistration at org.eclipse.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:136) at org.eclipse.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:129) at org.eclipse.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:98) at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:98) at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:89) at org.apache.spark.ui.WebUI.attachPage(WebUI.scala:64) at org.apache.spark.ui.WebUI$anonfun$attachTab$1.apply(WebUI.scala:57) at org.apache.spark.ui.WebUI$anonfun$attachTab$1.apply(WebUI.scala:57) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) at org.apache.spark.ui.WebUI.attachTab(WebUI.scala:57) at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:66) at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:60) at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:42) at org.apache.spark.SparkContext.<init>(SparkContext.scala:222) at org.apache.spark.SparkContext.<init>(SparkContext.scala:85) at shark.SharkContext.<init>(SharkContext.scala:42) at shark.SharkContext.<init>(SharkContext.scala:61) at shark.SharkEnv$.initWithSharkContext(SharkEnv.scala:78) at shark.SharkEnv$.init(SharkEnv.scala:38) at shark.SharkCliDriver.<init>(SharkCliDriver.scala:280) at shark.SharkCliDriver$.main(SharkCliDriver.scala:162) at shark.SharkCliDriver.main(SharkCliDriver.scala) Caused by: java.lang.ClassNotFoundException: javax.servlet.FilterRegistration at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 23 more
