Spark Master Build Failing to run on cluster in standalone ClassNotFoundException: javax.servlet.FilterRegistration

[Night Wolf]

Hi,

I just built Spark 1.3 master using maven via make-distribution.sh;

./make-distribution.sh --name mapr3 --skip-java-test --tgz -Pmapr3 -Phive
-Phive-thriftserver -Phive-0.12.0

When trying to start the standalone spark master on a cluster I get the
following stack trace;


15/02/04 08:53:56 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/02/04 08:53:56 INFO Remoting: Starting remoting
15/02/04 08:53:56 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkMaster@hadoop-009:7077]
15/02/04 08:53:56 INFO Remoting: Remoting now listens on addresses:
[akka.tcp://sparkMaster@hadoop-009:7077]
...skipping...
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at akka.util.Reflect$.instantiate(Reflect.scala:66)
        at akka.actor.ArgsReflectConstructor.produce(Props.scala:352)
        at akka.actor.Props.newActor(Props.scala:252)
        at akka.actor.ActorCell.newActor(ActorCell.scala:552)
        at akka.actor.ActorCell.create(ActorCell.scala:578)
        ... 9 more
Caused by: java.lang.NoClassDefFoundError: javax/servlet/FilterRegistration
        at
org.spark-project.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:136)
        at
org.spark-project.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:129)
        at
org.spark-project.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:98)
        at
org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:96)
        at
org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:87)
        at org.apache.spark.ui.WebUI.attachPage(WebUI.scala:67)
        at
org.apache.spark.deploy.master.ui.MasterWebUI.initialize(MasterWebUI.scala:40)
        at
org.apache.spark.deploy.master.ui.MasterWebUI.<init>(MasterWebUI.scala:36)
        at org.apache.spark.deploy.master.Master.<init>(Master.scala:95)
        ... 18 more
Caused by: java.lang.ClassNotFoundException:
javax.servlet.FilterRegistration
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
        ... 27 more

The distro seems about the right size (260MB, so I dont imagine any of the
libraries are missing. The above command worked on 1.2...

Any ideas whats going wrong?

Cheers,
N