Maybe you don't enabled Yarn when build Spark.
On Mon, Dec 30, 2013 at 8:36 AM, Liu, Raymond <raymond....@intel.com> wrote: > Hi Izhar > > Is that the exact command you are running? Say with 0.8.0 instead > of 0.8.1 in the cmd? > > Raymond Liu > > From: Izhar ul Hassan [mailto:ezh...@gmail.com] > Sent: Friday, December 27, 2013 9:40 PM > To: user@spark.incubator.apache.org > Subject: Errors with spark-0.8.1 hadoop-yarn 2.2.0 > > Hi, > I have a 3 node installation of hadoop 2.2.0 with yarn. I have installed > spark-0.8.1 with support for spark enabled. I get the following errors when > trying to run the examples: > SPARK_JAR=./assembly/target/scala-2.9.3/spark-assembly-0.8.0-incubating-hadoop2.0.5-alpha.jar > \ > ./spark-class org.apache.spark.deploy.yarn.Client \ > --jar > examples/target/scala-2.9.3/spark-examples-assembly-0.8.0-incubating.jar \ > --class org.apache.spark.examples.SparkPi \ > --args yarn-standalone \ > --num-workers 3 \ > --master-memory 4g \ > --worker-memory 2g \ > --worker-cores 1 > > Exception in thread "main" java.lang.NoClassDefFoundError: > org/apache/spark/deploy/yarn/Client > Caused by: java.lang.ClassNotFoundException: > org.apache.spark.deploy.yarn.Client > at java.net.URLClassLoader$1.run(URLClassLoader.java:217) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:205) > at java.lang.ClassLoader.loadClass(ClassLoader.java:323) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) > at java.lang.ClassLoader.loadClass(ClassLoader.java:268) > Could not find the main class: org.apache.spark.deploy.yarn.Client. > Program will exit. > spark-0.8.0 with hadooop 2.0.5-alpha works fine. > -- > /Izhar >
