Hi, Thanks for your response, that really helped.
However, I don't believe the job is being submitted. When I run spark from the shell, I don't need to start it up explicitly. Do I need to start up Spark on my machine before running this program? I see the following in the SPARK_HOME\bin directory: Name ---- beeline.cmd load-spark-env.cmd pyspark.cmd pyspark2.cmd run-example.cmd run-example2.cmd spark-class.cmd spark-class2.cmd spark-shell.cmd spark-shell2.cmd spark-submit.cmd spark-submit2.cmd sparkR.cmd sparkR2.cmd Do I need to run anyone of them before submitting the job via the program? Thanks & regards Arko On Fri, Feb 19, 2016 at 6:01 PM, Holden Karau <hol...@pigscanfly.ca> wrote: > How are you trying to launch your application? Do you have the Spark jars on > your class path? > > > On Friday, February 19, 2016, Arko Provo Mukherjee > <arkoprovomukher...@gmail.com> wrote: >> >> Hello, >> >> I am trying to submit a spark job via a program. >> >> When I run it, I receive the following error: >> Exception in thread "Thread-1" java.lang.NoClassDefFoundError: >> org/apache/spark/launcher/SparkLauncher >> at Spark.SparkConnector.run(MySpark.scala:33) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: java.lang.ClassNotFoundException: >> org.apache.spark.launcher.SparkLauncher >> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) >> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) >> ... 2 more >> >> It seems it cannot find the SparkLauncher class. Any clue to what I am >> doing wrong? >> >> Thanks & regards >> Arko >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> > > > -- > Cell : 425-233-8271 > Twitter: https://twitter.com/holdenkarau > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
