hi guys, can someone explain or give the stupid user like me a link where i can get the right usage of sbt and spark in order to run the examples as a stand alone app
I got to the point running the app by sbt "run path-to-the-data" but still get some error because i probably didnt tell the app that the master is local (--master local) in the SparkContext method in the BinaryClassification.scala programm it is set by val conf = new SparkConf().setAppName(s"BinaryClassification with $params") so... how to adapt the code in the docu it is written val sc = new SparkContext("local", "Simple App", "YOUR_SPARK_HOME", List("target/scala-2.10/simple-project_2.10-1.0.jar")) I got the following error sbt "run ~/git/spark/data/mllib/sample_binary_classification_data.txt" [info] Set current project to Simple Project (in build file:/home/filip/spark-sample/) [info] Running BinaryClassification ~/git/spark/data/mllib/sample_binary_classification_data.txt [error] (run-main-0) org.apache.spark.SparkException: A master URL must be set in your configuration org.apache.spark.SparkException: A master URL must be set in your configuration at org.apache.spark.SparkContext.<init>(SparkContext.scala:166) at BinaryClassification$.run(BinaryClassification.scala:107) at BinaryClassification$$anonfun$main$1.apply(BinaryClassification.scala:99) at BinaryClassification$$anonfun$main$1.apply(BinaryClassification.scala:98) at scala.Option.map(Option.scala:145) at BinaryClassification$.main(BinaryClassification.scala:98) at BinaryClassification.main(BinaryClassification.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) [trace] Stack trace suppressed: run last compile:run for the full output. java.lang.RuntimeException: Nonzero exit code: 1 at scala.sys.package$.error(package.scala:27) [trace] Stack trace suppressed: run last compile:run for the full output. [error] (compile:run) Nonzero exit code: 1 [error] Total time: 7 s, completed Aug 28, 2014 11:04:44 AM -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/sbt-package-assembly-run-spark-examples-tp13000.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org