Hi, We have been using standalone spark for last 6 months and I used to run application jars fine on spark cluster with the following command.
java -cp ":/app/data/spark_deploy/conf:/app/data/spark_deploy/lib/spark-assembly-1.0.0-SNAPSHOT-hadoop2.0.0-mr1-cdh4.5.0.jar:./app.jar" -Xms2g -Xmx2g -Dspark.cores.max=16 -Dspark.executor.memory=16g SparkApp sparkMaster jobOptions Note that I was waiting for scripts like spark-submit which are available now with 1.0 release... We are now trying to run these jobs on Spark deployed by CDH manager and similar bare bones java command does not run any more.. Is there any documentation from cloudera on how to run Spark apps on CDH Manager deployed Spark ? I see there has been changes to the script that I have been used to through the spark git... Thanks. Deb
