My job runs fine in yarn cluster mode but I have reason to use client mode instead. But I'm hitting this error when submitting: > spark-submit --class com.exabeam.martini.scripts.SparkStreamingTest --master > yarn --deploy-mode client --executor-memory 90G --num-executors 3 > --executor-cores 14 Martini-assembly-0.1.jar yarn-client
Error: Could not find or load main class org.apache.spark.deploy.SparkSubmitDriverBootstrapper If I replace deploy-mode to cluster the job is submitted successfully. Is there a dependency missing from my project? Right now only one I included is spark-streaming 1.6.0.