Do you put your app jar on hdfs ? The app jar must be on your local machine.
On Tue, May 17, 2016 at 8:33 PM, Serega Sheypak <serega.shey...@gmail.com> wrote: > hi, I'm trying to: > 1. upload my app jar files to HDFS > 2. run spark-submit with: > 2.1. --master yarn --deploy-mode cluster > or > 2.2. --master yarn --deploy-mode client > > specifying --jars hdfs:///my/home/commons.jar,hdfs:///my/home/super.jar > > When spark job is submitted, SparkSubmit client outputs: > Warning: Skip remote jar hdfs:///user/baba/lib/akka-slf4j_2.11-2.3.11.jar > ... > > and then spark application main class fails with class not found exception. > Is there any workaround? > -- Best Regards Jeff Zhang
