Re: Submitting with --deploy-mode cluster: uploading the jar

2015-10-01 Thread Christophe Schmitz
7 > --deploy-mode cluster --class org.apache.spark.examples.SparkPi > examples/target/scala-2.10/spark-examples-1.5.1-hadoop2.7.1.jar > > Seems Spark will upload this examples jar automatically, don't need to > handle it manually. > > Thanks > Saisai > > > > On Thu, Oct 1, 2015 at 8:36

Submitting with --deploy-mode cluster: uploading the jar

2015-09-30 Thread Christophe Schmitz
Hi there, I am trying to use the "--deploy-mode cluster" option to submit my job (spark 1.4.1). When I do that, the spark-driver (on the cluster) is looking for my application jar. I can manually copy my application jar on all the workers, but I was wondering if there is a way to submit the

Re: Submitting with --deploy-mode cluster: uploading the jar

2015-09-30 Thread Christophe Schmitz
wrote: > As I remembered you don't need to upload application jar manually, Spark > will do it for you when you use Spark submit. Would you mind posting out > your command of Spark submit? > > > On Wed, Sep 30, 2015 at 3:13 PM, Christophe Schmitz <cofcof...@gmail.com> >