Re: Running a spark code using submit job in google cloud platform

2017-01-13 Thread Anahita Talebi
Hello, Thanks a lot Dinko. Yes, now it is working perfectly. Cheers, Anahita On Fri, Jan 13, 2017 at 2:19 PM, Dinko Srkoč wrote: > On 13 January 2017 at 13:55, Anahita Talebi > wrote: > > Hi, > > > > Thanks for your answer. > > > > I have

Re: Running a spark code using submit job in google cloud platform

2017-01-13 Thread Dinko Srkoč
On 13 January 2017 at 13:55, Anahita Talebi wrote: > Hi, > > Thanks for your answer. > > I have chose "Spark" in the "job type". There is not any option where we can > choose the version. How I can choose different version? There's "Preemptible workers, bucket,

Re: Running a spark code using submit job in google cloud platform

2017-01-13 Thread Anahita Talebi
Hi, Thanks for your answer. I have chose "Spark" in the "job type". There is not any option where we can choose the version. How I can choose different version? Thanks, Anahita On Thu, Jan 12, 2017 at 6:39 PM, A Shaikh wrote: > You may have tested this code on Spark

Re: Running a spark code using submit job in google cloud platform

2017-01-12 Thread A Shaikh
You may have tested this code on Spark version on your local machine version of which may be different to whats in Google Cloud Storage. You need to select appropraite Spark version when you submit your job. On 12 January 2017 at 15:51, Anahita Talebi wrote: > Dear

Running a spark code using submit job in google cloud platform

2017-01-12 Thread Anahita Talebi
Dear all, I am trying to run a .jar file as a job using submit job in google cloud console. https://cloud.google.com/dataproc/docs/guides/submit-job I actually ran the spark code on my local computer to generate a .jar file. Then in the Argument folder, I give the value of the arguments that I