Re: Job failed while submitting python to yarn programatically

cc| |user <user@spark.apache.org> | | Subject| | Re: Job failed while subm

Re: Job failed while submitting python to yarn programatically

You cannot directly invoke Spark application by using yarn#client like what you mentioned, it is deprecated and not supported. you have to use spark-submit to submit a Spark application to yarn. Also here the specific problem is that you're invoking yarn#client to run spark app as yarn-client

Re: Job failed while submitting python to yarn programatically

Could you try yarn-cluster mode ? Make sure your cluster nodes can reach your client machine and no firewall. On Wed, Mar 16, 2016 at 10:54 AM, wrote: > > Hi all, > > We're trying to submit a python file, pi.py in this case, to yarn from java > code but this kept