Re: Unable to run Spark Jobs in yarn cluster mode

Thanks Vadim! Sent from my iPhone > On 10-Oct-2017, at 11:09 PM, Vadim Semenov > wrote: > > Try increasing the `spark.yarn.am.waitTime` parameter, it's by default set to > 100ms which might not be enough in certain cases. > >> On Tue, Oct 10, 2017 at 7:02 AM,

Re: Unable to run Spark Jobs in yarn cluster mode

Try increasing the `spark.yarn.am.waitTime` parameter, it's by default set to 100ms which might not be enough in certain cases. On Tue, Oct 10, 2017 at 7:02 AM, Debabrata Ghosh wrote: > Hi All, > I am constantly hitting an error : "ApplicationMaster: >

Unable to run Spark Jobs in yarn cluster mode

Hi All, I am constantly hitting an error : "ApplicationMaster: SparkContext did not initialize after waiting for 100 ms" while running my Spark code in yarn cluster mode. Here is the command what I am using :* spark-submit --master yarn --deploy-mode cluster spark_code.py*