Try increasing the `spark.yarn.am.waitTime` parameter, it's by default set to 100ms which might not be enough in certain cases.
On Tue, Oct 10, 2017 at 7:02 AM, Debabrata Ghosh <mailford...@gmail.com> wrote: > Hi All, > I am constantly hitting an error : "ApplicationMaster: > SparkContext did not initialize after waiting for 100 ms" while running my > Spark code in yarn cluster mode. > > Here is the command what I am using :* spark-submit --master yarn > --deploy-mode cluster spark_code.py* > > Please can you help me with a resolution at your > convenience. > > Thanks in advance ! > > Cheers, > > Debu > > >
