To: Sun, Rui; user@spark.apache.org
Subject: Re: Connecting SparkR through Yarn
Hi Sun,
Thank you for reply.
I did the same, but now I am getting another issue.
i.e: Not able to connect to ResourceManager after submitting the job
the Error message showing something like this
Connecting
Amit,
You can simply set “MASTER” as “yarn-client” before calling sparkR.init().
Sys.setenv("MASTER"="yarn-client")
I assume that you have set “YARN_CONF_DIR” env variable required for running
Spark on YARN.
If you want to set more YARN specific configurations, you can for example
Sys.setenv