Fixed by adding 2 configurations in yarn-site,xml.
Thanks all!
On Fri, Jun 8, 2018 at 2:44 PM, Aakash Basu
wrote:
> Hi,
>
> I fixed that problem by putting all the Spark JARS in spark-archive.zip
> and putting it in the HDFS (as that problem was happening for that reason) -
>
> But, I'm
Hi,
I fixed that problem by putting all the Spark JARS in spark-archive.zip and
putting it in the HDFS (as that problem was happening for that reason) -
But, I'm facing a new issue now, this is the new RPC error I get
(Stack-Trace below) -
2018-06-08 14:26:43 WARN NativeCodeLoader:62 -
It seems, your spark-on-yarn application is not able to get it's
application master,
org.apache.spark.SparkException: Yarn application has already ended!
It might have been killed or unable to launch application master.
Check once on yarn logs
Thanks,
Sathish-
On Fri, Jun 8, 2018 at 2:22 PM,
Check the yarn AM log for details.
Aakash Basu 于2018年6月8日周五 下午4:36写道：
> Hi,
>
> Getting this error when trying to run Spark Shell using YARN -
>
> Command: *spark-shell --master yarn --deploy-mode client*
>
> 2018-06-08 13:39:09 WARN Client:66 - Neither spark.yarn.jars nor
>
Hi,
Getting this error when trying to run Spark Shell using YARN -
Command: *spark-shell --master yarn --deploy-mode client*
2018-06-08 13:39:09 WARN Client:66 - Neither spark.yarn.jars nor
spark.yarn.archive is set, falling back to uploading libraries under
SPARK_HOME.
2018-06-08 13:39:25
