Fixed by adding 2 configurations in yarn-site,xml.
Thanks all!
On Fri, Jun 8, 2018 at 2:44 PM, Aakash Basu
wrote:
> Hi,
>
> I fixed that problem by putting all the Spark JARS in spark-archive.zip
> and putting it in the HDFS (as that problem was happening for that reason) -
>
> But, I'm facing
Hi,
I fixed that problem by putting all the Spark JARS in spark-archive.zip and
putting it in the HDFS (as that problem was happening for that reason) -
But, I'm facing a new issue now, this is the new RPC error I get
(Stack-Trace below) -
2018-06-08 14:26:43 WARN NativeCodeLoader:62 -
In Spark on YARN, error code 13 means SparkContext doesn't initialize in
time. You can check the yarn application log to get more information.
BTW, did you just write a plain python script without creating
SparkContext/SparkSession?
Aakash Basu 于2018年6月8日周五 下午4:15写道：
> Hi,
>
> I'm trying to
Hi,
I'm trying to run a program on a cluster using YARN.
YARN is present there along with HADOOP.
Problem I'm running into is as below -
Container exited with a non-zero exit code 13
> Failing this attempt. Failing the application.
> ApplicationMaster host: N/A
> ApplicationMaster
