I am running the spark job in yarn-client mode.
On Wed, Aug 3, 2016 at 8:14 PM, $iddhe$h Divekar wrote:
> Hi,
>
> I am running spark jobs using apache oozie.
> My job.properties has sparkConf which gets used in workflow.xml.
>
> I have tried increasing MaxPermSize
Hi,
I am running spark jobs using apache oozie.
My job.properties has sparkConf which gets used in workflow.xml.
I have tried increasing MaxPermSize using sparkConf in job.properties
but that is not resolving the issue.
*sparkConf*=--verbose --driver-java-options '-XX:MaxPermSize=8192M' --conf
parameters and properties files and then calls the above scala
program).
*I'm getting PermGen Space error when it hits the last line to print the
count.*
I'm printing to console the generated hive queries from the scala program.
When I run the same from a spark shell it works fine.
As mentioned
Hi, Sarath
Did you try to use and increase spark.excecutor.extraJaveOptions -XX:PermSize=
-XX:MaxPermSize=
fightf...@163.com
From: Sarath Chandra
Date: 2015-07-29 17:39
To: user@spark.apache.org
Subject: PermGen Space Error
Dear All,
I'm using -
= Spark 1.2.0
= Hive 0.13.1
= Mesos
sarathchandra.jos...@algofusiontech.com
*Date:* 2015-07-29 17:39
*To:* user@spark.apache.org
*Subject:* PermGen Space Error
Dear All,
I'm using -
= Spark 1.2.0
= Hive 0.13.1
= Mesos 0.18.1
= Spring
= JDK 1.7
I've written a scala program which
= instantiates a spark and hive
wrote:
Hi, Sarath
Did you try to use and increase spark.excecutor.extraJaveOptions
-XX:PermSize= -XX:MaxPermSize=
fightf...@163.com
From: Sarath Chandra
Date: 2015-07-29 17:39
To: user@spark.apache.org
Subject: PermGen Space Error
Dear All,
I'm using
Did you try to use and increase spark.excecutor.extraJaveOptions
-XX:PermSize= -XX:MaxPermSize=
fightf...@163.com
From: Sarath Chandra
Date: 2015-07-29 17:39
To: user@spark.apache.org
Subject: PermGen Space Error
Dear All,
I'm using