Re: PermGen space Error

2016-08-03 Thread $iddhe$h Divekar
I am running the spark job in yarn-client mode. On Wed, Aug 3, 2016 at 8:14 PM, $iddhe$h Divekar wrote: > Hi, > > I am running spark jobs using apache oozie. > My job.properties has sparkConf which gets used in workflow.xml. > > I have tried increasing MaxPermSize

PermGen space Error

2016-08-03 Thread $iddhe$h Divekar
Hi, I am running spark jobs using apache oozie. My job.properties has sparkConf which gets used in workflow.xml. I have tried increasing MaxPermSize using sparkConf in job.properties but that is not resolving the issue. *sparkConf*=--verbose --driver-java-options '-XX:MaxPermSize=8192M' --conf

PermGen Space Error

2015-07-29 Thread Sarath Chandra
parameters and properties files and then calls the above scala program). *I'm getting PermGen Space error when it hits the last line to print the count.* I'm printing to console the generated hive queries from the scala program. When I run the same from a spark shell it works fine. As mentioned

Re: PermGen Space Error

2015-07-29 Thread fightf...@163.com
Hi, Sarath Did you try to use and increase spark.excecutor.extraJaveOptions -XX:PermSize= -XX:MaxPermSize= fightf...@163.com From: Sarath Chandra Date: 2015-07-29 17:39 To: user@spark.apache.org Subject: PermGen Space Error Dear All, I'm using - = Spark 1.2.0 = Hive 0.13.1 = Mesos

Re: PermGen Space Error

2015-07-29 Thread Sarath Chandra
sarathchandra.jos...@algofusiontech.com *Date:* 2015-07-29 17:39 *To:* user@spark.apache.org *Subject:* PermGen Space Error Dear All, I'm using - = Spark 1.2.0 = Hive 0.13.1 = Mesos 0.18.1 = Spring = JDK 1.7 I've written a scala program which = instantiates a spark and hive

Re: PermGen Space Error

2015-07-29 Thread Sean Owen
wrote: Hi, Sarath Did you try to use and increase spark.excecutor.extraJaveOptions -XX:PermSize= -XX:MaxPermSize= fightf...@163.com From: Sarath Chandra Date: 2015-07-29 17:39 To: user@spark.apache.org Subject: PermGen Space Error Dear All, I'm using

Re: PermGen Space Error

2015-07-29 Thread Sarath Chandra
Did you try to use and increase spark.excecutor.extraJaveOptions -XX:PermSize= -XX:MaxPermSize= fightf...@163.com From: Sarath Chandra Date: 2015-07-29 17:39 To: user@spark.apache.org Subject: PermGen Space Error Dear All, I'm using