Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-16 Thread Attila Csordas
On Mon, Oct 8, 2012 at 4:29 PM, Arpit Gupta wrote: > > i would recommended using the oracle jdk. oracle version didn't help > Also from your email below you mention that mapred.child.java.opts and > mapred.child.ulimit were added to try to solve this problem. Are you setting > memory settings fo

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-08 Thread Arpit Gupta
i would recommended using the oracle jdk. Also i tried your configs on a single node setup of 1.0.3 and the mr jobs went through. So i suspect this is something specific to your env. Also from your email below you mention that mapred.child.java.opts and mapred.child.ulimit were added to try t

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-08 Thread Attila Csordas
ulimit was set to mapred.child.ulimit 6291456 -Xmx4096M stayed for heap still getting the very same error any other tips? Thanks, Attila On Sun, Oct 7, 2012 at 6:34 AM, Harsh J wrote: > Hi, > > What is your # of slots per TaskTracker? Your ulimit seems pretty > high. I'd set it to 1.5x tim

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-08 Thread Attila Csordas
OpenJDK 64-Bit Server VM (build 19.0-b09, mixed mode) might the official Oracle Java be better? Thanks, Attila On Sun, Oct 7, 2012 at 8:37 PM, Arpit Gupta wrote: > are you using 32bit jdk for your task trackers? > > If so reduce the mem setting in mapred.child.java.opts > > -- > Arpit > > On Oc

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-07 Thread Arpit Gupta
are you using 32bit jdk for your task trackers? If so reduce the mem setting in mapred.child.java.opts -- Arpit On Oct 7, 2012, at 12:29 PM, Attila Csordas wrote: > > mapred.tasktracker.map.tasks.maximum > 10 > > > > mapred.tasktracker.reduce.tasks.maximum > 6 > > > Cheers, > Attila >

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-07 Thread Attila Csordas
mapred.tasktracker.map.tasks.maximum 10 mapred.tasktracker.reduce.tasks.maximum 6 Cheers, Attila On Sun, Oct 7, 2012 at 6:34 AM, Harsh J wrote: > Hi, > > What is your # of slots per TaskTracker? Your ulimit seems pretty > high. I'd set it to 1.5x times heap initially, i.e., 6291456

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-06 Thread Harsh J
Hi, What is your # of slots per TaskTracker? Your ulimit seems pretty high. I'd set it to 1.5x times heap initially, i.e., 6291456 (6 GB) and try. On Sun, Oct 7, 2012 at 3:50 AM, Attila Csordas wrote: > some details to this problem: > > 12/10/05 12:13:27 INFO mapred.JobClient: map 0% reduce 0%

Re: Hadoopn1.03 There is insufficient memory for the Java Runtime Environment to continue.

2012-10-06 Thread Attila Csordas
some details to this problem: 12/10/05 12:13:27 INFO mapred.JobClient: map 0% reduce 0% 12/10/05 12:13:40 INFO mapred.JobClient: Task Id : attempt_201210051158_0001_m_02_0, Status : FAILED java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)