RE: out of memory running examples

2012-02-07 Thread Uma Maheswara Rao G
What is the Java heap space you configured? for the property mapred.child.java.opts From: Tim Broberg [tim.brob...@exar.com] Sent: Tuesday, February 07, 2012 3:20 PM To: common-user@hadoop.apache.org Subject: out of memory running examples I'm trying to

Re: out of memory running examples

2012-02-07 Thread Harsh J
What is your io.sort.mb set to? Given the heap size, you may have to lower it down. And did you intend to run the program in 'local' mode (i.e. non-distributed mode, no JobTracker but LocalJobRunner)? On Tue, Feb 7, 2012 at 3:20 PM, Tim Broberg tim.brob...@exar.com wrote: I'm trying to run the

RE: out of memory running examples

2012-02-07 Thread Tim Broberg
, 2012 4:45 AM To: common-user@hadoop.apache.org Subject: Re: out of memory running examples What is your io.sort.mb set to? Given the heap size, you may have to lower it down. And did you intend to run the program in 'local' mode (i.e. non-distributed mode, no JobTracker but LocalJobRunner)? On Tue

RE: out of memory running examples

2012-02-07 Thread Tim Broberg
mapred.child.java.opts is not set. Should it be? From: Uma Maheswara Rao G [mahesw...@huawei.com] Sent: Tuesday, February 07, 2012 2:27 AM To: common-user@hadoop.apache.org Subject: RE: out of memory running examples What is the Java heap space you

Re: out of memory running examples

2012-02-07 Thread Adam Brown
it be? From: Uma Maheswara Rao G [mahesw...@huawei.com] Sent: Tuesday, February 07, 2012 2:27 AM To: common-user@hadoop.apache.org Subject: RE: out of memory running examples What is the Java heap space you configured? for the property mapred.child.java.opts

RE: out of memory running examples

2012-02-07 Thread Tim Broberg
and to what for a local-only setup? Thanks, - Tim. Beware, beware, bewaee! From: Adam Brown [a...@hortonworks.com] Sent: Tuesday, February 07, 2012 9:47 AM To: common-user@hadoop.apache.org Subject: Re: out of memory running examples Tim

Re: out of memory running examples

2012-02-07 Thread Adam Brown
: Adam Brown [a...@hortonworks.com] Sent: Tuesday, February 07, 2012 9:47 AM To: common-user@hadoop.apache.org Subject: Re: out of memory running examples Tim, That will allow you to increase the spawned vm's max heap size, which based on your trace looks like a good thing to try. Adam

RE: out of memory running examples

2012-02-07 Thread Tim Broberg
! From: Adam Brown [a...@hortonworks.com] Sent: Tuesday, February 07, 2012 11:05 AM To: common-user@hadoop.apache.org Subject: Re: out of memory running examples Hey Tim, When a job runs, it will spawn a jvm, and set runtime parameters based on the properties file you can override

RE: out of memory running examples

2012-02-07 Thread Tim Broberg
understand how it is *supposed* to work. - Tim. From: Adam Brown [a...@hortonworks.com] Sent: Tuesday, February 07, 2012 11:05 AM To: common-user@hadoop.apache.org Subject: Re: out of memory running examples Hey Tim, When a job runs, it will spawn a jvm

RE: out of memory running examples

2012-02-07 Thread Tim Broberg
. From: Tim Broberg [tim.brob...@exar.com] Sent: Tuesday, February 07, 2012 4:33 PM To: common-user@hadoop.apache.org Subject: RE: out of memory running examples Ok, so I edited the bin/hadoop script to dump out what it is doing when it executes java: /usr/java/default