Out of memory error in Graph on hadoop1.2.1

2014-04-04 Thread Arun Kumar
Hi while executing triangle count progrm over graph in a cluster of 8 server machines i am getting out of memory exception.My data size is of 1GB In my conf/hadoop-env.sh file i have updated the heapsize export HADOOP_HEAPSIZE=6000 even after that i am getting the below exception Can someone

Out of memory

2014-03-27 Thread Stefan Beskow
Hi. I'm trying to run the sample connected components algorithm on a large data set on a cluster, but I get a "java.lang.OutOfMemoryError: Java heap space" error. The cluster has 16 nodes, and each node has 24 cores and 96GB of memory. I'm using Hadoop-2.2.0-cdh5.0.0-beta2 and running Giraph 1.

Error: Out of memory error..

2014-01-12 Thread Jyoti Yadav
Hi.. I faced some error at runtime Error running child java.lang.IllegalStateException: run: Caught an unrecoverable exception waitFor: ExecutionException occurred while waiting for org.apache.giraph.utils.ProgressableUtils$FutureWaitable@1a1d638 at org.apache.giraph.graph.GraphMapper.run

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-09-04 Thread Avery Ching
cular that changed... On 8/28/13 4:39 PM, Jeff Peters wrote: I am tasked with updating our ancient (circa 7/10/2012) Giraph to giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs out of memory using the same AWS elastic

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-09-04 Thread Jeff Peters
int in a >> modern Giraph? Should I simply assume that I need to force AWS to configure >> its EMR Hadoop so that each instance has fewer map tasks but with a >> somewhat larger VM max, say 3GB instead of 2GB? >> >> >> On Wed, Aug 28, 2013 at 4:57 PM, Avery Ching w

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-09-04 Thread Avery Ching
rote: I am tasked with updating our ancient (circa 7/10/2012) Giraph to giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs out of memory using the same AWS elastic-mapreduce configuration we have always used. I

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-09-04 Thread Lukas Nalezenec
r ancient (circa 7/10/2012) Giraph to giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs out of memory using the same AWS elastic-mapreduce configuration we have always used. I have never tried to configure either Giraph or

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-09-03 Thread Jeff Peters
n Wed, Aug 28, 2013 at 4:57 PM, Avery Ching wrote: > >> Try dumping a histogram of memory usage from a running JVM and see where >> the memory is going. I can't think of anything in particular that >> changed... >> >> >> On 8/28/13 4:39 PM, Jeff Pet

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-09-02 Thread Lukas Nalezenec
at changed... On 8/28/13 4:39 PM, Jeff Peters wrote: I am tasked with updating our ancient (circa 7/10/2012) Giraph to giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs out of memory using the same AWS elastic-mapreduce configuration we

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-08-30 Thread Jeff Peters
running JVM and see where >> the memory is going. I can't think of anything in particular that >> changed... >> >> >> On 8/28/13 4:39 PM, Jeff Peters wrote: >> >>> >>> I am tasked with updating our ancient (circa 7/10/2012) Girap

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-08-30 Thread Avery Ching
changed... On 8/28/13 4:39 PM, Jeff Peters wrote: I am tasked with updating our ancient (circa 7/10/2012) Giraph to giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs out of memory using the same AWS elastic-mapreduce configuration we hav

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-08-28 Thread Jeff Peters
;> giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs >> out of memory using the same AWS elastic-mapreduce configuration we have >> always used. I have never tried to configure either Giraph or the AWS >> Hadoop. We build for Hadoop 1.0.2 because that&

Re: Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-08-28 Thread Avery Ching
jobs run fine but our largest job now runs out of memory using the same AWS elastic-mapreduce configuration we have always used. I have never tried to configure either Giraph or the AWS Hadoop. We build for Hadoop 1.0.2 because that's closest to the 1.0.3 AWS provides us. The 8 X m2.4xlar

Out of memory with giraph-release-1.0.0-RC3, used to work on old Giraph

2013-08-28 Thread Jeff Peters
I am tasked with updating our ancient (circa 7/10/2012) Giraph to giraph-release-1.0.0-RC3. Most jobs run fine but our largest job now runs out of memory using the same AWS elastic-mapreduce configuration we have always used. I have never tried to configure either Giraph or the AWS Hadoop. We