RE: Scaling Problem

2013-07-26 Thread jerome richard
013 08:13:22 -0700 From: ach...@apache.org To: user@giraph.apache.org Subject: Re: Scaling Problem Hi guys, At some point, we do need to help with a guide for conserving memory, but this is a generic Java problem. You can work around it by

Re: Scaling Problem

2013-07-26 Thread Avery Ching
mailto:jeromerichard...@msn.com>> wrote: Hi, I encountered a critical scaling problem using Giraph. I made a very simple algorithm to test Giraph on large graphs : a connexity test. It works on relatively large graphs (3 072 441 nodes and 117 185 083 edges) but not on very large graph (

Re: Scaling Problem

2013-07-26 Thread Puneet Jain
Can you paste your cluster information ? I am also struggling to make it work on 75M vertices and 100s of million edges. On Fri, Jul 26, 2013 at 8:02 AM, jerome richard wrote: > Hi, > > I encountered a critical scaling problem using Giraph. I made a very > simple algorithm to te

Re: Scaling Problem

2013-07-26 Thread Han JU
What's your cluster configuration? How you invoke the job? 2013/7/26 jerome richard > Hi, > > I encountered a critical scaling problem using Giraph. I made a very > simple algorithm to test Giraph on large graphs : a connexity test. It > works on relatively large graphs

Scaling Problem

2013-07-26 Thread jerome richard
Hi, I encountered a critical scaling problem using Giraph. I made a very simple algorithm to test Giraph on large graphs : a connexity test. It works on relatively large graphs (3 072 441 nodes and 117 185 083 edges) but not on very large graph (52 000 000 nodes and 2 000 000 000 edges). In