Re: Blogpost: Large-scale graph partitioning with Apache Giraph

2014-04-24 Thread Claudio Martella
Very interesting. We recently wrote an article about a very similar technique: http://arxiv.org/pdf/1404.3861v1.pdf and we also evaluated it on 1B vertices. It would be nice to test it on your graph. On Tue, Apr 22, 2014 at 8:24 PM, Avery Ching ach...@apache.org wrote: Hi Giraphers,

Using out of core messages

2014-04-24 Thread Pascal Jäger
Hi all, I am struggling with the settings to use out of core messages. I have 3 nodes with 16 GB RAM each ( one master, two workers). I ran into a java heap space OOM Error. First question is: Where do I set the mapred.child.java-opts Options? Do I need to add them via the -ca mapred.child….“

Re: Using out of core messages

2014-04-24 Thread Claudio Martella
Answers are inline. On Thu, Apr 24, 2014 at 4:21 PM, Pascal Jäger pas...@pascaljaeger.dewrote: Hi all, I am struggling with the settings to use out of core messages. I have 3 nodes with 16 GB RAM each ( one master, two workers). I ran into a java heap space OOM Error. First question