Re: Combiners performance

2016-08-28 Thread José Luis Larroque
I found something: giraph.async.message.store (false by default) that will enable async messaging giraph.async.message.store.threads But i'm not sure if those options can work together with a Combiner. Thanks! Jose 2016-08-28 22:00 GMT-03:00 José Luis Larroque : > Hi guys, > > i recently impl

Combiners performance

2016-08-28 Thread José Luis Larroque
Hi guys, i recently implement a MessageCombiner, and testing in an application that previosly work, it takes siginficant more time. Is there a way to paralelize its work? As for example, giraph.numCombinerThreads or something like that. Sorry if the question is too dumb. Thanks in advance! Jose

Re: Giraph application get stuck, on superstep 4, all workers active but without progress

2016-08-28 Thread José Luis Larroque
Problem solved, i optimize the proccesing of each message, and i could solve it. Sorry for the spam guys :D Bye! Jose 2016-08-28 15:23 GMT-03:00 José Luis Larroque : > Ok, i understand what is happening now. > > I starting to use more compute threads, because i believed that the > problem was s

Re: Giraph application get stuck, on superstep 4, all workers active but without progress

2016-08-28 Thread José Luis Larroque
Ok, i understand what is happening now. I starting to use more compute threads, because i believed that the problem was scalability. I started the application again, using : giraph.numComputeThreads=15 (r3.8xlarge has 32 cores) giraph.userPartitionCount=240 (4 for each computing thread) The appli

Graph Data

2016-08-28 Thread agc studio
Hi all, I was wondering if there are any sample graph data from SNAP that are converted to work on Giraph? Is anyone willing to share the graph data? agron.develo...@gmail.com I tried using formats.IntIntNullTextInputFormat for the Facebook data on SNAP, however its not working for the other data