Re: Job settings to run PageRank on 75M vertices

Just a followup note .. my Master is timing out because my other mappers are taking too much time to finish ... 2013-07-24 22:13:18,874 INFO org.apache.giraph.utils.ProgressableUtils: waitFor: Waiting for org.apache.giraph.utils.ProgressableUtils$FutureWaitable@5f337f6f 2013-07-24 22:13:18,895 IN

Job settings to run PageRank on 75M vertices

Hello: I am struggling to make PageRank run on 75M nodes with each node having 1-75000 edges. I am constantly getting zookeeper timeouts irrespective of my configuration. - I have 21 node hadoop cluster, each node having 4 cores, 4GB memory. - Data is stored in hbase as adjacency matrix - I am r

Re: How to retrieve and display the values aggregated by the aggregators?

Hi Claudio, So I checked out TextAggregatorWriter and was, initially, still a bit confused on how to use it to write to a text file. That's when I noticed that, in org.apache.giraph.utils.ConfigurationUtils, there is an option "aw", which corresponds to an AggregatorWriterClass. I tried this out

Binary package of Giraph

Hello, Is there any binary package instead of the source code package of Giraph? Thanks, Chui-hui

Re: How to retrieve and display the values aggregated by the aggregators?

Hi Kyle, you can check out the AggregatorWriter interface which allows you to do that. As a matter of fact there is already a class that implements what you need (org.apache.giraph.aggregators.TextAggregatorWriter). Hope it helps. On Wed, Jul 24, 2013 at 5:19 PM, Kyle Orlando wrote: > Hello, >

How to retrieve and display the values aggregated by the aggregators?

Hello, I am new to Giraph and was just wondering how one could retrieve and display the certain global values/statistics that the aggregators keep track of. What classes and methods would I use, and would this be done in a class that extends VertexOutputFormat, or would it be done elsewhere? As