Re: Printing paths with shortest simple path algorithm

2017-11-30 Thread Kenrick Fernandes
Aneesh, The SSSP example given does not store that information in the vertex, so you'd have to modify the example so that each vertex stores the entire path from the source, perhaps as a string. Once you do that, you can print it out the same way. Hope thats helpful, Kenrick On Tue, Nov 28,

Re: Worker to task id mapping in giraph

2017-11-27 Thread Kenrick Fernandes
Ravikant, As far as I know, there is no way to do this (atleast not without changing the network names of the machines which is outside the scope of the Giraph code). However, a simple solution might be to make a mapping data structure that stores the underlying node IDs and then you can access

PartitionBalancing failure on Giraph 1.1.0

2015-09-21 Thread Kenrick Fernandes
Hello, When I change the Partition Balance Algorithm from static to edges/vertices, Giraph 1.1 quickly crashes. I have checked my configuration settings to make sure nothing else is out of place, and the logs are below. Has anyone else gotten this feature working ? Or have any thoughts on the

Developing Giraph in an IDE

2015-06-04 Thread Kenrick Fernandes
Hello, I have tried unsuccessfully to setup a local development environment to develop applications and play with Giraph code. So far, ive used a few tutorials and list threads for Eclipse and IntelliJ Community, and even tried adding the Hadoop project itself to the dependencies (compiling

Re: Input format problems running Giraph 1.1.0 on Twitter dataset

2015-04-25 Thread Kenrick Fernandes
of the existing formats slightly. Thanks, Roman. On Sat, Apr 25, 2015 at 2:58 PM, Kenrick Fernandes kenrick@gmail.com wrote: Hello, Im trying to get Giraph to read the Twitter dataset as input for the SimplePageRankComputation program. The dataset format looks like this: 61578010

Re: Giraph 1.1.0 not running on full cluster with Hadoop 2.6.0

2015-03-25 Thread Kenrick Fernandes
On Mon, Mar 23, 2015 at 7:06 PM, Kenrick Fernandes kenrick@gmail.com wrote: Hi Phil, The build was successful - now running the *ShortestPaths* example gives me a different error, *GiraphApplicationMaster* not found . However, when I run the PageRank benchmark, I still get the same

Re: Giraph 1.1.0 not running on full cluster with Hadoop 2.6.0

2015-03-23 Thread Kenrick Fernandes
) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) - Suggestions/fixes would be much appreciated. Thanks, Kenrick On Mon, Mar 23, 2015 at 1:30 PM, Kenrick Fernandes kenrick@gmail.com wrote: Hi Steve, Running

Re: Giraph 1.1.0 not running on full cluster with Hadoop 2.6.0

2015-03-23 Thread Kenrick Fernandes
, 2015 at 4:28 PM, Kenrick Fernandes kenrick@gmail.com wrote: Hi, I am working with Giraph 1.1.0 and a YARN cluster with Hadoop 2.6.0. I build Giraph with mvn -Phadoop_2 -Dhadoop.version=2.6.0 clean package -DskipTests So far, when I run any of the benchmarks or Shortest path

Re: Giraph 1.1.0 not running on full cluster with Hadoop 2.6.0

2015-03-23 Thread Kenrick Fernandes
-Dhadoop.version=2.5.2 (in my case) Phil This message optimized for indexing by NSA PRISM On Sun, Mar 22, 2015 at 4:28 PM, Kenrick Fernandes kenrick@gmail.com wrote: Hi, I am working with Giraph 1.1.0 and a YARN cluster with Hadoop 2.6.0. I build Giraph with mvn -Phadoop_2