Re: Giraph Use Case

2014-08-12 Thread John Yost
I recommend downloading a Twitter data set from SNAP and trying out PageRank,, Jaccard, Lin, etc...to define and compare communities..That's kind where I started. :) --John On Mon, Aug 11, 2014 at 8:46 AM, Vineet Mishra clearmido...@gmail.com wrote: Hi All, Although I have installed and ran

Re: Couldn't instantiate

2014-07-05 Thread John Yost
: onlineZooKeeperServers: ZooKeeper process exited with 143 (note that 143 typically means killed). 2014-07-02 13:52 GMT+02:00 John Yost soozandjohny...@gmail.com: Hi Carmen, Please post more of the exception stack trace, not enough here for me to figure anything out. :) Thanks

Re: Couldn't instantiate

2014-07-02 Thread John Yost
Hi Carmen, Please post more of the exception stack trace, not enough here for me to figure anything out. :) Thanks --John On Wed, Jul 2, 2014 at 7:33 AM, soozandjohny...@gmail.com wrote: Hi Carmen, Glad that one problem is fixed, and I can take a look at this one as well. --John Sent

Re: Couldn't instantiate

2014-06-30 Thread John Yost
Hi Carmen, Question--did you only define an arguments constructor? If so, I think you are getting this because you did not define a no-arguments constructor with public visibility. If this is not the case, I recommend posting your source code and I will be happy to help. --John On Mon, Jun

Re: Giraph insists on LocalJobRunner with custom Computation

2014-06-23 Thread John Yost
Hi Yorn, I figured this out and detailed the solution in my post earlier this morning (6/23 2:46). The key is the following: -ca mapred.job.tracker=localhost:5431. Without this, you'll see the exception you detailed above. --John On Thu, Jun 5, 2014 at 5:36 AM, Yørn de Jong y...@uninett.no

Got Giraph 1.1.0 examples running on YARN

2014-06-22 Thread John Yost
Hi Everyone, I just gotten the Giraph examples to run on YARN and I thought I would share the details since it looks like a few people have struggled with this. This is what I did: 1. Downloaded the latest snapshot (giraph-b218d2) 2. Built with mvn install -P=hadoop_2 -DskipTests=true 3.

Shortest Path Still Won't Work--Any Ideas?

2014-06-20 Thread John Yost
Here's more details regarding my attempts are running Shortest Path. Any help would be greatly appreciated as the root cause for the Giraph job failing is not obvious to me. Thanks ---John Command Line: $ hadoop jar giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0-jar-with-dependencies.jar

Re: How to output into multiple files through a GiraphJob

2014-06-19 Thread John Yost
Hi Ferenc, I have an Giraph job that outputs from the Computation class as opposed to the MasterCompute because I need to maintain alot of state within VertexValues as opposed to Aggregators. This is one way of outputting results as multiple files. I am assuming that you want to scope output

Cannot run shortest path on Hadoop 2.2

2014-06-16 Thread John Yost
Hi Everyone, The shortest path example fails on my Hadoop 2.2.0 single node cluster, and I don't see an identifiable root exception. I am able to execute my Map/Reduce jobs, including ones that use Accumulo for a source and/or sink, but cannot get the Giraph example jobs nor my custom Giraph

Re: Giraph keeps trying to connect to 9000 on Hadoop 2.2.0/YARN

2014-06-02 Thread John Yost
look at GiraphRunner. Thanks again for your quick response--much appreciated. --John On Sun, Jun 1, 2014 at 11:12 AM, Avery Ching ach...@apache.org wrote: Giraph should just pick up your cluster's HDFS configuration. Can you check your hadoop *.xml files? On 6/1/14, 3:34 AM, John Yost

Giraph keeps trying to connect to 9000 on Hadoop 2.2.0/YARN

2014-06-01 Thread John Yost
Hi Everyone, Not sure why, but Giraph tries to connect to port 9000: java.net.ConnectException: Call From localhost.localdomain/127.0.0.1 to localhost:9000 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:

Giraph job hangs and is eventually killed

2014-04-05 Thread John Yost
Hi Everyone, I have a shortest path implementation that completes and outputs the correct results to a counter, but then hangs after the last superstep and is eventually killed by Hadoop. Here's the output from the console: main-SendThread(localhost.localdomain:2181)] INFO