Help needed in Compilation and execution of a giraph code(Giraph noob)

Hi all, I am new to Apache Giraph. I am struggling to compile and run my code using apache giraph. I have got giraph installed properly, I have successfully tested shortest path example too. Now when I try to write my own code I'm unable to figure out how to compile it and run, the documentation

Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

go to ../giraph-core directory and run mvn clean install there. Lukas On 29.1.2014 16:00, Deepankar Patra wrote: Hi Jyoti, Thanks for the help. I tried your steps, while trying mvn compile I get build failure message with these two warnings: [INFO]

Re: Help needed in Compilation and execution of a giraph code(Giraph noob)

Dear Deepankar, you can use steps mentioned on this link http://anisnasir.wordpress.com/2014/01/03/running-a-custom-code-in-apache-giraph/ Regards Anis On Wed, Jan 29, 2014 at 4:00 PM, Deepankar Patra deepankarb...@gmail.comwrote: Hi Jyoti, Thanks for the help. I tried your steps, while

Re: constraint about no of supersteps

Thanks all for your reply.. Actually i am working with an algorithm in which single source shortest path algorithm runs for thousands of vertices .suppose on an average for one vertex this algo takes 5-6 supersteps,then for thousands of vertices,count of superstep is extremely large..In that

Re: constraint about no of supersteps

looks like one of your workers died. If you expect such a long job, I'd suggest you turn checkpointing on. On Wed, Jan 29, 2014 at 5:30 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote: Thanks all for your reply.. Actually i am working with an algorithm in which single source shortest path

duplicate edges created with TextVertexInputFormat

I am reading in an adjacency list using an input format which extends TextVertexInputFormat. My code doesn’t do anything to address input splits, but leaves that to the underlying giraph implementation. However it appears that as the data is being read 2 identical input splits are created and

Re: duplicate edges created with TextVertexInputFormat

The logs appear to show that you get two identical input slits: 14/01/28 11:02:41 INFO worker.InputSplitsCallable: getInputSplit: Reserved /_hadoopBsp/giraph_yarn_application_1390861968364_0029/_vertexInputSplitDir/ 0 from ZooKeeper and got input split

Re: Preconfigured BigTop running Giraph

There is a heap check in there when setting up to launch the AM in the client module. It uses information coming back from the RM of your YARN cluster. I'm guessing its cluster configs? On Tue, Jan 14, 2014 at 5:24 PM, Roman Shaposhnik r...@apache.org wrote: Hi Martin, sorry for the belated

Re: Could not find or load main class org.apache.giraph.yarn.GiraphApplicationMaster

Hi, Well it gets as far as receiving a container and appId from the RM and it looks like for just a sec the AM gets up and running then dies. The command line looks good (Mohammed who did the update to Hadoop 2.2 should probably confirm this) but the one thing I notice is that you're calling one

Re: DataStreamer Exception - LeaseExpiredException

Hi Kristen, I had this problem before and submitted a Jira ticket (GIRAPH-747) with path. You may want to take a look at it. Hope that can solve your problem. Thanks, Chuan On Jan 29, 2014, at 9:16 PM, Eli Reisman apache.mail...@gmail.com wrote: Hi Kristen, thanks for posting this. During

Re: DataStreamer Exception - LeaseExpiredException

Sorry, I do think this will solve it and it makes sense people are encountering the prob when using -w 1 I'll get this reviewed and committed (patch 747) Mohammed, any objections? On Wed, Jan 29, 2014 at 6:22 PM, Chuan Lei leich...@gmail.com wrote: Hi Kristen, I had this problem before and