Re: Sent Messages and Aggregate Sent Messages

2015-04-30 Thread Rob Vesse
As the person who added the Aggregate Sent Messages counter the difference is as follows: - Sent Messages is the number of messages sent in the current super step, as pointed out this gets reset at the end of each iteration - Aggregate sent messages it the total number of messages sent over all

Re: Master/Agreggators

2014-04-03 Thread Rob Vesse
How is that an error? That¹s just some informational log statements from Giraph, you¹ll need to provide the actual error message/describe the issue to get help with your problem Rob From: ghufran malik ghufran1ma...@gmail.com Reply-To: user@giraph.apache.org Date: Thursday, 3 April 2014

Re: duplicate edges created with TextVertexInputFormat

2014-01-29 Thread Rob Vesse
The logs appear to show that you get two identical input slits: 14/01/28 11:02:41 INFO worker.InputSplitsCallable: getInputSplit: Reserved /_hadoopBsp/giraph_yarn_application_1390861968364_0029/_vertexInputSplitDir/ 0 from ZooKeeper and got input split

Re: Issue while executing SimpleShortestPathsComputation

2013-12-10 Thread Rob Vesse
Applying the GIRAPH-814 patch did not help for me Even with the -yj argument (which fwiw I've been using all along) I still get GiraphApplicationMaster not found error Rob On 09/12/2013 21:45, Alexandre Fonseca alexandrejorgefons...@gmail.com wrote: I have confirmed a bug in Giraph's YARN code

Re: out of core option

2013-12-05 Thread Rob Vesse
Sebastian You've made a minor typo in the configuration setting which means you haven't actually enabled out of core graph mode. You have giraph.useOutOfCoreGiraph when it should be giraph.useOutOfCoreGraph ­ note that the last word is Graph not Giraph Rob From: Sebastian Stipkovic

Re: Missing chosen worker error on particular superstep

2013-12-04 Thread Rob Vesse
Kaushik I'm also running a triangle counting program of my own at the moment and have encountered similar problems. Missing working appears to indicate that one of the workers failed (AFAIK) and you'll need to look at the logs for the other map tasks to determine why this is. You appear to have

Re: Unable to instantiate AdjacencyListTextVertexInputFormat

2013-12-02 Thread Rob Vesse
Kaushik This looks like a general Java reflection error and not necessarily anything specific to Giraph. You haven't shown your code but from the stack trace I would guess that either you don't have a public constructor or you have one but it is expecting arguments. For Giraph (or any Java

Re: Giraph and Hadoop 2.2.0

2013-11-14 Thread Rob Vesse
AM, Rob Vesse rve...@dotnetrdf.org wrote: So I fixed the previous issue I was having which I reported and submitted a patch as GIRAPH-795 I then went ahead with installing and configuring my external Zookeeper appropriately and tried running again but now the YARN application fails

Re: Giraph and Hadoop 2.2.0

2013-11-13 Thread Rob Vesse
and Hadoop 2.2.0 Hi Rob, Did you try with this command mvn -Phadoop_yarn -Dhadoop.version=2.2.0 clean package -DskipTests? Regards, Mohammad On Wednesday, November 13, 2013 2:55 AM, Rob Vesse rve...@dotnetrdf.org wrote: Hi all I'm having trouble getting Giraph

Re: Giraph and Hadoop 2.2.0

2013-11-13 Thread Rob Vesse
) Anybody have idea what the cause of this one might be or how to fix it? Cheers, Rob From: Rob Vesse rve...@dotnetrdf.org Reply-To: user@giraph.apache.org Date: Wednesday, 13 November 2013 15:35 To: user@giraph.apache.org Subject: Re: Giraph and Hadoop 2.2.0 Mohammad This got me a build

Running on Amazon EMR?

2013-11-11 Thread Rob Vesse
Hi All I've been looking around for any documentation about running Giraph on Amazon Elastic Map Reduce (EMR) and didn't turn up anything particularly useful. It looks like the only real requirements to run on EMR are to add Bootstrap actions to the Job Flow configuration to apply the relevant