Friends,
We recently had a Hadoop cluster upgrade, after which my Giraph applications
failed with the following fatal exception in the yarn log:
2016-09-30 14:34:40,229 FATAL [AsyncDispatcher event handler]
org.apache.hadoop.yarn.event.AsyncDispatcher: Error in dispatcher thread
java.lang.NoSuc
I'm on a plane now. I'll look into your problem ASAP.
Sent from my phone.
-Original Message-
From: Mckie, Duncan [dmc...@ebay.com]
Received: Tuesday, 06 Jan 2015, 10:04AM
To: user@giraph.apache.org [user@giraph.apache.org]
Subject: Re: Need help on simple text based giraph input format
H
I think you answered your question "Or am I supposed to write a
VertexOutputFormat implementation that generates no output for the vertices
that have no data?", as in YES!.
But don't be put off; It is actually a very simple class to override. Here is
an example for something like you describe
With any generated ID like a hash, there will always be the possibility of a
collision (different ids creating the same generated id). However, because you
are using a long, the size of the hash space is quite large. a collision won't
become likely until you have around 4 billion vertexes. I
Edges "combine" differently than vertexes.
By default, each edge you read is added to the adjacency set of the source
vertex (all edges are directed in Giraph, if you had not realized that yet).
So if you read multiple edge for the same source -> target, they will all be
represented in the sou
}
As a warning, for this class I'm using Hadoop 0.20.203 and I'm also a beginner,
so take everything I say with a grain of salt, and Tom please correct me if I'm
wrong.
Best of luck,
Matthew
On Mon, Jul 21, 2014 at 11:37 PM, Schweiger, Tom
mailto:thschwei...@ebay.com>> wro
And in answer of :
This post also suggests (along with what I described above) to have a field in
the vertex value itself. For that I need to change the vertex input format and
also create my own custom vertex class. Is it really necessary?
No, you don't need a custom vertex class or vertex inpu
I suggest you store this information as a property of the vertex. If its just
a flag, you could use a BooleanWritable. That would be the V in .
From: Sardeshmukh, Vivek [vivek-sardeshm...@uiowa.edu]
Sent: Monday, July 21, 2014 2:05 PM
To: user@giraph.apache.
My graph uses vertex values which I would like to be able to set when I create
an edge. I know how to set the vertex values when reading from a
VertexInputFormat, but for reasons best left out of this discussion I need to
be able to set them when creating edges using a custom EdgeInputFormat a
That sounds like a breadth-first search.
Start with all vertexes with a distance of MAX_INTEGER
>From the starting vertex, set its distance to zero and send one to all
>neighbors. As vertexes get messages, if the message distance is less than the
>current distance, set the current distance to t
Hello Giraph list,
I have a problem that has two steps. Step 2 needs to start after step 1
completes. Step 1 is completed when all the vertices have voted to halt and
there are no more messages.
I know I can switch my computes using a MasterCompute, but it is unclear how I
re-awaken all th
11 matches
Mail list logo
