Allow creation of graph by adding edges that span multiple workers
------------------------------------------------------------------

                 Key: GIRAPH-155
                 URL: https://issues.apache.org/jira/browse/GIRAPH-155
             Project: Giraph
          Issue Type: New Feature
          Components: graph, lib
    Affects Versions: 0.1.0
            Reporter: Dionysios Logothetis


Currently a graph is created only be adding vertices. The typical way is to 
read input text files line-by-line with each line describing a vertex (its 
value, its edges etc). The current API allows for the creation of a vertex only 
if all the information for the vertex is available in a single line.

However, it's common to have graphs described in the form of edges. Edges might 
span multiple lines in an input file or even span multiple workers. The current 
API doesn't allow this. In the input superstep, a vertex must be created by a 
single worker.

Instead, it should be possible for multiple workers to mutate the graph during 
the input superstep.

This has the following implications:
(i) Instead of just instantiating a vertex, a vertex reader should be able to 
do vertex addition and edge addition requests.
(ii) Multiple workers might try to create the same vertex. Any conflicts should 
be handled with a VertexResolver. So the resolver has to be instantiated before 
load time.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to