Hassan Eslami created GIRAPH-1019:
-------------------------------------

             Summary: Optimizing and debugging vertex mutation
                 Key: GIRAPH-1019
                 URL: https://issues.apache.org/jira/browse/GIRAPH-1019
             Project: Giraph
          Issue Type: Improvement
          Components: graph
            Reporter: Hassan Eslami


Currently vertex mutations happen while preparing a superstep execution in a 
single-threaded manner. This is extremely inefficient specially for the case of 
out-of-core as we have to go over all the partitions, load them, and test if 
they have any applicable mutation. Also, there is an unexpected behavior in 
cases where a mutation happen to a vertex and some messages being delivered to 
that vertex at the same time (current implementation fails the job in that 
case).

In order to fix/optimize this, mutations should happen in a multi-threaded 
fashion right before start of processing of a partition. Also, while partition 
migration happens, mutation requests should migrate along with the partition 
and its messages.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to