[ https://issues.apache.org/jira/browse/GIRAPH-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091164#comment-14091164 ]
Igor Kabiljo commented on GIRAPH-939: ------------------------------------- https://reviews.facebook.net/D21423 > Reduce/broadcast API > -------------------- > > Key: GIRAPH-939 > URL: https://issues.apache.org/jira/browse/GIRAPH-939 > Project: Giraph > Issue Type: Improvement > Reporter: Igor Kabiljo > > Add reduce and broadcast API. > Current aggregator API has multiple issues: > - no matter whether aggregated values are needed on workers, they are > distributed to them > - there is no way to register aggregator for a single superstep > - in order for master to send data to workers, it needs to go through an > aggregator - even though it can only be Writable > - value to be aggregated and result of aggregation need to be of the same type > - logic of how to do aggregation is combined with how Aggregator is kept > (i.e. aggregate(valueToAggregate), instead of > aggregate(currentAggregatedValue, valueToAggregate)), and so every aggregator > needs to extend BasicAggregator, but that still limits what can be done. > reduce/broadcast is the simplest comprehensive API for what it does, and > Aggregator API can be built on top of it -- This message was sent by Atlassian JIRA (v6.2#6252)