[ 
https://issues.apache.org/jira/browse/GIRAPH-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091164#comment-14091164
 ] 

Igor Kabiljo commented on GIRAPH-939:
-------------------------------------

https://reviews.facebook.net/D21423

> Reduce/broadcast API
> --------------------
>
>                 Key: GIRAPH-939
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-939
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Igor Kabiljo
>
> Add reduce and broadcast API.
> Current aggregator API has multiple issues:
> - no matter whether aggregated values are needed on workers, they are 
> distributed to them
> - there is no way to register aggregator for a single superstep
> - in order for master to send data to workers, it needs to go through an 
> aggregator - even though it can only be Writable
> - value to be aggregated and result of aggregation need to be of the same type
> - logic of how to do aggregation is combined with how Aggregator is kept 
> (i.e. aggregate(valueToAggregate), instead of 
> aggregate(currentAggregatedValue, valueToAggregate)), and so every aggregator 
> needs to extend BasicAggregator, but that still limits what can be done.
> reduce/broadcast is the simplest comprehensive API for what it does, and 
> Aggregator API can be built on top of it



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to