[ 
https://issues.apache.org/jira/browse/TEZ-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506741#comment-14506741
 ] 

Gopal V commented on TEZ-2161:
------------------------------

The aggregations can be done consistently if and only if any two versions of 
the counter group can be merged associatively & commutatively.

> Support CRDT aggregation models for counters 
> ---------------------------------------------
>
>                 Key: TEZ-2161
>                 URL: https://issues.apache.org/jira/browse/TEZ-2161
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>
> Some counters such as last event received time need to be handled different 
> to say bytes read counters. Bytes reads requires a summation across all tasks 
> within a vertex. The received time requires doing a max() across all the 
> tasks. First event received time would likely need a min().



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to