[ 
https://issues.apache.org/jira/browse/APEXCORE-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sandesh reassigned APEXCORE-258:
--------------------------------

    Assignee:     (was: Sandesh)

> Make buffer server optional and enabled by default
> --------------------------------------------------
>
>                 Key: APEXCORE-258
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-258
>             Project: Apache Apex Core
>          Issue Type: New Feature
>            Reporter: Vlad Rozov
>
> In the current implementation if two operators reside in 2 different 
> containers tuples are passed using buffer server, so that if downstream 
> operator fails data flow can be restored from the buffer server without 
> recomputing data starting all the way from an input operator. On the other 
> hand if operators reside inside the same container (thread or container 
> local), there is no buffer server in between and data need to be recomputed 
> starting either an operator that resides in a different container (or from 
> input operator in case input operator resides in the same container). The 
> same option should exist for operators that reside in different containers, 
> skip buffer server and pass data directly from one operator to another 
> operator residing in different containers. In case of disaster recovery, it 
> will be necessary to skip all operators that don't use buffer server and go 
> to a previous operator (or input operator) to recompute data. Such option 
> should be beneficial for larger tuples when cost to pass data over wires is 
> significant and cost to recompute/process tuples is not.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to