[
https://issues.apache.org/jira/browse/APEXCORE-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandesh reassigned APEXCORE-258:
--------------------------------
Assignee: Sandesh
> Make buffer server optional and enabled by default
> --------------------------------------------------
>
> Key: APEXCORE-258
> URL: https://issues.apache.org/jira/browse/APEXCORE-258
> Project: Apache Apex Core
> Issue Type: New Feature
> Reporter: Vlad Rozov
> Assignee: Sandesh
>
> In the current implementation if two operators reside in 2 different
> containers tuples are passed using buffer server, so that if downstream
> operator fails data flow can be restored from the buffer server without
> recomputing data starting all the way from an input operator. On the other
> hand if operators reside inside the same container (thread or container
> local), there is no buffer server in between and data need to be recomputed
> starting either an operator that resides in a different container (or from
> input operator in case input operator resides in the same container). The
> same option should exist for operators that reside in different containers,
> skip buffer server and pass data directly from one operator to another
> operator residing in different containers. In case of disaster recovery, it
> will be necessary to skip all operators that don't use buffer server and go
> to a previous operator (or input operator) to recompute data. Such option
> should be beneficial for larger tuples when cost to pass data over wires is
> significant and cost to recompute/process tuples is not.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
