[ https://issues.apache.org/jira/browse/APEXCORE-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sandesh reassigned APEXCORE-258: -------------------------------- Assignee: (was: Sandesh) > Make buffer server optional and enabled by default > -------------------------------------------------- > > Key: APEXCORE-258 > URL: https://issues.apache.org/jira/browse/APEXCORE-258 > Project: Apache Apex Core > Issue Type: New Feature > Reporter: Vlad Rozov > > In the current implementation if two operators reside in 2 different > containers tuples are passed using buffer server, so that if downstream > operator fails data flow can be restored from the buffer server without > recomputing data starting all the way from an input operator. On the other > hand if operators reside inside the same container (thread or container > local), there is no buffer server in between and data need to be recomputed > starting either an operator that resides in a different container (or from > input operator in case input operator resides in the same container). The > same option should exist for operators that reside in different containers, > skip buffer server and pass data directly from one operator to another > operator residing in different containers. In case of disaster recovery, it > will be necessary to skip all operators that don't use buffer server and go > to a previous operator (or input operator) to recompute data. Such option > should be beneficial for larger tuples when cost to pass data over wires is > significant and cost to recompute/process tuples is not. -- This message was sent by Atlassian JIRA (v6.3.15#6346)