[
https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500397#comment-14500397
]
Tsuyoshi Ozawa commented on TEZ-145:
------------------------------------
[~gopalv] [~bikassaha] thank you for your comments. The name "Transducer"
sounds straight forward to me since the semantics looks similar to clojure's
one. Should we create subtasks to go advance this issue?
Subtasks I come up with is:
1. Implementing Transducer.
2. Implementing PartitionPreservingMergedInput.
3. Implementing PreorderedPartitionedOutput.
4. (optional) short circuit read.
What do you think?
> Support a combiner processor that can run non-local to map/reduce nodes
> -----------------------------------------------------------------------
>
> Key: TEZ-145
> URL: https://issues.apache.org/jira/browse/TEZ-145
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Hitesh Shah
> Assignee: Tsuyoshi Ozawa
> Attachments: TEZ-145.2.patch, WIP-TEZ-145-001.patch
>
>
> For aggregate operators that can benefit by running in multi-level trees,
> support of being able to run a combiner in a non-local mode would allow
> performance efficiencies to be gained by running a combiner at a rack-level.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
