[
https://issues.apache.org/jira/browse/TEZ-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Balamohan updated TEZ-2196:
----------------------------------
Attachment: TEZ-2196.1.patch
Attaching the patch for review.
- Using UnorderedPartitionedKVOutput with single partition for UnorderedKVOutput
- Removed FileBasedKVWriter
- Removed TEZ_RUNTIME_TRANSFER_DATA_VIA_EVENTS_ENABLED.
> Consider reusing UnorderedPartitionedKVWriter with single output in
> UnorderedKVOutput
> -------------------------------------------------------------------------------------
>
> Key: TEZ-2196
> URL: https://issues.apache.org/jira/browse/TEZ-2196
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Attachments: TEZ-2196.1.patch
>
>
> Can possibly get rid of FileBasedKVWriter and reuse
> UnorderedPartitionedKVWriter with single partition in UnorderedKVOutput.
> This can also benefit from pipelined shuffle changes done in
> UnorderedPartitionedKVWriter.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
