[
https://issues.apache.org/jira/browse/TEZ-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siddharth Seth updated TEZ-1080:
--------------------------------
Attachment: TEZ-1080.wip.2.txt
Second iteration which allows a single Edge builder to be used to configure IOs.
With this, there would be an EdgeConf per combination (Sorted / Unsorted +
Partitioned). Also, the individual IOs can be configured independently if
required. E.g. clubbing them together with an external I/O.
There's a usage example in the patch. Bunch of stuff still to be ironed out -
loading defaults, actually building the configuration, etc. Feedback request.
> Configuration for non MR based Inputs/Outputs
> ---------------------------------------------
>
> Key: TEZ-1080
> URL: https://issues.apache.org/jira/browse/TEZ-1080
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-1080.wip.1.txt, TEZ-1080.wip.2.txt
>
>
> De-link configuration from MRHelpers (except for the YARNRunner case), and
> allow for these to be configured easily - exposing necessary setters /
> getters without having to rely on config keys.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
