[
https://issues.apache.org/jira/browse/TEZ-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975954#comment-13975954
]
Bikas Saha commented on TEZ-802:
--------------------------------
With TEZ-1018 it should be possible to use the InputReadyVertexManager to
specify the locality of tasks where the locality is mainly dependent on the 1-1
source. This approach implements 1) above. Whenever there is a 1-1 only or a
broadcast and 1-1 edge then tez can choose to automatically insert the
InputReadyVertexManager.
Colocation of tasks by analyzing the DAG structure to determine co-location or
by the user may be done separately as a future improvement.
> Determination of Task Placement for 1-1 Edges
> ---------------------------------------------
>
> Key: TEZ-802
> URL: https://issues.apache.org/jira/browse/TEZ-802
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Bikas Saha
> Assignee: Bikas Saha
>
> Currently, task placement is determined by TaskLocationHints that are
> specified by the user in the API or during runtime. Everything else runs as
> without placement constraints. While this works for broadcase and
> scatter-gather edges, it does not work for 1-1 edges.
--
This message was sent by Atlassian JIRA
(v6.2#6252)