[ 
https://issues.apache.org/jira/browse/TEZ-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975954#comment-13975954
 ] 

Bikas Saha commented on TEZ-802:
--------------------------------

With TEZ-1018 it should be possible to use the InputReadyVertexManager to 
specify the locality of tasks where the locality is mainly dependent on the 1-1 
source. This approach implements 1) above. Whenever there is a 1-1 only or a 
broadcast and 1-1 edge then tez can choose to automatically insert the 
InputReadyVertexManager.

Colocation of tasks by analyzing the DAG structure to determine co-location or 
by the user may be done separately as a future improvement.

> Determination of Task Placement for 1-1 Edges
> ---------------------------------------------
>
>                 Key: TEZ-802
>                 URL: https://issues.apache.org/jira/browse/TEZ-802
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>
> Currently, task placement is determined by TaskLocationHints that are 
> specified by the user in the API or during runtime. Everything else runs as 
> without placement constraints. While this works for broadcase and 
> scatter-gather edges, it does not work for 1-1 edges.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to