[
https://issues.apache.org/jira/browse/TEZ-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189382#comment-14189382
]
Bikas Saha commented on TEZ-1700:
---------------------------------
Made the changes. Tried with broadcastAndOneToOneExample from master branch and
it worked fine.
The existing test case (broadcastAndOneToOneExample) does not catch this
because in the mini cluster there isnt enough parallelism and the preferred
container gets matched by chance because there are only 2 containers around.
The test might have become flaky after this.
I added a new test case in TestTaskSchedulerEventHandler to test that its doing
the translation.
Please take another look.
> Replace containerId from TaskLocationHint with [TaskIndex+Vertex] based
> affinity
> --------------------------------------------------------------------------------
>
> Key: TEZ-1700
> URL: https://issues.apache.org/jira/browse/TEZ-1700
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-1700.1.patch
>
>
> Today 1-1 dependencies are affinitized by creating a task location hint with
> the producer task container id. It can be created by affinitizing to the
> producer task-index+vertexname combination instead and internally Tez can map
> it to the container. This also allows this dependency to be specified before
> the container is assigned. This allows the dependency to be generic.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
