[
https://issues.apache.org/jira/browse/TEZ-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054597#comment-14054597
]
Bikas Saha commented on TEZ-1261:
---------------------------------
Its supposed to be 4. There were 2 reduce tasks with each getting 2 inputs (1
from lone map task in each of the 2 map vertices). When reduce tasks got merged
to 1 then that new task has to handle all 4 of the inputs (2 each from the 2
map tasks). When 4 events go to the Shuffle then it considers 4 inputs received
and moves on. We are sending 4 events but according to you the shuffle input
thinks it has only received 2. The shuffle input logs will help understand if
it somehow did not get 4 events or it considered 2 of them invalid.
> ShuffleVertexManager auto parallelism is broken after TEZ-1131
> --------------------------------------------------------------
>
> Key: TEZ-1261
> URL: https://issues.apache.org/jira/browse/TEZ-1261
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Daniel Dai
> Assignee: Bikas Saha
> Fix For: 0.5.0
>
> Attachments: syslog_dag_1404758486092_0018_1
>
>
> A plain 3 vertex join hang forever when turn on auto-parallelism. AM log
> attached.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
