Cheolsoo Park created PIG-4060:
----------------------------------
Summary: Refactor TezJob and TezLauncher
Key: PIG-4060
URL: https://issues.apache.org/jira/browse/PIG-4060
Project: Pig
Issue Type: Sub-task
Components: tez
Reporter: Cheolsoo Park
Assignee: Cheolsoo Park
Fix For: 0.14.0
Currently, TezJob extends ControlledJob, and TezLauncher submits TezJob to the
cluster via ControlJob. However, there is no reason for this since ControlJob
always contains a single job in Tez unlike MR.
There are some operators such as MergeJoin that consists of more than 1
disjoint DAGs. But this case is handled by TezPlanContainer. That is,
TezPlanContainer keeps multiple DAGs, and TezLauncher compiles/submits them one
by one in order.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
