[
https://issues.apache.org/jira/browse/PIG-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286246#comment-14286246
]
Daniel Dai commented on PIG-4352:
---------------------------------
The POStore is different however. The copy is created when we clone the union
vertex into the upstream node:
{code}
PhysicalPlan clonePlan = unionOpPlan.clone();
{code}
The clone does a deep copy and create a different POStore.
For the context for the change, it is triggered by testTwoUnions, which is a 2
level union:
{code}
l1 \
-> u1 \
l2 / -> u2
l3 /
{code}
UnionOptimizer process u2 first and clone the u2 POStore into l3 and u1. And
when UnionOptimizer process u1, it needs to merge l1, l2, l3 into the same
union group, since a union of a vertex and a vertex group does not work in tez.
> Port local mode tests to Tez - TestUnionOnSchema
> ------------------------------------------------
>
> Key: PIG-4352
> URL: https://issues.apache.org/jira/browse/PIG-4352
> Project: Pig
> Issue Type: Sub-task
> Components: tez
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.15.0
>
> Attachments: PIG-4352-1.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
