[
https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925947#comment-13925947
]
Koji Noguchi commented on PIG-3782:
-----------------------------------
bq. I attach another patch only fix PushDownForEachFlatten. I reuse your test
case though. Can you check if it looks better?
Thanks [~daijy]. I can see how your patch fixes the issue, but I'm not sure if
it's better.
Maybe it'll help me understand if you can teach me why we want to avoid my
approach of getting rid of the extra copy inside the LOGenerate.
To me, fixing the issue at the source(producer) by storing UIDs inside
mUserDefinedSchema is better than fixing on the receiver side with a
workaround.
> PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing
> due to incorrect UID assignment
> -----------------------------------------------------------------------------------------------------------
>
> Key: PIG-3782
> URL: https://issues.apache.org/jira/browse/PIG-3782
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.1, 0.12.0, 0.11.1
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
> Attachments: PIG-3782-2.patch, pig-3782-v01.patch
>
>
> {noformat}
> a = load '1.txt' as (a0:int, a1, a2:bag{});
> b = load '2.txt' as (b0:int, b1);
> c = foreach a generate a0, flatten(a2) as (q1, q2);
> d = join c by a0, b by b0;
> e = foreach d generate a0, q1, q2;
> f = foreach e generate a0, (int)q1, (int)q2;
> store f into 'output';
> {noformat}
> This pig script fails with
> 2014-02-27 11:49:45,657 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
> 2229: Couldn't find matching uid -1 for project (Name: Project Type:
> bytearray Uid: 13 Input: 0 Column: 1)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
