[
https://issues.apache.org/jira/browse/PIG-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aniket Mokashi reassigned PIG-2668:
-----------------------------------
Assignee: Aniket Mokashi
> projection pushdown should work through Split
> ----------------------------------------------
>
> Key: PIG-2668
> URL: https://issues.apache.org/jira/browse/PIG-2668
> Project: Pig
> Issue Type: Bug
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
>
> A = load ...
> B1 = filter A by cond1;
> B2 = filter A by cond2;
> B3 = filter A by cond3;
> B = union B1, B2, B3; does not push projection.
> Load (A)
> |
> Split
> |
> ---------------------------
> | |
> Filter(B1) Filter(B2) ...
> Because of the split operator introduced between the filter conditions and
> load, the filter does not get pushed into the load function.
> A simple way to fix this in pig would be to not share the load across the
> filter operators. Another option is to push the condition (B1 or B2 or B3)
> into Load operator and retain rest of the current plan (split and filters
> following the split).
> You can of course achieve the same effect by having a separate load statement
> as input for each of the filters.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
