[ 
https://issues.apache.org/jira/browse/PIG-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791070#comment-13791070
 ] 

Cheolsoo Park commented on PIG-3461:
------------------------------------

[~aniket486], can you take a look at PIG-3510? I discovered it after deploying 
this new partition filter optimizer to production today. It seems that 
optimization rules are applied in a different order than before. Particularly 
in my case, MergeFilter used to come *before* PartionFilterPushDown, but now it 
comes *after* NewPartitionFilterPushDown. I didn't expect this side effect, but 
it seems like a serious regression.

> Rewrite PartitionFilterOptimizer to make it work for all the cases
> ------------------------------------------------------------------
>
>                 Key: PIG-3461
>                 URL: https://issues.apache.org/jira/browse/PIG-3461
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.11.1
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>             Fix For: 0.12.0
>
>         Attachments: PIG-3461-2.patch, PIG-3461-4.patch, PIG-3461-6.patch
>
>
> Current algorithm for Partition Filter pushdown identification fails in 
> several corner cases. We need to rewrite its logic so that it works in all 
> cases and does the maximum possible filter pushdown.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to