[ https://issues.apache.org/jira/browse/PIG-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13911825#comment-13911825 ]
Mona Chitnis commented on PIG-3594: ----------------------------------- Thanks [~aniket486], from what I remember, I needed this fix for 0.11 branch and 0.12 was ok. But will check once again to confirm. > Pig with HCatLoader partition filter does not push down valid conditions > ------------------------------------------------------------------------ > > Key: PIG-3594 > URL: https://issues.apache.org/jira/browse/PIG-3594 > Project: Pig > Issue Type: Bug > Affects Versions: 0.11.1 > Reporter: Mona Chitnis > Fix For: 0.11.2 > > > When running the following pig query (script.pig) : > A = LOAD ' my_data' USING org.apache.hcatalog.pig.HCatLoader(); > B = FILTER A by part1=='$val1' and part2 matches '$val2'; > C = FILTER B by map#'key' matches '(val3|val4)'; > DUMP C; > > pig -useHCatalog -p val1=2013_01_01 val2=XYZ script.pig > This results in Pig scanning all partitions inspite of filter condition. > part1=='$val1' should have been pushed to HCatLoader even though there are > other conditions that cannot be pushed. -- This message was sent by Atlassian JIRA (v6.1.5#6160)