[ https://issues.apache.org/jira/browse/PIG-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J updated PIG-3594: ------------------------- Summary: Pig 0.11 with HCatLoader partition filter does not push down valid conditions (was: Pig with HCatLoader partition filter does not push down valid conditions) > Pig 0.11 with HCatLoader partition filter does not push down valid conditions > ----------------------------------------------------------------------------- > > Key: PIG-3594 > URL: https://issues.apache.org/jira/browse/PIG-3594 > Project: Pig > Issue Type: Bug > Affects Versions: 0.11.1 > Reporter: Mona Chitnis > Fix For: 0.11.2 > > > When running the following pig query (script.pig) : > A = LOAD ' my_data' USING org.apache.hcatalog.pig.HCatLoader(); > B = FILTER A by part1=='$val1' and part2 matches '$val2'; > C = FILTER B by map#'key' matches '(val3|val4)'; > DUMP C; > > pig -useHCatalog -p val1=2013_01_01 val2=XYZ script.pig > This results in Pig scanning all partitions inspite of filter condition. > part1=='$val1' should have been pushed to HCatLoader even though there are > other conditions that cannot be pushed. -- This message was sent by Atlassian JIRA (v6.2#6252)