[ https://issues.apache.org/jira/browse/PIG-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-3172: ------------------------------------ Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk (0.12). Thanks Daniel. > Partition filter push down does not happen when there is a non partition key > map column filter > ---------------------------------------------------------------------------------------------- > > Key: PIG-3172 > URL: https://issues.apache.org/jira/browse/PIG-3172 > Project: Pig > Issue Type: Bug > Affects Versions: 0.10.1 > Reporter: Rohini Palaniswamy > Assignee: Rohini Palaniswamy > Fix For: 0.12 > > Attachments: PIG-3172-1.patch > > > A = LOAD 'job_confs' USING org.apache.hcatalog.pig.HCatLoader(); > B = FILTER A by grid == 'cluster1' and dt < '2012_12_01' and dt > > '2012_11_20'; > C = FILTER B by params#'mapreduce.job.user.name' == 'userx'; > D = FOREACH B generate dt, grid, params#'mapreduce.job.user.name' as user, > params#'mapreduce.job.name' as job_name, job_id, > params#'mapreduce.job.cache.files'; > dump D; > The query gives the below warning and ends up scanning the whole table > instead of pushing the partition key filters grid and dt. > [main] WARN org.apache.pig.newplan.PColFilterExtractor - No partition filter > push down: Internal error while processing any partition filter conditions in > the filter after the load > Works fine if the second filter is on a column with simple datatype like > chararray instead of map. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira