[ https://issues.apache.org/jira/browse/HIVE-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13736175#comment-13736175 ]
Navis commented on HIVE-3926: ----------------------------- [~sershe] Compacting pruner predicate only removes nulls. It does not do removing non-partition column related expression. Without this, exception is thrown in the pruneBySequentialScan() method, like this, {noformat} Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: cannot find field block__offset__inside__file from [org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@12fb063, org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@1e55d39, org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@14b525c, org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@c4c05] at org.apache.hadoop.hive.ql.optimizer.ppr.PartitionPruner.prune(PartitionPruner.java:231) at org.apache.hadoop.hive.ql.optimizer.pcr.PcrOpProcFactory$FilterPCR.process(PcrOpProcFactory.java:112) ... 26 more Caused by: java.lang.RuntimeException: cannot find field block__offset__inside__file from [org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@12fb063, org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@1e55d39, org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@14b525c, org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector$MyField@c4c05] at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getStandardStructFieldRef(ObjectInspectorUtils.java:368) at org.apache.hadoop.hive.serde2.objectinspector.UnionStructObjectInspector.getStructFieldRef(UnionStructObjectInspector.java:100) at org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.initialize(ExprNodeColumnEvaluator.java:55) at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:121) at org.apache.hadoop.hive.ql.optimizer.ppr.PartExprEvalUtils.prepareExpr(PartExprEvalUtils.java:100) at org.apache.hadoop.hive.ql.optimizer.ppr.PartitionPruner.pruneBySequentialScan(PartitionPruner.java:330) at org.apache.hadoop.hive.ql.optimizer.ppr.PartitionPruner.prune(PartitionPruner.java:219) ... 27 more {noformat} > PPD on virtual column of partitioned table is not working > --------------------------------------------------------- > > Key: HIVE-3926 > URL: https://issues.apache.org/jira/browse/HIVE-3926 > Project: Hive > Issue Type: Bug > Components: Query Processor > Reporter: Navis > Assignee: Navis > Priority: Minor > Fix For: 0.12.0 > > Attachments: HIVE-3926.6.patch, HIVE-3926.D8121.1.patch, > HIVE-3926.D8121.2.patch, HIVE-3926.D8121.3.patch, HIVE-3926.D8121.4.patch, > HIVE-3926.D8121.5.patch > > > {code} > select * from src where BLOCK__OFFSET__INSIDE__FILE<100; > {code} > is working, but > {code} > select * from srcpart where BLOCK__OFFSET__INSIDE__FILE<100; > {code} > throws SemanticException. Disabling PPD makes it work. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira