[
https://issues.apache.org/jira/browse/DRILL-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775348#comment-16775348
]
Anton Gozhiy commented on DRILL-7022:
-------------------------------------
Tested with Drill 1.16.0-SNAPSHOT (commit
ad63b70478674185c438682fc0ccd7ca191da1d5)
Cases verified:
- The case from the bug.
- Verified that metadata was regenerated only one time after the modification.
- Removed the metadata and ran queries.
- Generated it again.
> Partition pruning is not happening the first time after the metadata auto
> refresh
> ---------------------------------------------------------------------------------
>
> Key: DRILL-7022
> URL: https://issues.apache.org/jira/browse/DRILL-7022
> Project: Apache Drill
> Issue Type: Bug
> Components: Metadata, Storage - Parquet
> Affects Versions: 1.15.0
> Reporter: Anton Gozhiy
> Assignee: Volodymyr Vysotskyi
> Priority: Major
> Labels: ready-to-commit
> Fix For: 1.16.0
>
>
> *Data creation:*
> # Create table:
> {code:sql}
> create table dfs.tmp.`orders`
> partition by (o_orderstatus)
> as select * from cp.`tpch/orders.parquet`
> {code}
> # Create table metadata:
> {code:sql}
> refresh table metadata dfs.tmp.`orders`
> {code}
> *Steps:*
> # Modify the table to trigger metadata auto refresh:
> {noformat}
> hadoop fs -mkdir /tmp/orders/111
> {noformat}
> # Run the query:
> {code:sql}
> explain plan for
> select * from dfs.tmp.`orders`
> where o_orderstatus = 'O' and o_orderdate < '1995-03-10'
> {code}
> *Expected result:*
> Partition pruning happens:
> {noformat}
> ... numFiles=1, numRowGroups=1, usedMetadataFile=true ...
> {noformat}
> *Actual result:*
> Partition pruning doesn't happen:
> {noformat}
> ... numFiles=1, numRowGroups=3, usedMetadataFile=true
> {noformat}
> *Note:* It is being reproduced only the first time after auto refresh, after
> repeating the query it works as expected.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
