Qifan Chen has uploaded a new patch set (#6). (
http://gerrit.cloudera.org:8080/18071 )
Change subject: IMPALA-11047 Preconditions.checkNotNull(statsTuple_) fail in
HdfsScanNode.java if PARQUET_READ_STATISTICS=0
......................................................................
IMPALA-11047 Preconditions.checkNotNull(statsTuple_) fail in HdfsScanNode.java
if PARQUET_READ_STATISTICS=0
This patch addresses the check not-null failure in FE by checking
the query option PARQUET_READ_STATISTICS in the following situations:
1) When determining whether to apply the min/max overlap predicate;
2) When modifying query option minmax_filter_threshold and
minmax_filtering_level for applying min/max filters to sort or
partition columns.
When PARQUET_READ_STATISTICS is true or 1, then either will proceed.
Testing:
1. Add a new test in TestOverlapMinMaxFilters;
2. Ran the core test successfully.
Change-Id: I52203e73502a35a275decb602b063982b9cad26e
---
M fe/src/main/java/org/apache/impala/planner/Planner.java
M fe/src/main/java/org/apache/impala/planner/RuntimeFilterGenerator.java
M
testdata/workloads/functional-query/queries/QueryTest/overlap_min_max_filters.test
3 files changed, 28 insertions(+), 15 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/71/18071/6
--
To view, visit http://gerrit.cloudera.org:8080/18071
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I52203e73502a35a275decb602b063982b9cad26e
Gerrit-Change-Number: 18071
Gerrit-PatchSet: 6
Gerrit-Owner: Qifan Chen <qc...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Kurt Deschler <kdesc...@cloudera.com>
Gerrit-Reviewer: Qifan Chen <qc...@cloudera.com>
Gerrit-Reviewer: Riza Suminto <riza.sumi...@cloudera.com>
