Hello Quanlong Huang, Steve Carlin, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/25001
to look at the new patch set (#2).
Change subject: IMPALA-15059: Use HBO row counts in Calcite scans
......................................................................
IMPALA-15059: Use HBO row counts in Calcite scans
Use HBO row counts for unfiltered HDFS scans during Calcite
optimization. Keep catalog statistics for selectivity estimation
and fall back to existing estimates when no history matches.
Snapshot the HBO lookup during table initialization and share scan
input-stat helpers with HdfsScanNode. Keep catalog row counts for
column-stat selectivity and distinct-value estimates.
Filtered scan keys, Iceberg, Kudu and transactional tables are left
for follow-up work.
Change-Id: I0f530098d34869cda5ff36a06576bb4854ad7f4f
---
M fe/src/main/java/org/apache/impala/catalog/FeFsTable.java
M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteTable.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/FilterSelectivityEstimator.java
M
java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/ImpalaRelMdDistinctRowCount.java
A
java/calcite-planner/src/test/java/org/apache/impala/calcite/planner/TestCalciteHboStats.java
6 files changed, 376 insertions(+), 17 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/01/25001/2
--
To view, visit http://gerrit.cloudera.org:8080/25001
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I0f530098d34869cda5ff36a06576bb4854ad7f4f
Gerrit-Change-Number: 25001
Gerrit-PatchSet: 2
Gerrit-Owner: Aleksandr Efimov <[email protected]>
Gerrit-Reviewer: Aleksandr Efimov <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Steve Carlin <[email protected]>
