Steve Carlin has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/24528 )
Change subject: IMPALA-15135: Calcite planner: added support for Kudu tables ...................................................................... IMPALA-15135: Calcite planner: added support for Kudu tables This commit enables the Calcite planner to support queries on Kudu tables. Highlights include: - The Kudu tables can have an auto_incrementing_id column that does not show up when a "select *" is done on the query. Special logic has been added to support this. If the user expliclity selects the auto_incrementing_id column, the query will fall back to the original planner (IMPALA-15136 has been filed for this). - A small refactor was done for PrunedPartitionHelper to handle Kudu tables because it does not support code in the HdfsPartitionPruner. - A small refactor was done in CalciteDb to handle FeKuduTable - IMPALA-15134 has been filed on an issue where the cardinality on the KuduScan table is different from the original planner. - Added some code in the test framework to handle the section CALCITE_PLANNER_RUNTIME_PROFILE for when a table format is specified. Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7 Reviewed-on: http://gerrit.cloudera.org:8080/24528 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Steve Carlin <[email protected]> --- M fe/src/main/java/org/apache/impala/analysis/SelectStmt.java M fe/src/main/java/org/apache/impala/catalog/FeKuduTable.java M fe/src/main/java/org/apache/impala/catalog/FeTable.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaHdfsScanRel.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/PrunedPartitionHelper.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteDb.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteIcebergTable.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/schema/CalciteTable.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/service/ImpalaSqlValidatorImpl.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/service/UnsupportedChecker.java M testdata/workloads/functional-query/queries/QueryTest/kudu_runtime_filter_with_timestamp_conversion.test M testdata/workloads/functional-query/queries/QueryTest/partitioned-top-n-high-ndv.test M testdata/workloads/functional-query/queries/QueryTest/runtime_filters.test M tests/common/impala_test_suite.py M tests/util/test_file_parser.py 15 files changed, 126 insertions(+), 53 deletions(-) Approvals: Impala Public Jenkins: Verified Steve Carlin: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/24528 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ie22a66f0edad195cade74a8447efc83a8ce526f7 Gerrit-Change-Number: 24528 Gerrit-PatchSet: 19 Gerrit-Owner: Steve Carlin <[email protected]> Gerrit-Reviewer: Aman Sinha <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Jason Fehr <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Steve Carlin <[email protected]> Gerrit-Reviewer: Xuebin Su <[email protected]>
