Peter Rozsa has uploaded a new patch set (#3). ( http://gerrit.cloudera.org:8080/21871 )
Change subject: IMPALA-12861: Fix mixed file format listing for Iceberg tables ...................................................................... IMPALA-12861: Fix mixed file format listing for Iceberg tables This change fixes file format information collection for Iceberg tables. Previously, file formats were collected from getSampledOrRawPartitions() in HdfsScanNode for Iceberg tables, now the collection part is extracted as a method and it's overridden in IcebergScanNode to do nothing. The file format collection is done during planning time when the selected file descriptors are looped through. This change also changes the underlying file format collection method by using bit flags derived from FbIcebergDataFileFormat. Tests: - Planner tests added for mixed file format table with partitioning. Change-Id: Ifae900914a0d255f5a4d9b8539361247dfeaad7b --- M common/fbs/IcebergObjects.fbs M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java M fe/src/main/java/org/apache/impala/planner/IcebergScanNode.java M fe/src/test/java/org/apache/impala/planner/PlannerTest.java M testdata/datasets/functional/functional_schema_template.sql M testdata/datasets/functional/schema_constraints.csv A testdata/workloads/functional-planner/queries/PlannerTest/iceberg-mixed-file-format.test 7 files changed, 321 insertions(+), 38 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/71/21871/3 -- To view, visit http://gerrit.cloudera.org:8080/21871 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ifae900914a0d255f5a4d9b8539361247dfeaad7b Gerrit-Change-Number: 21871 Gerrit-PatchSet: 3 Gerrit-Owner: Peter Rozsa <pro...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Zoltan Borok-Nagy <borokna...@cloudera.com>
