[
https://issues.apache.org/jira/browse/IMPALA-14804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18079790#comment-18079790
]
ASF subversion and git services commented on IMPALA-14804:
----------------------------------------------------------
Commit 384d863ebaeea307da27f15203b7c9a516827c11 in impala's branch
refs/heads/master from Csaba Ringhofer
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=384d863eb ]
IMPALA-14804: (addendum) Refactor IcebergTable.loadFileMetadata()
Extract file descriptor loading from IcebergTable.loadFileMetadata()
to static function IcebergFileMetadataLoader.loadContentFilesStore().
The main goal is to make this reusable from
https://gerrit.cloudera.org/#/c/24049/ and avoid making that patch
more noisy.
Also has a diagnostic change: "Loaded Iceberg file descriptors"
event in catalog timeline is moved after IcebergContentFileStore
creation. It makes much more sense to track the time there
instead of the previous state ("Loaded avro schema").
Generated-by: Claude Sonnet 4.6
Change-Id: I0e6bc981b4b91b4c92c6c29a3066b106ea722204
Reviewed-on: http://gerrit.cloudera.org:8080/24273
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Improve incremental updates of Iceberg tables
> ---------------------------------------------
>
> Key: IMPALA-14804
> URL: https://issues.apache.org/jira/browse/IMPALA-14804
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Csaba Ringhofer
> Assignee: Csaba Ringhofer
> Priority: Critical
> Fix For: Impala 5.0.0
>
>
> Currently all files are taken from Iceberg and compared to old file
> descriptors based on hash. This avoids reloading file descriptors, but can be
> still very slow if the table is large.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
