[
https://issues.apache.org/jira/browse/IMPALA-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18074456#comment-18074456
]
ASF subversion and git services commented on IMPALA-14896:
----------------------------------------------------------
Commit c101e5f5832ed3082670ab293bc265564ef48d7a in impala's branch
refs/heads/master from Csaba Ringhofer
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=c101e5f58 ]
IMPALA-14896: Do less GetPartialCatalogObject for Iceberg tables
Before this patch 5 GetPartialCatalogObject RPCs were needed
to catalog to load an Iceberg table. This patch removes 2
(loadPartitionsByRefs, loadPartitionList) which have trivial results
for Iceberg tables and don't need caching. This logic was already
implemented for Iceberg REST catalog in IcebergMetaProvider.
Change-Id: I9bbb6cf08a15e8ad2a76acd86380b87f06fc25a5
Reviewed-on: http://gerrit.cloudera.org:8080/24197
Reviewed-by: Noemi Pap-Takacs <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Avoid extra GetPartialCatalogObject calls in Icebert table loading
> ------------------------------------------------------------------
>
> Key: IMPALA-14896
> URL: https://issues.apache.org/jira/browse/IMPALA-14896
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog, Frontend
> Reporter: Csaba Ringhofer
> Assignee: Csaba Ringhofer
> Priority: Major
> Labels: iceberg
>
> Currently loading an Iceberg table loads 5 cache object and lead to 5
> GetPartialCatalogObject RPCs:
> 1. CatalogdMetaProvider.loadTable()
> 2. CatalogdMetaProvider.loadIcebergTable()
> 3. CatalogdMetaProvider.loadTableColumnStatistics()
> 4. CatalogdMetaProvider.loadPartitionList()
> 5. CatalogdMetaProvider.loadPartitionsByRefs()
> 4 and 5 return dummy result in Iceberg and could be skipped
> https://gerrit.cloudera.org/#/c/24049/ is POC patch and implements this
> among other things,
> Note that IMPALA-14806 / https://gerrit.cloudera.org/#/c/24177/ adds an extra
> call (CatalogdMetaProvider.loadIcebergContentFileStore)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
