Zoltán Borók-Nagy created IMPALA-14853:
------------------------------------------
Summary: Add support for credential vending via Iceberg REST
Catalogs
Key: IMPALA-14853
URL: https://issues.apache.org/jira/browse/IMPALA-14853
Project: IMPALA
Issue Type: New Feature
Components: Backend, Frontend
Reporter: Zoltán Borók-Nagy
Iceberg REST catalogs have a feature called "credential vending". Via this
mechanism the Iceberg REST server can hand out temporary storage credentials
(e.g. S3 access keys or tokens) to the clients with which they can access the
underlying storage.
Impala should be able to utilize these temporary credentials:
* get vended credentials from Iceberg REST server during query planning
* distribute credentials to the executors in the query plan
* Backend IO layer should be able to read files with provided credentials
It's possible that Impala is configured with multiple REST Catalogs, and it
needs to read multiple tables from different catalogs in a single query. To
make this scenario work, vended credentials need to be associated with
tables/scans operators.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
