Re: [DISCUSS] Supporting region attribute in vended credentials for AWS

2024-09-13 Thread Michael Collado
Currently, we can set table defaults at the catalog level - e.g., we do this to set the s3 endpoint in tests: https://github.com/apache/polaris/blob/main/polaris-service/src/test/java/org/apache/polaris/service/catalog/PolarisSparkIntegrationTest.java#L151-L158 The plan for StorageConfigurationInf

Re: [DISCUSS] Supporting region attribute in vended credentials for AWS

2024-09-13 Thread Robert Stupp
I think that the particular S3FileIO config and the credential(s) for it can differ between tables. It is (or can be) possible, although not common, that different tables use different buckets - which may even be on different object store systems (AWS, Minio, Ceph) or even different object sto

Re: [DISCUSS] Supporting region attribute in vended credentials for AWS

2024-09-13 Thread Jean-Baptiste Onofré
Hi, It makes sense to me, and almost already done via entity (table) property. I think it makes sense to create GitHub issue to implement/document that. Regards JB On Thu, Sep 12, 2024 at 11:54 PM Aniket Kulkarni wrote: > > On Thu, Sep 12, 2024 at 02:38:30PM UTC, Robert Stupp wrote: > > What wo