Re: Storage Based Authorization for s3a warehouse

2023-01-17 Thread Marco Jacopo Ferrarotti
Thank you Wen, you made my day. I think this is exactly what I was talking about. I might just need to implement a proper credential provider for my use case. One curiosity though, I see that you check for read/write permissions only. You never test if the credentials are able to delete objects wh

Re: Storage Based Authorization for s3a warehouse

2023-01-17 Thread Wen Shi via user
Hi Marco, You can check this out: https://github.com/awslabs/amazon-emr-user-role-mapper/tree/master/emr-user-role-mapper-s3storagebasedauthorizationmanager It is open sourced with AWS EMR utils named URM and we have been using it for two years now. Thanks Wen On Tue, Jan 17, 2023 at 1:12 AM Ma

Storage Based Authorization for s3a warehouse

2023-01-17 Thread Marco Jacopo Ferrarotti
Hi, I'm building an on prem data warehouse with a custom s3 gateway as storage backend. I was able to deploy a standalone Hive Metastore Server (HMS) secured by kerberos however now I'm having a hard time figuring out how to manage authorization. It seems to me that the storage based authorizatio