johnpyp commented on issue #2795: URL: https://github.com/apache/arrow-rs/issues/2795#issuecomment-2285028221
The bucket to redirect to is actually provided in the response headers, as `x-amz-bucket-region`. The botocore library and thus awscli v2 use this to automatically do the redirect ([source](https://github.com/boto/botocore/blob/3e85531776532a9de1accbb86180698017bacc6f/botocore/utils.py#L1706)). And the latest aws-sdk-js-v3 library does too ([source](https://github.com/aws/aws-sdk-js-v3/blob/1a479dc8a26dfacef950b4d86631f168b55f3561/packages/middleware-sdk-s3/src/region-redirect-middleware.ts#L44)) And the aws-sdk-java-v2 library does ([source](https://github.com/aws/aws-sdk-java-v2/blob/431d022aad26c6639a9b5db4b463b8aba1362988/services/s3/src/main/java/software/amazon/awssdk/services/s3/internal/crossregion/S3CrossRegionAsyncClient.java#L98)), when enabled. This isn't quite consistent among all the SDKs, like you pointed out the Go SDK doesn't have it, and neither does the Rust one from a brief glance. This seems like it would be a nice option to at least be configurable if not the default, for use-cases like the `datafusion-cli` where this would be quite convenient. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
