Re: [I] `datafusion-cli`: Use correct S3 region if it is not specified [datafusion]
alamb commented on issue #16306: URL: https://github.com/apache/datafusion/issues/16306#issuecomment-2970456923 Thank you for starting to look into it @liamzwbao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] `datafusion-cli`: Use correct S3 region if it is not specified [datafusion]
alamb commented on issue #16306: URL: https://github.com/apache/datafusion/issues/16306#issuecomment-2970455674 > Retry upon the region specified by user is wrong. (1 request for correct region, 3 requests for wrong region) This would be my preferred behavior for datafusion-cli And maybe we can add a `WARN` (`log::warn`) style message / hint that says the region was incorrect and datafusion-cli is finding the correct one automatically, but that this is slow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] `datafusion-cli`: Use correct S3 region if it is not specified [datafusion]
liamzwbao commented on issue #16306: URL: https://github.com/apache/datafusion/issues/16306#issuecomment-2968741593 Hi @alamb, from the upstream ticket, I think we can use `resolve_bucket_region` to get the region if it's not specified. However, I'm wondering what should be the expected behavior if user explicitly specify the region. Here are several options: 1. Do not resolve bucket region if it's provided already. This would fail the request if user set the wrong region (may not be a good user experience) 2. Always resolve the bucket to get the right region. This would make the region config useless and probably have performance issue? (2 requests on average) 3. Retry upon the region specified by user is wrong. (1 request for correct region, 3 requests for wrong region) Would appreciate your thoughts on this. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] `datafusion-cli`: Use correct S3 region if it is not specified [datafusion]
liamzwbao commented on issue #16306: URL: https://github.com/apache/datafusion/issues/16306#issuecomment-296858 take -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
Re: [I] `datafusion-cli`: Use correct S3 region if it is not specified [datafusion]
alamb commented on issue #16306: URL: https://github.com/apache/datafusion/issues/16306#issuecomment-2949467314 - Filed https://github.com/apache/arrow-rs-object-store/issues/402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
