timsaucer commented on issue #970: URL: https://github.com/apache/datafusion-python/issues/970#issuecomment-5700625263
I know this is a very old issue, but I've looked into the root cause of it. The `datafusion-cli` adds in a special configuration option for AWS credentials. In `datafusion-python` the more canonical way to add these credentials is documented at https://datafusion.apache.org/python/user-guide/data-sources.html#object-store If you have a specific need to be able to add credentials via configuration we could go the route of adding a configuration extension as [shown here in datafusion-cli](https://github.com/apache/datafusion/blob/140c7c5a4cbde4409a4d29a4c04032d618c3b8ce/datafusion-cli/src/object_storage.rs#L353) but for right now I suspect using the credentials from the OS is the better path forward. If you need that configuration option you could either add it as a user defined configuration option and expose it to python or we could consider adding it to this project. For the latter, we'd probably want more justification since the canonical support method already exists. Please reopen this issue if you need further asssistance! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
