kevinjqliu commented on issue #899: URL: https://github.com/apache/datafusion-python/issues/899#issuecomment-2715086281
sure, the main issue is figuring out how to pass the credentials from one system to the other. I would like to load an iceberg table object using pyiceberg and then register the table as a table provider with datafusion-python. Internally, pyiceberg uses iceberg-rust to interface with the `__datafusion_table_provider__` trait. The iceberg table object is "recreated" in iceberg-rust using its metadata.json file. Heres an example from the WIP PR https://github.com/kevinjqliu/iceberg-rust/pull/2/files#diff-edc1fdc3ace9b88d4f61113ff01e977eb928495adaa25c9e03aa07cfc5d6aceeR64 I want to figure out a way to automatically pass credentials from pyiceberg -> iceberg-rust -> datafusion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
