yihua opened a new issue, #1001: URL: https://github.com/apache/hudi-rs/issues/1001
### Feature Description `TableBuilder` has no way to open a table over a caller-supplied `object_store::ObjectStore`: every `Storage` builds its store from the storage options and environment through `parse_url_opts`, which also limits tables to the URI schemes `object_store` recognises. An engine embedding hudi-rs usually already has its own I/O layer (a file or metadata cache, its own credential chain, its own filesystem abstraction or scheme), and needs every read and write of the table, including the metadata table and table services such as compaction, to go through that layer instead of a second, separately configured client. Proposal: add `TableBuilder::with_object_store(Arc<dyn ObjectStore>)`, which routes all of the table's I/O through the given store under any URI scheme. ### Additional context The Rust core API is the place to start; the DataFusion provider and the Python and C++ bindings can follow separately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
