yihua opened a new issue, #1001:
URL: https://github.com/apache/hudi-rs/issues/1001

   ### Feature Description
   
   `TableBuilder` has no way to open a table over a caller-supplied 
`object_store::ObjectStore`: every `Storage` builds its store from the storage 
options and environment through `parse_url_opts`, which also limits tables to 
the URI schemes `object_store` recognises. An engine embedding hudi-rs usually 
already has its own I/O layer (a file or metadata cache, its own credential 
chain, its own filesystem abstraction or scheme), and needs every read and 
write of the table, including the metadata table and table services such as 
compaction, to go through that layer instead of a second, separately configured 
client.
   
   Proposal: add `TableBuilder::with_object_store(Arc<dyn ObjectStore>)`, which 
routes all of the table's I/O through the given store under any URI scheme.
   
   ### Additional context
   
   The Rust core API is the place to start; the DataFusion provider and the 
Python and C++ bindings can follow separately.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to