Kimahriman opened a new issue, #424: URL: https://github.com/apache/arrow-rs-object-store/issues/424
**Which part is this question about** <!-- Is it code base, library api, documentation or some other part? --> Code base **Describe your question** <!-- A clear and concise description of what the question is. --> I am the creator of [hdfs-native](https://github.com/Kimahriman/hdfs-native) and the object store implementation that sits on top of it [hdfs-native-object-store](https://github.com/datafusion-contrib/hdfs-native-object-store). I'm wondering if I could just roll the object store implementation directly into this crate. The object store implementation itself is a fairly small wrapper around the underlying `hdfs-native` library, so there shouldn't be a huge maintenance tail involved, and it would be great to get more eyes on how I have implemented the `object_store` semantics. There are a few other crates I know of now relying on this object store, and whenever there's a new `object_store` minor release they are also dependent on me cutting a new release of my crate for binary compatibility, and usually there are very minor API changes I just need to make. Delta is currently the only library that has a dependency on it, but there other non-library projects using it as well, though I don't remember all of them off the top of my head. https://crates.io/crates/hdfs-native-object-store/reverse_dependencies https://github.com/lakehq/sail Additionally polars attempted to add HDFS support but chose not too partially because of the uncertainty of whether the crate would be supported: https://github.com/pola-rs/polars/pull/17506 There are a decent number of additional dependencies it would add, but it shouldn't be a huge issue if it's behind a feature I assume. **Additional context** <!-- Add any other context about the problem here. --> If you are willing to accept it, I can work on a PR (and probably cleaning things up a little bit) as well as figuring out how/what other integration tests I should add. Any users with questions or errors would most likely just need to be forwarded to `hdfs-native` repo for me to investigate. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
