tustvold commented on issue #380: URL: https://github.com/apache/arrow-rs-object-store/issues/380#issuecomment-2907800942
I think a logging store is potentially useful, although it might make more sense as an HttpService wrapper now that they exist. With regards to read-ahead, I'm a little torn. The design of object_store is to encourage people to avoid using cursor-based access patterns that warrant this sort of incremental read-ahead pattern - https://docs.rs/object_store/0.12.0/object_store/#why-not-a-filesystem-interface. Instead people should identify the range up front, and fetch and process it, potentially in a streaming fashion where applicable. That being said I appreciate people might have existing codebases with such access patterns, but I'm not sure to what extent we want to encourage this... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
