tustvold commented on PR #6999: URL: https://github.com/apache/arrow-rs/pull/6999#issuecomment-2602473598
> Would it be beneficial to have the right APIs to make it possible to pre-fetch the entire file? E.g. if I'm going to load a <1MB parquet file I might want to just make a single request to object storage and know I have everything I need instead of loading the metadata In such a scenario you're best off just fetching the entire file and feeding the `Bytes` to the synchronous readers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
