tustvold commented on PR #6157: URL: https://github.com/apache/arrow-rs/pull/6157#issuecomment-2308434411
I'm pretty apprehensive about changing the default behaviour to use suffix requests given there are stores that are known to not support them. I wonder what you think of instead performing the initial suffix read of the prefetch size manually, and then constructing an AsyncFileReader with these bytes cached? This initial fetch request would tell you the total size of the object and so no changes would be necessary to traits, allowing us to keep the current simple interface and avoid potential compatibility footguns -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
