tustvold commented on issue #7171: URL: https://github.com/apache/arrow-rs/issues/7171#issuecomment-2684708664
With https://github.com/apache/arrow-rs/pull/7183 we will have a mechanism to introduce request-oriented middleware, along with more sophisticated logic for doing things like: * Request-oriented metrics * Concurrency limiting * Spawning IO to different thread pools This will reduce the need for ObjectStore wrappers, as well as address a number of their more glaring deficiencies. However, it will not address the need to get context (#7155) through the ObjectStore trait either for use within an ObjectStore wrapper, or within the HTTPClient. As such I think we should proceed with #7170, as I don't really see a viable alternative to doing this. I also am excited by the possibilities of combining #7183 and #7170 to allow doing things like carrying information into S3 access logs as described [here](https://docs.aws.amazon.com/AmazonS3/latest/userguide/LogFormat.html#LogFormatCustom). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
