crepererum opened a new pull request, #4015: URL: https://github.com/apache/arrow-rs/pull/4015
# Which issue does this PR close? \- # Rationale for this change In DataFusion (and potentially other users of `object_store`) people run CPU-bound tasks within a tokio runtime. In a larger setting, this can easily stall and destabilize IO tasks (e.g. TLS connections) because tokio is unable to task-steal from CPU-blocked worker threads. Users may observe this as TLS connection failures or timeouts. # What changes are included in this PR? A `CrossRtStore` object store wrapper that ensures that the store-related futures are executed within an IO-specific runtime. Extensive tests for blocking and cancellation are added. # Are there any user-facing changes? Users may now use `CrossRtStore` to protect object store IO from being stalled. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
