westonpace opened a new pull request #9644: URL: https://github.com/apache/arrow/pull/9644
This moves the read to the IO context and runs continuations on the CPU thread pool. It does not add any parallelism. The resulting reader is not reentrant or async-reentrant and it does not do any fan-out parallelism for converting/etc. That follow-up can be addressed in ARROW-11889. This is needed by ARROW-7001 to enable nested parallelism in the datasets API. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org