yjshen commented on issue #1313:
URL:
https://github.com/apache/arrow-datafusion/issues/1313#issuecomment-969919591
Hi @roeap , the current usages of sync version of object store API in
DataFusion are because Parquet/CSV/JSON/Avro readers/writers in arrow-rs are
all constructed based on `std::io::{Read, Seek, SeekFrom, Write...}` APIs,
which are all sync trait.
We could certainly move to use the async version of object store when the
file format reader/writers are re-implemented using async API. Please refer to
https://github.com/apache/arrow-rs/issues/111 if you are interested in making
these readers/writers async first.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
