morristai commented on issue #5090: URL: https://github.com/apache/opendal/issues/5090#issuecomment-3053114263
> Did you try with `CUDF_KVIKIO_REMOTE_IO=ON` (available since [cudf=24.12](https://developer.nvidia.com/blog/rapids-24-12-introduces-cudf-on-pypi-cuda-unified-memory-for-polars-and-faster-gnns/#faster_io_from_aws_s3_remote_storage))? From reading https://developer.nvidia.com/blog/high-performance-remote-io-with-nvidia-kvikio/, `kvikIO` should support Remote IO from s3 already, though GDS can be tricky to set up... @weiji14 It works! The setup process is very straightforward. (Although it keeps looking for `/etc/pki/tls/certs/ca-bundle.crt` even if you set `CURL_CA_BUNDLE`) But everything works like a charm. Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
