weiji14 commented on issue #5090: URL: https://github.com/apache/opendal/issues/5090#issuecomment-3051085290
Did you try with `CUDF_KVIKIO_REMOTE_IO=ON` (available since [cudf=24.12](https://developer.nvidia.com/blog/rapids-24-12-introduces-cudf-on-pypi-cuda-unified-memory-for-polars-and-faster-gnns/#faster_io_from_aws_s3_remote_storage))? From reading https://developer.nvidia.com/blog/high-performance-remote-io-with-nvidia-kvikio/, `kvikIO` should support Remote IO from s3 already, though GDS can be tricky to set up... > We could still try some third-party libraries like [cudarc](https://github.com/coreylowman/cudarc); maybe it will be sufficient for our use case. Perhaps others might have better ideas? FYI, someone's trying to add cuFile bindings to `cudarc` - https://github.com/coreylowman/cudarc/issues/403 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
