vyasr commented on issue #5090: URL: https://github.com/apache/opendal/issues/5090#issuecomment-3501046702
The main value-add that kvikio provides on top of lower-level cuFile APIs is that it detects GDS availability at runtime and provides transparent fallback to POSIX-based I/O when GDS is not available that uses multithreaded host reads along with coordinated H2D data transfers. GDS remains a bit of a bear to set up on many machines, so having the ability to run on all machines is useful. The core cufile bindings in both Python and C++ will wind up outside of kvikio, but we'll likely also retain some higher-level wrappers around those to provide a better UX. For example, in Python we'll probably try to offer something Pythonic that looks like standard Python io file types, whereas cuda-python will (at least initially) be focused more on providing raw cuFile Python bindings. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
