[
https://issues.apache.org/jira/browse/HDDS-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18088839#comment-18088839
]
Ivan Andika commented on HDDS-15353:
------------------------------------
Found another implementation of RDMA in SparkRDMA
[https://github.com/Mellanox/SparkRDMA] (Mellanox was acquired by NVIDIA in
2019 so seems the SparkRDMA was archived after the acquisition). The NVIDIA
docs is https://enterprise-support.nvidia.com/s/article/apache-spark-rdma-plugin
> Support GPUDirectStorage
> ------------------------
>
> Key: HDDS-15353
> URL: https://issues.apache.org/jira/browse/HDDS-15353
> Project: Apache Ozone
> Issue Type: New Feature
> Reporter: Ivan Andika
> Assignee: Ivan Andika
> Priority: Major
>
> Support GPUDirectStorage (https://docs.nvidia.com/gpudirect-storage/) by
> implementing the CuObject and CuFile APIs. This requires RDMA so it might be
> very far in the future (i.e. we need might need to use or write a library
> using RDMA). There is also
> https://blogs.nvidia.com/blog/s3-compatible-ai-storage/ that implements RDMA
> on top of S3-compatible storage.
> See GDS implementation on 3FS (https://github.com/deepseek-ai/3FS/pull/407)
> and SeaweedFS RDMA on Rust (https://github.com/seaweedfs/seaweedfs/pull/7140)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
