RE: [openib-general] how to choose appropriate ULPs for application
FYI, you can find a kDAPL implementation for OpenIB at svn/gen2/users/jlentini/linux-kernel and a uDAPL implementation for OpenIB at svn/gen2/users/jlentini/userspace I can answer any questions you might have about these ULPs. I'm not familiar with NAL, so I can't comment on which ULP is right for you. On Wed, 6 Jul 2005, wangxigui wrote: Thank you very much! I'll read the materials that you supply. I have not described my plan clearly. I don't konw how to run lustre on IB. Neither do I konw the lustre running in kernel space or user space. Now the lustre NAL does not supports IB vapi. If I use IPoIB, it works. But it doen not take take advantage of RDMA. Supporse lustre NAL invoke SDP or uDAP, RDMA is enable. Invocation of Verb API to realize lustre NAL is my target. The SDP or uDAP is first step. Clem Cole said: The quick answer here is none of SDP, iSER/SRP or uDAPL for different reasons on each case kDAPL is the kernel API that is designed to handle a kernel application such as NFS, Lustre or the like. See: http://www.datcollaborative.org/kdapl.html There is are already implementations of NFS/RDMA available: http://www.sourceforge.net/projects/nfs-rdma This should give you some hints on how to a distrubuted file system uses the kDAPL interface. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, July 06, 2005 9:26 AM To: openib-general Subject: [openib-general] how to choose appropriate ULPs for application Hello！ We plan to run lustre on InfiniBand. But now lustre does not support IB. I know noting about the IB stack. So I think the IB Upper Layer Protocol(SDP, DAP) could be used to transport data for lustre. But there are too many ULPs over IB. I know little about them. As far as I konw, iSER/SRP is for SCSI command transportation. So, it seems both SDP and uDAP are OK for my plan. I cant tell the difference between them. Which one is better, SDP or DAP? I don't konw how to choose? Any suggestion is appreciated! 致 礼！ Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62564394(office) Email: [EMAIL PROTECTED] -- Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62565533-9314(office) Email: [EMAIL PROTECTED] -- Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62565533-9314(office) Email: [EMAIL PROTECTED] ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
RE: [openib-general] how to choose appropriate ULPs for application
There exists a NAL that supports the old gen1 IBAL stack and I thought that there was one for the gen1 topspin stack, but there is not one yet for gen2. I suspect that someone will write one pretty soon, but do not know if anyone has started this effort yet or not. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of wangxigui Sent: Wednesday, July 06, 2005 7:09 AM To: openib-general@openib.org Subject: RE: [openib-general] how to choose appropriate ULPs for application Thank you very much! I'll read the materials that you supply. I have not described my plan clearly. I don't konw how to run lustre on IB. Neither do I konw the lustre running in kernel space or user space. Now the lustre NAL does not supports IB vapi. If I use IPoIB, it works. But it doen not take take advantage of RDMA. Supporse lustre NAL invoke SDP or uDAP, RDMA is enable. Invocation of Verb API to realize lustre NAL is my target. The SDP or uDAP is first step. Clem Cole said: The quick answer here is none of SDP, iSER/SRP or uDAPL for different reasons on each case kDAPL is the kernel API that is designed to handle a kernel application such as NFS, Lustre or the like. See: http://www.datcollaborative.org/kdapl.html There is are already implementations of NFS/RDMA available: http://www.sourceforge.net/projects/nfs-rdma This should give you some hints on how to a distrubuted file system uses the kDAPL interface. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, July 06, 2005 9:26 AM To: openib-general Subject: [openib-general] how to choose appropriate ULPs for application Hello！ We plan to run lustre on InfiniBand. But now lustre does not support IB. I know noting about the IB stack. So I think the IB Upper Layer Protocol(SDP, DAP) could be used to transport data for lustre. But there are too many ULPs over IB. I know little about them. As far as I konw, iSER/SRP is for SCSI command transportation. So, it seems both SDP and uDAP are OK for my plan. I cant tell the difference between them. Which one is better, SDP or DAP? I don't konw how to choose? Any suggestion is appreciated! 致 礼！ Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62564394(office) Email: [EMAIL PROTECTED] -- Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62565533-9314(office) Email: [EMAIL PROTECTED] -- Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62565533-9314(office) Email: [EMAIL PROTECTED] ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
[openib-general] how to choose appropriate ULPs for application
Hello！ We plan to run lustre on InfiniBand. But now lustre does not support IB. I know noting about the IB stack. So I think the IB Upper Layer Protocol(SDP, DAP) could be used to transport data for lustre. But there are too many ULPs over IB. I know little about them. As far as I konw, iSER/SRP is for SCSI command transportation. So, it seems both SDP and uDAP are OK for my plan. I cant tell the difference between them. Which one is better, SDP or DAP? I don't konw how to choose? Any suggestion is appreciated! 致 礼！ Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62564394(office) Email: [EMAIL PROTECTED] ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
RE: [openib-general] how to choose appropriate ULPs for application
The quick answer here is none of SDP, iSER/SRP or uDAPL for different reasons on each case kDAPL is the kernel API that is designed to handle a kernel application such as NFS, Lustre or the like. See: http://www.datcollaborative.org/kdapl.html There is are already implementations of NFS/RDMA available: http://www.sourceforge.net/projects/nfs-rdma This should give you some hints on how to a distrubuted file system uses the kDAPL interface. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, July 06, 2005 9:26 AM To: openib-general Subject: [openib-general] how to choose appropriate ULPs for application Hello！ We plan to run lustre on InfiniBand. But now lustre does not support IB. I know noting about the IB stack. So I think the IB Upper Layer Protocol(SDP, DAP) could be used to transport data for lustre. But there are too many ULPs over IB. I know little about them. As far as I konw, iSER/SRP is for SCSI command transportation. So, it seems both SDP and uDAP are OK for my plan. I cant tell the difference between them. Which one is better, SDP or DAP? I don't konw how to choose? Any suggestion is appreciated! 致 礼！ Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62564394(office) Email: [EMAIL PROTECTED] ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
RE: [openib-general] how to choose appropriate ULPs for application
Thank you very much! I'll read the materials that you supply. I have not described my plan clearly. I don't konw how to run lustre on IB. Neither do I konw the lustre running in kernel space or user space. Now the lustre NAL does not supports IB vapi. If I use IPoIB, it works. But it doen not take take advantage of RDMA. Supporse lustre NAL invoke SDP or uDAP, RDMA is enable. Invocation of Verb API to realize lustre NAL is my target. The SDP or uDAP is first step. Clem Cole said: The quick answer here is none of SDP, iSER/SRP or uDAPL for different reasons on each case kDAPL is the kernel API that is designed to handle a kernel application such as NFS, Lustre or the like. See: http://www.datcollaborative.org/kdapl.html There is are already implementations of NFS/RDMA available: http://www.sourceforge.net/projects/nfs-rdma This should give you some hints on how to a distrubuted file system uses the kDAPL interface. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, July 06, 2005 9:26 AM To: openib-general Subject: [openib-general] how to choose appropriate ULPs for application Hello！ We plan to run lustre on InfiniBand. But now lustre does not support IB. I know noting about the IB stack. So I think the IB Upper Layer Protocol(SDP, DAP) could be used to transport data for lustre. But there are too many ULPs over IB. I know little about them. As far as I konw, iSER/SRP is for SCSI command transportation. So, it seems both SDP and uDAP are OK for my plan. I cant tell the difference between them. Which one is better, SDP or DAP? I don't konw how to choose? Any suggestion is appreciated! 致 礼！ Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62564394(office) Email: [EMAIL PROTECTED] -- Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62565533-9314(office) Email: [EMAIL PROTECTED] -- Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62565533-9314(office) Email: [EMAIL PROTECTED] ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] how to choose appropriate ULPs for application
I would also recommend studying DAFS, and in particular the differences between DAFS and NFS over RDMA. NFS over RDMA leaves most of the existing file system logic intact and basically optimizes the exchange of individual messages over RDMA. Using SDP would be a somewhat similar strategy, with slightly less optimizations. The key benefit being minimal disruption of existing file system layer code. DAFS would be an example of fully optimizing the peer-to-peer communication to optimize for RDMA. If your application lacks an existing intermediate layer, such as RPC, that type of approach may be required to get the full benefit of RDMA. Such an approach would suggest the use of kDAPL. But I would recommend against use of kDAPL if you are only replacing the transport of messages locked to socket semantics. If you are going to keep the socket semantics then definitely use SDP. On 7/6/05, 王锡贵 [EMAIL PROTECTED] wrote: Hello！ We plan to run lustre on InfiniBand. But now lustre does not support IB. I know noting about the IB stack. So I think the IB Upper Layer Protocol(SDP, DAP) could be used to transport data for lustre. But there are too many ULPs over IB. I know little about them. As far as I konw, iSER/SRP is for SCSI command transportation. So, it seems both SDP and uDAP are OK for my plan. I cant tell the difference between them. Which one is better, SDP or DAP? I don't konw how to choose? Any suggestion is appreciated! 致 礼！ Sincerely yours Wang Xigui 王锡贵 2005-07-06 Computer Architecture Laboratory Institute of Computing Technology Chinese Academy of Sciences Beijing,P.R.China Zip code: 100080 Tel: +86-10-62564394(office) Email: [EMAIL PROTECTED] ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
