Re: Socket Direct Protocol: help (2)

2010-04-23 Thread Andrea Gozzelino
Hi Amir, have you any news about bugs 2027 and 2028 (SDP)? Take care and keep in touch. Thamk you very much, Andrea On Apr 21, 2010 02:01 PM, Amir Vadai wrote: > Hi Andrea, > > I am preparing the fix right now. > > - Amir > > On 04/20/2010 04:53 PM, Andrea Gozzelino wrote: > > Hi Amir, >

Re: Socket Direct Protocol: help (2)

2010-04-21 Thread Amir Vadai
Hi Andrea, I am preparing the fix right now. - Amir On 04/20/2010 04:53 PM, Andrea Gozzelino wrote: > Hi Amir, > > have you any news about bugs 2027 "SDP not respecting # SGEs as reported > from HW" and 2028 "SDP should support fastreg mrs"? > > When those bugs will be fixed, I will test the NE0

Re: Socket Direct Protocol: help (2)

2010-04-20 Thread Andrea Gozzelino
Hi Amir, have you any news about bugs 2027 "SDP not respecting # SGEs as reported from HW" and 2028 "SDP should support fastreg mrs"? When those bugs will be fixed, I will test the NE020 cards performance with SDP protocol and I will compare SDP and TCP. Keep in touch, Andrea Gozzelino INFN -

Re: Socket Direct Protocol: help (2)

2010-04-15 Thread Amir Vadai
It should be a simple fix and I plan to do soon - just add yourself as CC in bugzilla - that way I won't forget to notify you. - amir On 04/15/2010 10:07 AM, Andrea Gozzelino wrote: > On Apr 15, 2010 08:24 AM, Amir Vadai wrote: > > >> I hope to have a fix next week for the first one. >> >> T

Re: Socket Direct Protocol: help (2)

2010-04-15 Thread Andrea Gozzelino
On Apr 15, 2010 08:24 AM, Amir Vadai wrote: > I hope to have a fix next week for the first one. > > Thanks, > Amir > > On 04/14/2010 09:48 PM, Tung, Chien Tin wrote: > >> Tung, Chien Tin wrote: > >> > One more thing - Please open a bug regarding the num_sge > limitation at: > >>>

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Amir Vadai
I hope to have a fix next week for the first one. Thanks, Amir On 04/14/2010 09:48 PM, Tung, Chien Tin wrote: >> Tung, Chien Tin wrote: >> One more thing - Please open a bug regarding the num_sge limitation at: https://bugs.openfabrics.org/ >>> Done, Bug 2027. >>

RE: Socket Direct Protocol: help (2)

2010-04-14 Thread Tung, Chien Tin
>I work on NE020 cards from February 2010 for an INFN experimental >proposal, called REDIGO (Read out at 10 Gbits/s), about the data >acquisition and movement systems. The covergence of storage protocols >around 10 Gigabits/s Ethernet protocols shows that one way could be the >Remote Direct Memory

RE: Socket Direct Protocol: help (2)

2010-04-14 Thread Tung, Chien Tin
>Tung, Chien Tin wrote: >>> One more thing - Please open a bug regarding the num_sge limitation at: >>> https://bugs.openfabrics.org/ >>> >> >> Done, Bug 2027. >> >> Chien >> > >And 2028 opened to request fastreg support. > I am open to test fixes for these two bugs. Chien -- To unsubscribe from

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Amir Vadai
ok - actually I used it in an early version of SDP before changing to FMR... - Amir On 04/14/2010 06:08 PM, Steve Wise wrote: > Amir Vadai wrote: > >> You are right - I missed it. >> >> Andrea, Please open a bug at bugzilla (https://bugs.openfabrics.org) - >> so that you will be notified as so

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Andrea Gozzelino
Thank you very much. I check the status of 2027 and 2028 bugs. Andrea n Apr 14, 2010 05:05 PM, Steve Wise wrote: > Tung, Chien Tin wrote: > >> One more thing - Please open a bug regarding the num_sge limitation > >> at: > >> https://bugs.openfabrics.org/ > >> > > > > Done, Bug 2027. > > >

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Steve Wise
Amir Vadai wrote: You are right - I missed it. Andrea, Please open a bug at bugzilla (https://bugs.openfabrics.org) - so that you will be notified as soon as I will fix SDP not use FMR if not supported. As to fastreg_mrs support - I don't know this mechanism. Do you mean FRWR? ib_alloc_fa

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Steve Wise
Tung, Chien Tin wrote: One more thing - Please open a bug regarding the num_sge limitation at: https://bugs.openfabrics.org/ Done, Bug 2027. Chien And 2028 opened to request fastreg support. Steve. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Amir Vadai
You are right - I missed it. Andrea, Please open a bug at bugzilla (https://bugs.openfabrics.org) - so that you will be notified as soon as I will fix SDP not use FMR if not supported. As to fastreg_mrs support - I don't know this mechanism. Do you mean FRWR? Thanks, Amir On 04/14/2010 05:54 P

RE: Socket Direct Protocol: help (2)

2010-04-14 Thread Tung, Chien Tin
>One more thing - Please open a bug regarding the num_sge limitation at: >https://bugs.openfabrics.org/ Done, Bug 2027. Chien -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.o

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Steve Wise
Hey Amir, I don't think this helps because sdp_add_device() will not add rdma devices that fail to create fmr pools. So I guess you could key off of fmr pool failures and set sdp_zcopy_thresh to 0 and allow the device to be used? But what we really need is sdp support for fastreg_mrs as an

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Amir Vadai
One more thing - Please open a bug regarding the num_sge limitation at: https://bugs.openfabrics.org/ Thanks, Amir On 04/14/2010 05:31 PM, Amir Vadai wrote: > Hi, > > FMR are being used only in a special mode called ZCopy. > > You could disable this mode by setting the module paramter > sdp_zcopy

Re: Socket Direct Protocol: help (2)

2010-04-14 Thread Amir Vadai
Hi, FMR are being used only in a special mode called ZCopy. You could disable this mode by setting the module paramter sdp_zcopy_thresh to 0, or by issuing: # echo 0 > /sys/module/ib_sdp/parameters/sdp_zcopy_thresh This means that you won't get the benefits of Zero-copy. - Amir On 04/14/2010 1

RE: Socket Direct Protocol: help (2)

2010-04-14 Thread Andrea Gozzelino
On Apr 13, 2010 10:22 PM, "Tung, Chien Tin" wrote: > >>> Chien, does the NE020 support FMRs? I looked at the nes ofed-1.5 > >>> code > >>> and it appears to do nothing in the map_phys_fmr functions. > >>> > >> > >> We never implemented map_phys_fmr. Is it relevant to the # of SGEs? > >> > >No, bu

RE: Socket Direct Protocol: help (2)

2010-04-13 Thread Tung, Chien Tin
>>> Chien, does the NE020 support FMRs? I looked at the nes ofed-1.5 code >>> and it appears to do nothing in the map_phys_fmr functions. >>> >> >> We never implemented map_phys_fmr. Is it relevant to the # of SGEs? >> >No, but SDP uses FMRs. I don't think it will run without FMR support. > Go

Re: Socket Direct Protocol: help (2)

2010-04-13 Thread Steve Wise
Tung, Chien Tin wrote: NE020 supports 4 SGEs. I don't know enough about SDP to know why it is using this calculation for # of send_sge: #define SDP_MAX_RECV_SKB_FRAGS (PAGE_SIZE > 0x8000 ? 1 : 0x8000 / PAGE_SIZE) Chien, does the NE020 support FMRs? I looked at the nes ofed-1.5 code a

RE: Socket Direct Protocol: help (2)

2010-04-13 Thread Tung, Chien Tin
>> NE020 supports 4 SGEs. I don't know enough about SDP to know why it is >> using this calculation for # of send_sge: >> >> #define SDP_MAX_RECV_SKB_FRAGS (PAGE_SIZE > 0x8000 ? 1 : 0x8000 / PAGE_SIZE) >> >> > >Chien, does the NE020 support FMRs? I looked at the nes ofed-1.5 code >and it appears

Re: Socket Direct Protocol: help (2)

2010-04-13 Thread Steve Wise
NE020 supports 4 SGEs. I don't know enough about SDP to know why it is using this calculation for # of send_sge: #define SDP_MAX_RECV_SKB_FRAGS (PAGE_SIZE > 0x8000 ? 1 : 0x8000 / PAGE_SIZE) Chien, does the NE020 support FMRs? I looked at the nes ofed-1.5 code and it appears to do noth

RE: Socket Direct Protocol: help (2)

2010-04-13 Thread Tung, Chien Tin
>I add that in kernel space SDP debug the error is: > >command line: dmesg >sdp_init_qp:95 sdp_sock( 2100:2 40720:0): recv sge's. capability: 4 >needed: 9 >sdp_init_qp:95 sdp_sock( 2100:2 41203:0): recv sge's. capability: 4 >needed: 9 > >The structure sdp_init_qp() is defined in >/usr/src/ofa_kerne