Re: Writing RDMA applications on Linux

2012-08-30 Thread Gaetano Mendola
that Sean can fix it in a blink of an eye. Let me know, I would like to adopt rsocket in my application instead of my own implementation but until rsocket is not fixed I have to stick with my implementation. Gaetano On Wed, Aug 29, 2012 at 6:03 PM, Gaetano Mendola mend...@gmail.com wrote: I

Re: Writing RDMA applications on Linux

2012-08-29 Thread Gaetano Mendola
On Wed, Aug 29, 2012 at 12:51 AM, Hefty, Sean sean.he...@intel.com wrote: I'm not sure if I have to say sorry for the noise or not but it seems that the issue was just an NUMA issue! that's good news May be rsocket has to do a memory affinity on the node with the IB board attached on

Re: Writing RDMA applications on Linux

2012-08-29 Thread Gaetano Mendola
modification on my code now it doesn't matter on which NUMA node I do the affinity (mem/cpu) I'm getting around 1400MB/sec Gaetano On Wed, Aug 29, 2012 at 10:27 AM, Gaetano Mendola mend...@gmail.com wrote: On Wed, Aug 29, 2012 at 12:51 AM, Hefty, Sean sean.he...@intel.com wrote: I'm not sure if I

Re: Writing RDMA applications on Linux

2012-08-28 Thread Gaetano Mendola
I'm not sure if I have to say sorry for the noise or not but it seems that the issue was just an NUMA issue! My system is a 2 node NUMA system and the IB board is attached on NODE 0. Not performing any cpu/mem affinity it seems the code runs on the worst node, always! Without affinity ( I did run

Writing RDMA applications on Linux

2012-08-24 Thread Gaetano Mendola
Hi, as told you on twitter I wrote using ib berbs and rdma a communication channel between a server and a client . I used your paper to understand the IBV/RDMA however I'm getting only around 650 MBps when I should reach on my hardware 1500 MB (at least ib_write_bw test is reporting me 1500MBps).