Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
> The ICRC isn't even necessary from a technical sense for DCE. The > underlying reasons for the ICRC/VCRC split are not really present for > ethernet. Considering RDMAoE isn't interoperable with existing IB anyhow > and DCE can't do routing, the best course would be to just get rid of > it e

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
> Of course we need to interoperate with ConnectX-en and it, as far as I know, > only knows how to compute the VCRC as though the packet was going to get > sent to IB including a phantom 12 byte LRH that is filled with 1's without > any way to turn it off. It is also a requirement that UD work

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Jason Gunthorpe
On Thu, Dec 17, 2009 at 05:00:26PM -0600, Robert Pearson wrote: > Of course we need to interoperate with ConnectX-en and it, as far as I know, > only knows how to compute the VCRC as though the packet was going to get > sent to IB including a phantom 12 byte LRH that is filled with 1's without > an

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
To: 'Jason Gunthorpe' Cc: 'Roland Dreier'; 'frank zago'; 'linux-rdma@vger.kernel.org'; 'John Groves' Subject: RE: [Announce] rxe dev tree available (soft RDMAoE) Of course we need to interoperate with ConnectX-en and it, as far as I know, only know

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
stream then we would only use those kernels. -Original Message- From: Roland Dreier [mailto:rdre...@cisco.com] Sent: Thursday, December 17, 2009 3:26 PM To: Robert Pearson Cc: 'Jason Gunthorpe'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves'

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
and Dreier'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves' Subject: Re: [Announce] rxe dev tree available (soft RDMAoE) On Thu, Dec 17, 2009 at 03:43:56PM -0600, Robert Pearson wrote: > I agree about the polynomial. That would have been nice. As currently > prop

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Jason Gunthorpe
On Thu, Dec 17, 2009 at 03:43:56PM -0600, Robert Pearson wrote: > I agree about the polynomial. That would have been nice. As currently > proposed the embedding of the IB transport in Ethernet frames preserves the > IB ICRC as part of the transport and trades the VCRC for Ethernet's CRC32 > over th

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
> We have thought that we could try CRC32C first and if that works then use > that, otherwise fall back to CRC32 which would allow rxe to use CRC32C when > talking to itself and get a speedup on new Intel CPUs. How would you negotiate that? Is this being worked in the definition of the IBoE s

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
stable. We will keep the warn and error messages. Bob -Original Message- From: Roland Dreier [mailto:rdre...@cisco.com] Sent: Thursday, December 17, 2009 3:26 PM To: Robert Pearson Cc: 'Jason Gunthorpe'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
> Yes, but later. For now it is still being actively developed and is changing > a lot. Once it settles down we plan to convert to patches and push up > stream. I think you would probably be better off developing the kernel driver as a branch in an up-to-date kernel tree, and then worrying abo

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
, 2009 5:53 PM To: Sean Hefty Cc: 'Robert Pearson'; 'Jason Gunthorpe'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves' Subject: Re: [Announce] rxe dev tree available (soft RDMAoE) > Is there any commonality that can be shared between rxe and t

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Dave Olson
On Wed, 16 Dec 2009, Roland Dreier wrote: | | > Is there any commonality that can be shared between rxe and the qlogic driver? | | Interesting to note that according to ohcount, rxe is 9591 non-blank | non-comment lines of kernel code, while qib is 36957 lines. So the | complexity of IB trans

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread fzago
"Woodruff wrote: > What is soft RDMA over ethernet, does this mean it is RDMAoE that will run > over > any ethernet interface that is installed in the system ? > That's correct. Currently for every ethX interface present, it creates a corresponding rxeX device. These rxeX devices behaves

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Woodruff, Robert J
What is soft RDMA over ethernet, does this mean it is RDMAoE that will run over any ethernet interface that is installed in the system ? woody -Original Message- From: linux-rdma-ow...@vger.kernel.org [mailto:linux-rdma-ow...@vger.kernel.org] On Behalf Of frank zago Sent: Wednesday, De

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Roland Dreier
> Is there any commonality that can be shared between rxe and the qlogic > driver? Interesting to note that according to ohcount, rxe is 9591 non-blank non-comment lines of kernel code, while qib is 36957 lines. So the complexity of IB transport is a small part of the complexity of qib. - R

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Robert Pearson
2009 4:20 PM To: 'Robert Pearson'; 'Jason Gunthorpe'; 'frank zago' Cc: linux-rdma@vger.kernel.org; 'John Groves' Subject: RE: [Announce] rxe dev tree available (soft RDMAoE) >Yes, but later. For now it is still being actively developed and is changing >a

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Sean Hefty
>Yes, but later. For now it is still being actively developed and is changing >a lot. Once it settles down we plan to convert to patches and push up >stream. Is there any commonality that can be shared between rxe and the qlogic driver? -- To unsubscribe from this list: send the line "unsubscribe

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Robert Pearson
, 2009 3:38 PM To: frank zago Cc: linux-rdma@vger.kernel.org; Bob Pearson; John Groves Subject: Re: [Announce] rxe dev tree available (soft RDMAoE) On Wed, Dec 16, 2009 at 03:06:37PM -0600, frank zago wrote: > Hello, > > The development tree for a soft RDMA transport over Ethernet driver &

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Jason Gunthorpe
On Wed, Dec 16, 2009 at 03:06:37PM -0600, frank zago wrote: > Hello, > > The development tree for a soft RDMA transport over Ethernet driver > (rxe) is available in the OFA git repository. This is a work in progress > but has enough functionality for people interested in looking at it to > be