Re: [PATCH 2/9] IB: add a proper completion queue abstraction

2015-11-23 Thread Caitlin Bestler
On 11/23/2015 4:00 PM, Jason Gunthorpe wrote: On Mon, Nov 23, 2015 at 03:30:42PM -0800, Caitlin Bestler wrote: The receive completion can be safely assumed to indicate transmit completion over a reliable connection unless your peer has gone completely bonkers and is replying

Re: [PATCH 2/9] IB: add a proper completion queue abstraction

2015-11-23 Thread Caitlin Bestler
On 11/23/2015 4:00 PM, Jason Gunthorpe wrote: On Mon, Nov 23, 2015 at 03:30:42PM -0800, Caitlin Bestler wrote: The receive completion can be safely assumed to indicate transmit completion over a reliable connection unless your peer has gone completely bonkers and is replying

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
> -Original Message- > From: Christoph Lameter [mailto:[EMAIL PROTECTED] > Sent: Friday, February 15, 2008 2:50 PM > To: Caitlin Bestler > Cc: linux-kernel@vger.kernel.org; [EMAIL PROTECTED]; [EMAIL PROTECTED]; > [EMAIL PROTECTED]; [EMAIL PROTECTED] > Subject:

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
Christoph Lameter wrote > > > Merely mlocking pages deals with the end-to-end RDMA semantics. > > What still needs to be addressed is how a fastpath interface > > would dynamically pin and unpin. Yielding pins for short-term > > suspensions (and flushing cached translations) deals with the > >

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
> -Original Message- > From: Christoph Lameter [mailto:[EMAIL PROTECTED] > Sent: Friday, February 15, 2008 10:46 AM > To: Caitlin Bestler > Cc: linux-kernel@vger.kernel.org; [EMAIL PROTECTED]; [EMAIL PROTECTED]; > [EMAIL PROTECTED]; [EMAIL PROTECTED] > Subject:

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
Christoph Lameter asked: > > What does it mean that the "application layer has to be determine what > pages are registered"? The application does not know which of its pages > are currently in memory. It can only force these pages to stay in > memory if their are mlocked. > An application that

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
-Original Message- From: Christoph Lameter [mailto:[EMAIL PROTECTED] Sent: Friday, February 15, 2008 10:46 AM To: Caitlin Bestler Cc: linux-kernel@vger.kernel.org; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: RE: [ofa-general] Re: Demand

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
Christoph Lameter asked: What does it mean that the application layer has to be determine what pages are registered? The application does not know which of its pages are currently in memory. It can only force these pages to stay in memory if their are mlocked. An application that

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
Christoph Lameter wrote Merely mlocking pages deals with the end-to-end RDMA semantics. What still needs to be addressed is how a fastpath interface would dynamically pin and unpin. Yielding pins for short-term suspensions (and flushing cached translations) deals with the rest.

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-15 Thread Caitlin Bestler
-Original Message- From: Christoph Lameter [mailto:[EMAIL PROTECTED] Sent: Friday, February 15, 2008 2:50 PM To: Caitlin Bestler Cc: linux-kernel@vger.kernel.org; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: RE: [ofa-general] Re: Demand

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
> -Original Message- > From: Christoph Lameter [mailto:[EMAIL PROTECTED] > Sent: Thursday, February 14, 2008 2:49 PM > To: Caitlin Bestler > Cc: linux-kernel@vger.kernel.org; [EMAIL PROTECTED]; [EMAIL PROTECTED]; > [EMAIL PROTECTED]; [EMAIL PROTECTED] > Subject:

Re: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
On Thu, Feb 14, 2008 at 12:20 PM, Christoph Lameter <[EMAIL PROTECTED]> wrote: > On Thu, 14 Feb 2008, Caitlin Bestler wrote: > > > So suspend/resume to re-arrange pages is one thing. Suspend/resume to cover > > swapping out pages so they can be reallocated is

Re: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
On Thu, Feb 14, 2008 at 11:39 AM, Christoph Lameter <[EMAIL PROTECTED]> wrote: > On Thu, 14 Feb 2008, Steve Wise wrote: > > > Note that for T3, this involves suspending _all_ rdma connections that are > in > > the same PD as the MR being remapped. This is because the driver doesn't > know >

Re: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
On Thu, Feb 14, 2008 at 8:23 AM, Steve Wise <[EMAIL PROTECTED]> wrote: > Robin Holt wrote: > > On Thu, Feb 14, 2008 at 09:09:08AM -0600, Steve Wise wrote: > >> Note that for T3, this involves suspending _all_ rdma connections that are > >> in the same PD as the MR being remapped. This is

Re: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
On Thu, Feb 14, 2008 at 8:23 AM, Steve Wise [EMAIL PROTECTED] wrote: Robin Holt wrote: On Thu, Feb 14, 2008 at 09:09:08AM -0600, Steve Wise wrote: Note that for T3, this involves suspending _all_ rdma connections that are in the same PD as the MR being remapped. This is because the

Re: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
On Thu, Feb 14, 2008 at 11:39 AM, Christoph Lameter [EMAIL PROTECTED] wrote: On Thu, 14 Feb 2008, Steve Wise wrote: Note that for T3, this involves suspending _all_ rdma connections that are in the same PD as the MR being remapped. This is because the driver doesn't know who the

Re: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
On Thu, Feb 14, 2008 at 12:20 PM, Christoph Lameter [EMAIL PROTECTED] wrote: On Thu, 14 Feb 2008, Caitlin Bestler wrote: So suspend/resume to re-arrange pages is one thing. Suspend/resume to cover swapping out pages so they can be reallocated is an exercise in futility. By the time

RE: [ofa-general] Re: Demand paging for memory regions

2008-02-14 Thread Caitlin Bestler
-Original Message- From: Christoph Lameter [mailto:[EMAIL PROTECTED] Sent: Thursday, February 14, 2008 2:49 PM To: Caitlin Bestler Cc: linux-kernel@vger.kernel.org; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: Re: [ofa-general] Re: Demand

RE: [ofa-general] Re: [ewg] Re: [PATCH] IB/ehca: Serialize HCA-related hCalls on POWER5

2007-12-13 Thread Caitlin Bestler
> -Original Message- > From: Joachim Fenkes [mailto:[EMAIL PROTECTED] > Sent: Thursday, December 13, 2007 1:00 PM > To: Caitlin Bestler > Cc: Arnd Bergmann; [EMAIL PROTECTED]; OF-General; LKML; > [EMAIL PROTECTED]; Or Gerlitz; Roland Dreier; Stefan Roscher > Subject:

Re: [ofa-general] Re: [ewg] Re: [PATCH] IB/ehca: Serialize HCA-related hCalls on POWER5

2007-12-13 Thread Caitlin Bestler
On Dec 13, 2007 12:30 AM, Or Gerlitz <[EMAIL PROTECTED]> wrote: > Roland Dreier wrote: > > I think the right fix for iSER would be to make iSER work even for > > devices that don't support FMRs. For example cxgb3 doesn't implement > > FMRs so if anyone ever updates iSER to work on iWARP and not

Re: [ofa-general] Re: [ewg] Re: [PATCH] IB/ehca: Serialize HCA-related hCalls on POWER5

2007-12-13 Thread Caitlin Bestler
On Dec 13, 2007 12:30 AM, Or Gerlitz [EMAIL PROTECTED] wrote: Roland Dreier wrote: I think the right fix for iSER would be to make iSER work even for devices that don't support FMRs. For example cxgb3 doesn't implement FMRs so if anyone ever updates iSER to work on iWARP and not just IB,

RE: [ofa-general] Re: [ewg] Re: [PATCH] IB/ehca: Serialize HCA-related hCalls on POWER5

2007-12-13 Thread Caitlin Bestler
-Original Message- From: Joachim Fenkes [mailto:[EMAIL PROTECTED] Sent: Thursday, December 13, 2007 1:00 PM To: Caitlin Bestler Cc: Arnd Bergmann; [EMAIL PROTECTED]; OF-General; LKML; [EMAIL PROTECTED]; Or Gerlitz; Roland Dreier; Stefan Roscher Subject: Re: [ofa-general] Re: [ewg

RE: [openib-general] [PATCH 1/10] cxgb3 - main header files

2007-01-09 Thread Caitlin Bestler
> -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Michael S. Tsirkin > Sent: Tuesday, January 09, 2007 5:57 AM > To: Steve Wise > Cc: netdev@vger.kernel.org; Roland Dreier; Divy Le Ray; > linux-kernel@vger.kernel.org; openib-general > Subject:

RE: [openib-general] [PATCH 1/10] cxgb3 - main header files

2007-01-09 Thread Caitlin Bestler
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael S. Tsirkin Sent: Tuesday, January 09, 2007 5:57 AM To: Steve Wise Cc: netdev@vger.kernel.org; Roland Dreier; Divy Le Ray; linux-kernel@vger.kernel.org; openib-general Subject: Re: