Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-16 Thread Christopher Lameter
On Fri, 15 Feb 2019, Ira Weiny wrote: > > > > for filesystems and processes. The only problems come in for the things > > > > which bypass the page cache like O_DIRECT and DAX. > > > > > > It makes a lot of sense since the filesystems play COW etc games with the > > > pages and RDMA is very much

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-16 Thread Dave Chinner
On Fri, Feb 15, 2019 at 03:38:29PM -0800, Ira Weiny wrote: > On Fri, Feb 15, 2019 at 03:00:31PM -0700, Jason Gunthorpe wrote: > > On Fri, Feb 15, 2019 at 06:31:36PM +, Christopher Lameter wrote: > > > On Fri, 15 Feb 2019, Matthew Wilcox wrote: > > > > > > > > Since RDMA is something similar:

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-15 Thread Ira Weiny
On Fri, Feb 15, 2019 at 03:00:31PM -0700, Jason Gunthorpe wrote: > On Fri, Feb 15, 2019 at 06:31:36PM +, Christopher Lameter wrote: > > On Fri, 15 Feb 2019, Matthew Wilcox wrote: > > > > > > Since RDMA is something similar: Can we say that a file that is used for > > > > RDMA should not use

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-15 Thread Jason Gunthorpe
On Fri, Feb 15, 2019 at 06:31:36PM +, Christopher Lameter wrote: > On Fri, 15 Feb 2019, Matthew Wilcox wrote: > > > > Since RDMA is something similar: Can we say that a file that is used for > > > RDMA should not use the page cache? > > > > That makes no sense. The page cache is the standard

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-15 Thread Christopher Lameter
On Fri, 15 Feb 2019, Matthew Wilcox wrote: > > Since RDMA is something similar: Can we say that a file that is used for > > RDMA should not use the page cache? > > That makes no sense. The page cache is the standard synchronisation point > for filesystems and processes. The only problems come

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-15 Thread Matthew Wilcox
On Fri, Feb 15, 2019 at 03:42:02PM +, Christopher Lameter wrote: > On Fri, 15 Feb 2019, Dave Chinner wrote: > > > Which tells us filesystem people that the applications are doing > > something that _will_ cause data corruption and hence not to spend > > any time triaging data corruption

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-15 Thread Christopher Lameter
On Fri, 15 Feb 2019, Dave Chinner wrote: > Which tells us filesystem people that the applications are doing > something that _will_ cause data corruption and hence not to spend > any time triaging data corruption reports because it's not a > filesystem bug that caused it. > > See open(2): > >

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-14 Thread Dave Chinner
On Thu, Feb 14, 2019 at 04:39:22PM -0500, Jerome Glisse wrote: > On Thu, Feb 14, 2019 at 12:50:49PM -0800, Matthew Wilcox wrote: > > On Thu, Feb 14, 2019 at 03:26:22PM -0500, Jerome Glisse wrote: > > > On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > > > > But it also doesnt'

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-14 Thread Jerome Glisse
On Thu, Feb 14, 2019 at 12:50:49PM -0800, Matthew Wilcox wrote: > On Thu, Feb 14, 2019 at 03:26:22PM -0500, Jerome Glisse wrote: > > On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > > > But it also doesnt' trucate/create a hole. Another thread wrote to it > > > right away and the

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-14 Thread Matthew Wilcox
On Thu, Feb 14, 2019 at 03:26:22PM -0500, Jerome Glisse wrote: > On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > > But it also doesnt' trucate/create a hole. Another thread wrote to it > > right away and the 'hole' was essentially instantly reallocated. This > > is an inherent,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-14 Thread Jerome Glisse
On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > > > I honestly don't like the idea that random subsystems can pin down > > file blocks as a side effect of gup on the result of mmap. Recall that > > it's not just

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-13 Thread Jan Kara
On Tue 12-02-19 16:55:21, Christopher Lameter wrote: > On Tue, 12 Feb 2019, Jan Kara wrote: > > > > Isn't that already racy? If the mmap user is fast enough can't it > > > prevent the page from becoming freed in the first place today? > > > > No, it cannot. We block page faulting for the file

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread John Hubbard
On 2/12/19 8:39 AM, Christopher Lameter wrote: > On Mon, 11 Feb 2019, John Hubbard wrote: > >> But anyway, Jan's proposal a bit earlier today [1] is finally sinking into >> my head--if we actually go that way, and prevent the caller from setting up >> a problematic gup pin in the first place,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Dan Williams
On Tue, Feb 12, 2019 at 8:07 AM Jan Kara wrote: > > On Mon 11-02-19 09:22:58, Dan Williams wrote: > > On Mon, Feb 11, 2019 at 2:24 AM Jan Kara wrote: > > > > > > On Fri 08-02-19 12:50:37, Dan Williams wrote: > > > > On Fri, Feb 8, 2019 at 3:11 AM Jan Kara wrote: > > > > > > > > > > On Fri

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Christopher Lameter
On Tue, 12 Feb 2019, Jan Kara wrote: > > Isn't that already racy? If the mmap user is fast enough can't it > > prevent the page from becoming freed in the first place today? > > No, it cannot. We block page faulting for the file (via a lock), tear down > page tables, free pages and blocks. Then

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Jan Kara
On Tue 12-02-19 16:36:36, Christopher Lameter wrote: > On Mon, 11 Feb 2019, Dan Williams wrote: > > > An mmap write after a fault due to a hole punch is free to trigger > > SIGBUS if the subsequent page allocation fails. So no, I don't see > > them as the same unless you're allowing for the

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Christopher Lameter
On Mon, 11 Feb 2019, John Hubbard wrote: > But anyway, Jan's proposal a bit earlier today [1] is finally sinking into > my head--if we actually go that way, and prevent the caller from setting up > a problematic gup pin in the first place, then that may make this point sort > of moot. Ok well

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Christopher Lameter
On Mon, 11 Feb 2019, Dan Williams wrote: > An mmap write after a fault due to a hole punch is free to trigger > SIGBUS if the subsequent page allocation fails. So no, I don't see > them as the same unless you're allowing for the holder of the MR to > receive a re-fault failure. Order 0 page

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Jan Kara
On Mon 11-02-19 14:09:56, Jason Gunthorpe wrote: > On Mon, Feb 11, 2019 at 01:02:37PM -0800, Dan Williams wrote: > > On Mon, Feb 11, 2019 at 12:49 PM Jason Gunthorpe wrote: > > > > > > On Mon, Feb 11, 2019 at 11:58:47AM -0800, Dan Williams wrote: > > > > On Mon, Feb 11, 2019 at 10:40 AM Matthew

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Jan Kara
On Mon 11-02-19 11:06:54, Jason Gunthorpe wrote: > On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > > > I honestly don't like the idea that random subsystems can pin down > > file blocks as a side effect of gup on the result of mmap. Recall that > > it's not just RDMA that wants

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-12 Thread Jan Kara
On Mon 11-02-19 09:22:58, Dan Williams wrote: > On Mon, Feb 11, 2019 at 2:24 AM Jan Kara wrote: > > > > On Fri 08-02-19 12:50:37, Dan Williams wrote: > > > On Fri, Feb 8, 2019 at 3:11 AM Jan Kara wrote: > > > > > > > > On Fri 08-02-19 15:43:02, Dave Chinner wrote: > > > > > On Thu, Feb 07, 2019

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread John Hubbard
On 2/11/19 2:12 PM, Jason Gunthorpe wrote: > On Mon, Feb 11, 2019 at 01:22:11PM -0800, John Hubbard wrote: > >> The only way that breaks is if longterm pins imply an irreversible action, >> such >> as blocking and waiting in a way that you can't back out of or get >> interrupted >> out of. And

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jason Gunthorpe
On Mon, Feb 11, 2019 at 01:22:11PM -0800, John Hubbard wrote: > The only way that breaks is if longterm pins imply an irreversible action, > such > as blocking and waiting in a way that you can't back out of or get interrupted > out of. And the design doesn't seem to be going in that direction,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread John Hubbard
On 2/11/19 10:19 AM, Ira Weiny wrote: > On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: >> On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: [...] > John's patches will indicate to the FS that the page is gup pinned. But they > will not indicate longterm vs not

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jason Gunthorpe
On Mon, Feb 11, 2019 at 01:02:37PM -0800, Dan Williams wrote: > On Mon, Feb 11, 2019 at 12:49 PM Jason Gunthorpe wrote: > > > > On Mon, Feb 11, 2019 at 11:58:47AM -0800, Dan Williams wrote: > > > On Mon, Feb 11, 2019 at 10:40 AM Matthew Wilcox > > > wrote: > > > > > > > > On Mon, Feb 11, 2019

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jerome Glisse
On Mon, Feb 11, 2019 at 10:19:22AM -0800, Ira Weiny wrote: > On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > > On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > > > > > I honestly don't like the idea that random subsystems can pin down > > > file blocks as a side

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Dan Williams
On Mon, Feb 11, 2019 at 12:49 PM Jason Gunthorpe wrote: > > On Mon, Feb 11, 2019 at 11:58:47AM -0800, Dan Williams wrote: > > On Mon, Feb 11, 2019 at 10:40 AM Matthew Wilcox wrote: > > > > > > On Mon, Feb 11, 2019 at 11:26:49AM -0700, Jason Gunthorpe wrote: > > > > On Mon, Feb 11, 2019 at

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jason Gunthorpe
On Mon, Feb 11, 2019 at 11:58:47AM -0800, Dan Williams wrote: > On Mon, Feb 11, 2019 at 10:40 AM Matthew Wilcox wrote: > > > > On Mon, Feb 11, 2019 at 11:26:49AM -0700, Jason Gunthorpe wrote: > > > On Mon, Feb 11, 2019 at 10:19:22AM -0800, Ira Weiny wrote: > > > > What if user space then writes

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Dan Williams
On Mon, Feb 11, 2019 at 10:40 AM Matthew Wilcox wrote: > > On Mon, Feb 11, 2019 at 11:26:49AM -0700, Jason Gunthorpe wrote: > > On Mon, Feb 11, 2019 at 10:19:22AM -0800, Ira Weiny wrote: > > > What if user space then writes to the end of the file with a regular > > > write? > > > Does that write

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Matthew Wilcox
On Mon, Feb 11, 2019 at 11:26:49AM -0700, Jason Gunthorpe wrote: > On Mon, Feb 11, 2019 at 10:19:22AM -0800, Ira Weiny wrote: > > What if user space then writes to the end of the file with a regular write? > > Does that write end up at the point they truncated to or off the end of the > > mmaped

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jason Gunthorpe
On Mon, Feb 11, 2019 at 10:19:22AM -0800, Ira Weiny wrote: > On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > > On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > > > > > I honestly don't like the idea that random subsystems can pin down > > > file blocks as a side

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Ira Weiny
On Mon, Feb 11, 2019 at 11:06:54AM -0700, Jason Gunthorpe wrote: > On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > > > I honestly don't like the idea that random subsystems can pin down > > file blocks as a side effect of gup on the result of mmap. Recall that > > it's not just

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Dan Williams
On Mon, Feb 11, 2019 at 10:07 AM Jason Gunthorpe wrote: > > On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > > > I honestly don't like the idea that random subsystems can pin down > > file blocks as a side effect of gup on the result of mmap. Recall that > > it's not just RDMA that

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jason Gunthorpe
On Mon, Feb 11, 2019 at 09:22:58AM -0800, Dan Williams wrote: > I honestly don't like the idea that random subsystems can pin down > file blocks as a side effect of gup on the result of mmap. Recall that > it's not just RDMA that wants this guarantee. It seems safer to have > the file be in an

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Dan Williams
On Mon, Feb 11, 2019 at 2:24 AM Jan Kara wrote: > > On Fri 08-02-19 12:50:37, Dan Williams wrote: > > On Fri, Feb 8, 2019 at 3:11 AM Jan Kara wrote: > > > > > > On Fri 08-02-19 15:43:02, Dave Chinner wrote: > > > > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > > > >

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-11 Thread Jan Kara
On Fri 08-02-19 12:50:37, Dan Williams wrote: > On Fri, Feb 8, 2019 at 3:11 AM Jan Kara wrote: > > > > On Fri 08-02-19 15:43:02, Dave Chinner wrote: > > > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > > > One approach that may be a clean way to solve this: > > > > 3.

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-08 Thread Dave Chinner
On Fri, Feb 08, 2019 at 12:10:28PM +0100, Jan Kara wrote: > On Fri 08-02-19 15:43:02, Dave Chinner wrote: > > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > > One approach that may be a clean way to solve this: > > > 3. Filesystems that allow bypass of the page cache

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-08 Thread Dan Williams
On Fri, Feb 8, 2019 at 3:11 AM Jan Kara wrote: > > On Fri 08-02-19 15:43:02, Dave Chinner wrote: > > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > > One approach that may be a clean way to solve this: > > > 3. Filesystems that allow bypass of the page cache (like XFS /

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-08 Thread Jason Gunthorpe
On Thu, Feb 07, 2019 at 11:20:37PM -0800, Dan Williams wrote: > On Thu, Feb 7, 2019 at 9:19 PM Jason Gunthorpe wrote: > > > > On Thu, Feb 07, 2019 at 03:54:58PM -0800, Dan Williams wrote: > > > > > > The only production worthy way is to have the FS be a partner in > > > > making this work without

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-08 Thread Christopher Lameter
On Fri, 8 Feb 2019, Dave Chinner wrote: > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > One approach that may be a clean way to solve this: > > 3. Filesystems that allow bypass of the page cache (like XFS / DAX) will > >provide the virtual mapping when the PIN is

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-08 Thread Jan Kara
On Fri 08-02-19 15:43:02, Dave Chinner wrote: > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > One approach that may be a clean way to solve this: > > 3. Filesystems that allow bypass of the page cache (like XFS / DAX) will > >provide the virtual mapping when the PIN

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Dan Williams
On Thu, Feb 7, 2019 at 9:19 PM Jason Gunthorpe wrote: > > On Thu, Feb 07, 2019 at 03:54:58PM -0800, Dan Williams wrote: > > > > The only production worthy way is to have the FS be a partner in > > > making this work without requiring revoke, so the critical RDMA > > > traffic can operate safely.

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Jason Gunthorpe
On Thu, Feb 07, 2019 at 03:54:58PM -0800, Dan Williams wrote: > > The only production worthy way is to have the FS be a partner in > > making this work without requiring revoke, so the critical RDMA > > traffic can operate safely. > > ...belies a path forward. Just swap out "FS be a partner"

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Dave Chinner
On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > One approach that may be a clean way to solve this: > 3. Filesystems that allow bypass of the page cache (like XFS / DAX) will >provide the virtual mapping when the PIN is done and DO NO OPERATIONS >on the longterm

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Ira Weiny
On Thu, Feb 07, 2019 at 03:54:58PM -0800, Dan Williams wrote: > On Thu, Feb 7, 2019 at 9:17 AM Jason Gunthorpe wrote: > > > > Insisting to run RDMA & DAX without ODP and building an elaborate > > revoke mechanism to support non-ODP HW is inherently baroque. > > > > Use the HW that supports ODP. >

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Dan Williams
On Thu, Feb 7, 2019 at 9:17 AM Jason Gunthorpe wrote: > > On Wed, Feb 06, 2019 at 10:00:28PM -0800, Dan Williams wrote: > > > > > If your argument is that "existing RDMA apps don't have a recall > > > > mechanism" then that's what they are going to need to implement to > > > > work with DAX+RDMA.

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Tom Talpey
On 2/7/2019 11:57 AM, Ira Weiny wrote: On Thu, Feb 07, 2019 at 10:28:05AM -0500, Tom Talpey wrote: On 2/7/2019 10:04 AM, Chuck Lever wrote: On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: Requiring ODP capable hardware

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Christopher Lameter
On Thu, 7 Feb 2019, Ira Weiny wrote: > On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > > One approach that may be a clean way to solve this: > > > > 1. Long term GUP usage requires the virtual mapping to the pages be fixed > >for the duration of the GUP Map. There never

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Ira Weiny
On Thu, Feb 07, 2019 at 04:55:37PM +, Christopher Lameter wrote: > One approach that may be a clean way to solve this: > > 1. Long term GUP usage requires the virtual mapping to the pages be fixed >for the duration of the GUP Map. There never has been a way to break >the pinnning and

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Jason Gunthorpe
On Thu, Feb 07, 2019 at 09:24:05AM -0800, Matthew Wilcox wrote: > On Thu, Feb 07, 2019 at 11:25:35AM -0500, Doug Ledford wrote: > > * Really though, as I said in my email to Tom Talpey, this entire > > situation is simply screaming that we are doing DAX networking wrong. > > We shouldn't be

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Ira Weiny
On Wed, Feb 06, 2019 at 07:13:16PM -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 6:42 PM Doug Ledford wrote: > > > > On Wed, 2019-02-06 at 14:44 -0800, Dan Williams wrote: > > > On Wed, Feb 6, 2019 at 2:25 PM Doug Ledford wrote: > > > > Can someone give me a real world scenario that

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Matthew Wilcox
On Thu, Feb 07, 2019 at 11:25:35AM -0500, Doug Ledford wrote: > * Really though, as I said in my email to Tom Talpey, this entire > situation is simply screaming that we are doing DAX networking wrong. > We shouldn't be writing the networking code once in every single > application that wants to

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Jason Gunthorpe
On Wed, Feb 06, 2019 at 10:00:28PM -0800, Dan Williams wrote: > > > If your argument is that "existing RDMA apps don't have a recall > > > mechanism" then that's what they are going to need to implement to > > > work with DAX+RDMA. Reliable remote access arbitration is required > > > for

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Ira Weiny
On Thu, Feb 07, 2019 at 10:28:05AM -0500, Tom Talpey wrote: > On 2/7/2019 10:04 AM, Chuck Lever wrote: > > > > > > > On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: > > > > > > On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: > > > > > > > Requiring ODP capable hardware and

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Christopher Lameter
One approach that may be a clean way to solve this: 1. Long term GUP usage requires the virtual mapping to the pages be fixed for the duration of the GUP Map. There never has been a way to break the pinnning and thus this needs to be preserved. 2. Page Cache Long term pins are not allowed

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Ira Weiny
On Wed, Feb 06, 2019 at 10:23:10PM -0700, Jason Gunthorpe wrote: > On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: > > > Requiring ODP capable hardware and applications that control RDMA > > access to use file leases and be able to cancel/recall client side > > delegations (like NFS

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Jan Kara
On Wed 06-02-19 15:54:01, Doug Ledford wrote: > On Wed, 2019-02-06 at 12:20 -0800, Matthew Wilcox wrote: > > On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > > > On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > > > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Doug Ledford
I think I've finally wrapped my head around all of this. Let's see if I have this right: * People are using filesystem DAX to expose byte addressable persistent memory because putting a filesystem on the memory makes an easy way to organize the data in the memory and share it between various

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Doug Ledford
On Thu, 2019-02-07 at 10:41 -0500, Tom Talpey wrote: > On 2/7/2019 10:37 AM, Doug Ledford wrote: > > On Thu, 2019-02-07 at 10:28 -0500, Tom Talpey wrote: > > > On 2/7/2019 10:04 AM, Chuck Lever wrote: > > > > > On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: > > > > > > > > > > On Thu, Feb

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Tom Talpey
On 2/7/2019 10:37 AM, Doug Ledford wrote: On Thu, 2019-02-07 at 10:28 -0500, Tom Talpey wrote: On 2/7/2019 10:04 AM, Chuck Lever wrote: On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: Requiring ODP capable hardware and

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Doug Ledford
On Thu, 2019-02-07 at 10:28 -0500, Tom Talpey wrote: > On 2/7/2019 10:04 AM, Chuck Lever wrote: > > > > > On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: > > > > > > On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: > > > > > > > Requiring ODP capable hardware and applications

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Tom Talpey
On 2/7/2019 10:04 AM, Chuck Lever wrote: On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: Requiring ODP capable hardware and applications that control RDMA access to use file leases and be able to cancel/recall client side

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-07 Thread Chuck Lever
> On Feb 7, 2019, at 12:23 AM, Jason Gunthorpe wrote: > > On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: > >> Requiring ODP capable hardware and applications that control RDMA >> access to use file leases and be able to cancel/recall client side >> delegations (like NFS is

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 9:23 PM Jason Gunthorpe wrote: > > On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: > > On Wed, Feb 06, 2019 at 05:24:50PM -0500, Doug Ledford wrote: > > > On Wed, 2019-02-06 at 15:08 -0700, Jason Gunthorpe wrote: > > > > On Thu, Feb 07, 2019 at 08:03:56AM

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Wed, Feb 06, 2019 at 04:22:16PM -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 3:41 PM Jason Gunthorpe wrote: > [..] > > > You're describing the current situation, i.e. Linux already implements > > > this, it's called Device-DAX and some users of RDMA find it > > > insufficient. The

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Thu, Feb 07, 2019 at 02:52:58PM +1100, Dave Chinner wrote: > On Wed, Feb 06, 2019 at 05:24:50PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 15:08 -0700, Jason Gunthorpe wrote: > > > On Thu, Feb 07, 2019 at 08:03:56AM +1100, Dave Chinner wrote: > > > > On Wed, Feb 06, 2019 at 07:16:21PM

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dave Chinner
On Wed, Feb 06, 2019 at 05:24:50PM -0500, Doug Ledford wrote: > On Wed, 2019-02-06 at 15:08 -0700, Jason Gunthorpe wrote: > > On Thu, Feb 07, 2019 at 08:03:56AM +1100, Dave Chinner wrote: > > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > On Wed, 6 Feb 2019, Doug

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 6:42 PM Doug Ledford wrote: > > On Wed, 2019-02-06 at 14:44 -0800, Dan Williams wrote: > > On Wed, Feb 6, 2019 at 2:25 PM Doug Ledford wrote: > > > Can someone give me a real world scenario that someone is *actually* > > > asking for with this? > > > > I'll point to this

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 5:57 PM Doug Ledford wrote: [..] > > > > Dave, you said the FS is responsible to arbitrate access to the > > > > physical pages.. > > > > > > > > Is it possible to have a filesystem for DAX that is more suited to > > > > this environment? Ie designed to not require block

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 14:44 -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 2:25 PM Doug Ledford wrote: > > Can someone give me a real world scenario that someone is *actually* > > asking for with this? > > I'll point to this example. At the 6:35 mark Kodi talks about the > Oracle use case

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 14:44 -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 2:25 PM Doug Ledford wrote: > > On Wed, 2019-02-06 at 15:08 -0700, Jason Gunthorpe wrote: > > > On Thu, Feb 07, 2019 at 08:03:56AM +1100, Dave Chinner wrote: > > > > On Wed, Feb 06, 2019 at 07:16:21PM +,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 3:41 PM Jason Gunthorpe wrote: [..] > > You're describing the current situation, i.e. Linux already implements > > this, it's called Device-DAX and some users of RDMA find it > > insufficient. The choices are to continue to tell them "no", or say > > "yes, but you need to

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Wed, Feb 06, 2019 at 03:30:27PM -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 3:21 PM Jason Gunthorpe wrote: > > > > On Wed, Feb 06, 2019 at 02:44:45PM -0800, Dan Williams wrote: > > > > > > Do they need to stick with xfs? > > > > > > Can you clarify the motivation for that question?

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 3:21 PM Jason Gunthorpe wrote: > > On Wed, Feb 06, 2019 at 02:44:45PM -0800, Dan Williams wrote: > > > > Do they need to stick with xfs? > > > > Can you clarify the motivation for that question? This problem exists > > for any filesystem that implements an mmap that where

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Wed, Feb 06, 2019 at 02:44:45PM -0800, Dan Williams wrote: > > Do they need to stick with xfs? > > Can you clarify the motivation for that question? This problem exists > for any filesystem that implements an mmap that where the physical > page backing the mapping is identical to the physical

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 2:25 PM Doug Ledford wrote: > > On Wed, 2019-02-06 at 15:08 -0700, Jason Gunthorpe wrote: > > On Thu, Feb 07, 2019 at 08:03:56AM +1100, Dave Chinner wrote: > > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > On Wed, 6 Feb 2019, Doug Ledford

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 15:08 -0700, Jason Gunthorpe wrote: > On Thu, Feb 07, 2019 at 08:03:56AM +1100, Dave Chinner wrote: > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > On Wed, 6 Feb 2019, Doug Ledford wrote: > > > > > > > > Most of the cases we want revoke for are

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Thu, Feb 07, 2019 at 08:03:56AM +1100, Dave Chinner wrote: > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > On Wed, 6 Feb 2019, Doug Ledford wrote: > > > > > > Most of the cases we want revoke for are things like truncate(). > > > > Shouldn't happen with a sane

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dave Chinner
On Tue, Feb 05, 2019 at 10:01:20AM -0800, Ira Weiny wrote: > I had an old invalid address for Jason Gunthorpe in my address book... > > Correcting his email in the thread. Probably should have cc'd linux-fsdevel, too, but it's too late for that now > On Tue, Feb 05, 2019 at 09:50:59AM

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 13:04 -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 12:14 PM Doug Ledford wrote: > > On Wed, 2019-02-06 at 11:45 -0800, Dan Williams wrote: > > > On Wed, Feb 6, 2019 at 10:52 AM Jason Gunthorpe wrote: > > > > On Wed, Feb 06, 2019 at 10:35:04AM -0800, Matthew Wilcox

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 12:14 PM Doug Ledford wrote: > > On Wed, 2019-02-06 at 11:45 -0800, Dan Williams wrote: > > On Wed, Feb 6, 2019 at 10:52 AM Jason Gunthorpe wrote: > > > On Wed, Feb 06, 2019 at 10:35:04AM -0800, Matthew Wilcox wrote: > > > > > > > > Admittedly, I'm coming in late to this

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dave Chinner
On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > On Wed, 6 Feb 2019, Doug Ledford wrote: > > > > Most of the cases we want revoke for are things like truncate(). > > > Shouldn't happen with a sane system, but we're trying to avoid users > > > doing awful things like being

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 12:20 -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > though? If we only allow this use

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 12:49 -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 03:47:53PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 12:41 -0800, Matthew Wilcox wrote: > > > On Wed, Feb 06, 2019 at 03:28:35PM -0500, Doug Ledford wrote: > > > > On Wed, 2019-02-06 at 12:20 -0800,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Matthew Wilcox
On Wed, Feb 06, 2019 at 03:47:53PM -0500, Doug Ledford wrote: > On Wed, 2019-02-06 at 12:41 -0800, Matthew Wilcox wrote: > > On Wed, Feb 06, 2019 at 03:28:35PM -0500, Doug Ledford wrote: > > > On Wed, 2019-02-06 at 12:20 -0800, Matthew Wilcox wrote: > > > > Not hot-unplugging the RDMA device but

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 12:41 -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 03:28:35PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 12:20 -0800, Matthew Wilcox wrote: > > > On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > > > > On Wed, 2019-02-06 at 11:40 -0800,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Matthew Wilcox
On Wed, Feb 06, 2019 at 03:28:35PM -0500, Doug Ledford wrote: > On Wed, 2019-02-06 at 12:20 -0800, Matthew Wilcox wrote: > > On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > > > On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > > > > On Wed, Feb 06, 2019 at 07:16:21PM

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Christopher Lameter
On Wed, 6 Feb 2019, Matthew Wilcox wrote: > It's straightforward to migrate text pages from one DIMM to another; > you remove the PTEs from the CPU's page tables, copy the data over and > pagefaults put the new PTEs in place. We don't have a way to do similar > things to an RDMA device, do we?

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Wed, Feb 06, 2019 at 12:20:21PM -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > > > > > though? If we

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 12:20 -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > though? If we only allow this use

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Christopher Lameter
On Wed, 6 Feb 2019, Matthew Wilcox wrote: > > > > Coming in late here too but isnt the only DAX case that we are concerned > > about where there was an mmap with the O_DAX option to do direct write > > There is no O_DAX option. There's mount -o dax, but there's nothing that > a program does to

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Matthew Wilcox
On Wed, Feb 06, 2019 at 03:16:02PM -0500, Doug Ledford wrote: > On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > > > though? If we only allow this use case then we may not have to worry about > > > long term

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 11:40 -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > > > > though? If we only allow this use case then we may not have to worry about > > long term GUP because DAX mapped files will stay in the physical location > >

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 11:45 -0800, Dan Williams wrote: > On Wed, Feb 6, 2019 at 10:52 AM Jason Gunthorpe wrote: > > On Wed, Feb 06, 2019 at 10:35:04AM -0800, Matthew Wilcox wrote: > > > > > > Admittedly, I'm coming in late to this conversation, but did I miss the > > > > portion where that

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Dan Williams
On Wed, Feb 6, 2019 at 10:52 AM Jason Gunthorpe wrote: > > On Wed, Feb 06, 2019 at 10:35:04AM -0800, Matthew Wilcox wrote: > > > > Admittedly, I'm coming in late to this conversation, but did I miss the > > > portion where that alternative was ruled out? > > > > That's my preferred option too,

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Matthew Wilcox
On Wed, Feb 06, 2019 at 07:16:21PM +, Christopher Lameter wrote: > On Wed, 6 Feb 2019, Doug Ledford wrote: > > > Most of the cases we want revoke for are things like truncate(). > > > Shouldn't happen with a sane system, but we're trying to avoid users > > > doing awful things like being able

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Christopher Lameter
On Wed, 6 Feb 2019, Doug Ledford wrote: > > Most of the cases we want revoke for are things like truncate(). > > Shouldn't happen with a sane system, but we're trying to avoid users > > doing awful things like being able to DMA to pages that are now part of > > a different file. > > Why is the

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Jason Gunthorpe
On Wed, Feb 06, 2019 at 10:35:04AM -0800, Matthew Wilcox wrote: > > Admittedly, I'm coming in late to this conversation, but did I miss the > > portion where that alternative was ruled out? > > That's my preferred option too, but the preponderance of opinion leans > towards "We can't give people

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Doug Ledford
On Wed, 2019-02-06 at 10:35 -0800, Matthew Wilcox wrote: > On Wed, Feb 06, 2019 at 01:32:04PM -0500, Doug Ledford wrote: > > On Wed, 2019-02-06 at 09:52 -0800, Matthew Wilcox wrote: > > > On Wed, Feb 06, 2019 at 10:31:14AM -0700, Jason Gunthorpe wrote: > > > > On Wed, Feb 06, 2019 at 10:50:00AM

Re: [LSF/MM TOPIC] Discuss least bad options for resolving longterm-GUP usage by RDMA

2019-02-06 Thread Matthew Wilcox
On Wed, Feb 06, 2019 at 01:32:04PM -0500, Doug Ledford wrote: > On Wed, 2019-02-06 at 09:52 -0800, Matthew Wilcox wrote: > > On Wed, Feb 06, 2019 at 10:31:14AM -0700, Jason Gunthorpe wrote: > > > On Wed, Feb 06, 2019 at 10:50:00AM +0100, Jan Kara wrote: > > > > > > > MM/FS asks for lease to be

  1   2   >