On Thu, Mar 28, 2019 at 06:43:51AM -0700, Ira Weiny wrote:
> On Mon, Mar 25, 2019 at 10:40:05AM -0400, Jerome Glisse wrote:
> > From: Jérôme Glisse <[email protected]>
> >
> > Rename for consistency between code, comments and documentation. Also
> > improves the comments on all the possible returns values. Improve the
> > function by returning the number of populated entries in pfns array.
> >
> > Changes since v1:
> > - updated documentation
> > - reformated some comments
> >
> > Signed-off-by: Jérôme Glisse <[email protected]>
> > Reviewed-by: Ralph Campbell <[email protected]>
> > Cc: Andrew Morton <[email protected]>
> > Cc: John Hubbard <[email protected]>
> > Cc: Dan Williams <[email protected]>
> > ---
> > Documentation/vm/hmm.rst | 8 +---
> > include/linux/hmm.h | 13 +++++-
> > mm/hmm.c | 91 +++++++++++++++++-----------------------
> > 3 files changed, 52 insertions(+), 60 deletions(-)
> >
> > diff --git a/Documentation/vm/hmm.rst b/Documentation/vm/hmm.rst
> > index d9b27bdadd1b..61f073215a8d 100644
> > --- a/Documentation/vm/hmm.rst
> > +++ b/Documentation/vm/hmm.rst
> > @@ -190,13 +190,7 @@ When the device driver wants to populate a range of
> > virtual addresses, it can
> > use either::
> >
> > long hmm_range_snapshot(struct hmm_range *range);
> > - int hmm_vma_fault(struct vm_area_struct *vma,
> > - struct hmm_range *range,
> > - unsigned long start,
> > - unsigned long end,
> > - hmm_pfn_t *pfns,
> > - bool write,
> > - bool block);
> > + long hmm_range_fault(struct hmm_range *range, bool block);
> >
> > The first one (hmm_range_snapshot()) will only fetch present CPU page table
> > entries and will not trigger a page fault on missing or non-present
> > entries.
> > diff --git a/include/linux/hmm.h b/include/linux/hmm.h
> > index 32206b0b1bfd..e9afd23c2eac 100644
> > --- a/include/linux/hmm.h
> > +++ b/include/linux/hmm.h
> > @@ -391,7 +391,18 @@ bool hmm_vma_range_done(struct hmm_range *range);
> > *
> > * See the function description in mm/hmm.c for further documentation.
> > */
> > -int hmm_vma_fault(struct hmm_range *range, bool block);
> > +long hmm_range_fault(struct hmm_range *range, bool block);
> > +
> > +/* This is a temporary helper to avoid merge conflict between trees. */
> > +static inline int hmm_vma_fault(struct hmm_range *range, bool block)
> > +{
> > + long ret = hmm_range_fault(range, block);
> > + if (ret == -EBUSY)
> > + ret = -EAGAIN;
> > + else if (ret == -EAGAIN)
> > + ret = -EBUSY;
> > + return ret < 0 ? ret : 0;
> > +}
> >
> > /* Below are for HMM internal use only! Not to be used by device driver! */
> > void hmm_mm_destroy(struct mm_struct *mm);
> > diff --git a/mm/hmm.c b/mm/hmm.c
> > index 91361aa74b8b..7860e63c3ba7 100644
> > --- a/mm/hmm.c
> > +++ b/mm/hmm.c
> > @@ -336,13 +336,13 @@ static int hmm_vma_do_fault(struct mm_walk *walk,
> > unsigned long addr,
> > flags |= write_fault ? FAULT_FLAG_WRITE : 0;
> > ret = handle_mm_fault(vma, addr, flags);
> > if (ret & VM_FAULT_RETRY)
> > - return -EBUSY;
> > + return -EAGAIN;
> > if (ret & VM_FAULT_ERROR) {
> > *pfn = range->values[HMM_PFN_ERROR];
> > return -EFAULT;
> > }
> >
> > - return -EAGAIN;
> > + return -EBUSY;
> > }
> >
> > static int hmm_pfns_bad(unsigned long addr,
> > @@ -368,7 +368,7 @@ static int hmm_pfns_bad(unsigned long addr,
> > * @fault: should we fault or not ?
> > * @write_fault: write fault ?
> > * @walk: mm_walk structure
> > - * Returns: 0 on success, -EAGAIN after page fault, or page fault error
> > + * Returns: 0 on success, -EBUSY after page fault, or page fault error
> > *
> > * This function will be called whenever pmd_none() or pte_none() returns
> > true,
> > * or whenever there is no page directory covering the virtual address
> > range.
> > @@ -391,12 +391,12 @@ static int hmm_vma_walk_hole_(unsigned long addr,
> > unsigned long end,
> >
> > ret = hmm_vma_do_fault(walk, addr, write_fault,
> > &pfns[i]);
> > - if (ret != -EAGAIN)
> > + if (ret != -EBUSY)
> > return ret;
> > }
> > }
> >
> > - return (fault || write_fault) ? -EAGAIN : 0;
> > + return (fault || write_fault) ? -EBUSY : 0;
> > }
> >
> > static inline void hmm_pte_need_fault(const struct hmm_vma_walk
> > *hmm_vma_walk,
> > @@ -527,11 +527,11 @@ static int hmm_vma_handle_pte(struct mm_walk *walk,
> > unsigned long addr,
> > uint64_t orig_pfn = *pfn;
> >
> > *pfn = range->values[HMM_PFN_NONE];
> > - cpu_flags = pte_to_hmm_pfn_flags(range, pte);
> > - hmm_pte_need_fault(hmm_vma_walk, orig_pfn, cpu_flags,
> > - &fault, &write_fault);
> > + fault = write_fault = false;
> >
> > if (pte_none(pte)) {
> > + hmm_pte_need_fault(hmm_vma_walk, orig_pfn, 0,
> > + &fault, &write_fault);
>
> This really threw me until I applied the patches to a tree. It looks like
> this
> is just optimizing away a pte_none() check. The only functional change which
> was mentioned was returning the number of populated pfns. So I spent a bit of
> time trying to figure out why hmm_pte_need_fault() needed to move _here_ to do
> that... :-(
>
> It would have been nice to have said something about optimizing in the commit
> message.
Yes i should have added that to the commit message i forgot.
>
> > if (fault || write_fault)
> > goto fault;
> > return 0;
> > @@ -570,7 +570,7 @@ static int hmm_vma_handle_pte(struct mm_walk *walk,
> > unsigned long addr,
> > hmm_vma_walk->last = addr;
> > migration_entry_wait(vma->vm_mm,
> > pmdp, addr);
> > - return -EAGAIN;
> > + return -EBUSY;
> > }
> > return 0;
> > }
> > @@ -578,6 +578,10 @@ static int hmm_vma_handle_pte(struct mm_walk *walk,
> > unsigned long addr,
> > /* Report error for everything else */
> > *pfn = range->values[HMM_PFN_ERROR];
> > return -EFAULT;
> > + } else {
> > + cpu_flags = pte_to_hmm_pfn_flags(range, pte);
> > + hmm_pte_need_fault(hmm_vma_walk, orig_pfn, cpu_flags,
> > + &fault, &write_fault);
>
> Looks like the same situation as above.
>
> > }
> >
> > if (fault || write_fault)
> > @@ -628,7 +632,7 @@ static int hmm_vma_walk_pmd(pmd_t *pmdp,
> > if (fault || write_fault) {
> > hmm_vma_walk->last = addr;
> > pmd_migration_entry_wait(vma->vm_mm, pmdp);
> > - return -EAGAIN;
> > + return -EBUSY;
>
> While I am at it. Why are we swapping EAGAIN and EBUSY everywhere?
It is a part of the API change when going from hmm_vma_fault() to
hmm_range_fault() and unifying the return values with the old
hmm_vma_get_pfns() so that all API have the same meaning behind
the same return value.
Cheers,
Jérôme
