Charles Givre created DRILL-8320:
------------------------------------

             Summary: Prevent Infinite Pagination for Index Paginator
                 Key: DRILL-8320
                 URL: https://issues.apache.org/jira/browse/DRILL-8320
             Project: Apache Drill
          Issue Type: Bug
          Components: Storage - HTTP
    Affects Versions: 1.20.2
            Reporter: Charles Givre
            Assignee: Charles Givre
             Fix For: 2.0.0


In some cases that use keyset/index pagination, if the API does not have a 
boolean column that indicates when to stop, Drill will send requests until the 
API stops returning data.  This PR fixes this by making the boolean parameter 
optional.  

If that parameter is not present, if the index result is blank or the same as 
the previous request, pagination will end.

Note, if the pagination parameters are buried in nested objects, this cannot be 
configured with a dataPath.  If the user uses a dataPath, pagination will stop 
at the first page.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to