hyperbolix opened a new issue, #2895: URL: https://github.com/apache/drill/issues/2895
**Describe the bug** HTTP Storage Plugin INDEX pagination mode is field-order sensitive and should not be (JSON is supposed to be unordered). When the pagination fields 'has_next' and 'next_page' come after the data path field 'results', the presence of a next page is ignored. The next page fields are only honored when they come before the data path field. **To Reproduce** Steps to reproduce the behavior: 1. Start Drill. 2. Start the Python3 HTTP server that demonstrates the issue: https://gist.github.com/hyperbolix/b66f07d5d007ca2df321550241d748ac 3. Enable the http storage plugin and configure it using this configuration: https://gist.github.com/hyperbolix/7df108c8169cf54bcc72fdc499be1dce 4. Open the Drill query interface and issue this query: `select * from http.a_bug_test where total_results_val=300 and page_size_val=10 limit 15` 6. See that it returns 10 results, but it should return 15. 7. Modify the Python3 HTTP server, moving lines 52-58 so they come before line 50, so that the 'has_next' and 'next_page' fields come before the 'results' field. 8. Restart the Python3 HTTP server and issue the query again from step 5. 9. Observe than now 15 results are returned. **Expected behavior** The INDEX pagination mode page token fields should be honored regardless of field ordering in the JSON response. Or, at a minimum, the documentation should clearly indicate that these fields must come before the results field (which is not the order in the example in the HTTP pagination readme today). **Error detail, log output or screenshots** When the 'has_next' and 'next_page' fields come after the data path 'results' field, they are ignored, meaning the result set is incorrectly trimmed short, as though there are not additional pages, yet there are additional pages. **Drill version** Observed in 1.21.1 and also in the latest commit as of 2024-03-26: 749772cb0bd83c1a8fe455410ec80b1e5a9bf239 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org