zhangshenghang opened a new pull request, #11098:
URL: https://github.com/apache/seatunnel/pull/11098

   ### Purpose
   
   Fixes #10929.
   
   HTTP cursor pagination could keep polling forever when an API returned the 
same non-empty cursor for a terminal page. In that case the next request cannot 
make progress because it is sent with the same cursor again.
   
   ### Change
   
   - Track the cursor used for the current request before reading the response 
cursor.
   - Stop cursor pagination when the response cursor is empty or unchanged.
   - Add a unit test that reproduces a terminal page with the same cursor and 
an empty data array.
   
   ### Verification
   
   - ./mvnw -pl seatunnel-connectors-v2/connector-http/connector-http-base 
-Dtest=HttpSourceReaderInternalPollNextTest#testCursorPaginationStopsWhenCursorDoesNotAdvance
 test
   - ./mvnw -pl seatunnel-connectors-v2/connector-http/connector-http-base test
   - ./mvnw spotless:apply
   - ./mvnw -q -DskipTests verify
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to