cgivre opened a new pull request, #2691: URL: https://github.com/apache/drill/pull/2691
# [DRILL-8342](https://issues.apache.org/jira/browse/DRILL-8342): Add Automatic Retry for Rate Limited APIs ## Description Many APIs have a burst limit for number of requests. This PR adds a retry capability to the HTTP Storage Plugin, whereby if a 429 response code is received, Drill will wait a configurable amount of time, and retry the request once. To prevent runaway pagination, this retry will only happen once per request. This PR adds a new configuration option called retryDelay which is the number of milliseconds that Drill should wait between retrys. ## Documentation When using automatic pagination, you may encounter APIs that have burst limits or other limits as to the maximum number of requests in a minute or other amount of time. Drill allows you to set a `retryDelay` parameter which is the number of milliseconds that Drill should wait before resending the request. This defaults to 1 second. This option is set in the configuration for the HTTP plugin. ## Testing Added unit test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@drill.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
