Charles Givre created DRILL-8342:
------------------------------------
Summary: Add Automatic Retry for Rate Limited APIs
Key: DRILL-8342
URL: https://issues.apache.org/jira/browse/DRILL-8342
Project: Apache Drill
Issue Type: Improvement
Components: Storage - HTTP
Affects Versions: 1.20.2
Reporter: Charles Givre
Assignee: Charles Givre
Fix For: 2.0.0
Many APIs have a burst limit for number of requests. This PR adds a retry
capability to the HTTP Storage Plugin, whereby if a 429 response code is
received, Drill will wait a configurable amount of time, and retry the request
once.
To prevent runaway pagination, this retry will only happen once per request.
This PR adds a new configuration option called retryDelay which is the number
of milliseconds that Drill should wait between retrys.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
