ozzieba opened a new issue, #309: URL: https://github.com/apache/arrow-rs-object-store/issues/309
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** We are trying to do bulk ingestion on a LanceDB table in GCS, and hitting 429 "TooManyRequests" errors, which are not being retried. **Describe the solution you'd like** I'd like 429 responses to always generate a retry with truncated exponential backoff. **Describe alternatives you've considered** This could theoretically be handled by users of this library like LanceDB or even application code. But it seems to me that the best place to address is here. **Additional context** GCS [guidance](https://cloud.google.com/storage/docs/request-rate): >You should [retry your requests](https://cloud.google.com/storage/docs/retry-strategy) with exponential backoff when: > * Receiving errors with 408 and 429 response codes. > * Receiving errors with 5xx response codes. In AWS this is a 503 with SlowDown as the reason: https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
