rustyprimus commented on issue #277: URL: https://github.com/apache/arrow-rs-object-store/issues/277#issuecomment-4536564234
I believe the likely root cause of this problem is that AWS S3 can return HTTP 200 with a throttling or transient-error body for certain operations — this is [documented by AWS](https://repost.aws/knowledge-center/s3-resolve-200-internalerror). The retry module already handles this via body_contains_error() in src/client/retry.rs (checking for "SlowDown" and "InternalError" substrings) and the retry_error_body flag on RetryableRequest. Other requests (e.g. multipart upload) already set this flag correctly. bulk_delete_request in src/aws/client.rs **does not set retry_error_body(true)** when sending its request -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
