Re: [PR] AWS: Add configuration and set better defaults for S3 retry behaviour [iceberg]

2024-09-09 Thread via GitHub
ookumuso commented on PR #11052: URL: https://github.com/apache/iceberg/pull/11052#issuecomment-2338851624 Removed all InputStream related changes in favor #10433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

Re: [PR] AWS: Add configuration and set better defaults for S3 retry behaviour [iceberg]

2024-09-09 Thread via GitHub
nastra commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1750335281 ## aws/src/test/java/org/apache/iceberg/aws/s3/TestS3FileIOProperties.java: ## @@ -491,4 +493,17 @@ public void testApplyUserAgentConfigurations() { Mockito.verif

Re: [PR] AWS: Add configuration and set better defaults for S3 retry behaviour [iceberg]

2024-09-06 Thread via GitHub
ookumuso commented on code in PR #11052: URL: https://github.com/apache/iceberg/pull/11052#discussion_r1747367991 ## aws/src/main/java/org/apache/iceberg/aws/s3/S3FileIOProperties.java: ## @@ -824,6 +889,65 @@ public void applyEndpointConfigurations(T builder) { } }

[PR] AWS: Add configuration and set better defaults for S3 retry behaviour [iceberg]

2024-08-30 Thread via GitHub
ookumuso opened a new pull request, #11052: URL: https://github.com/apache/iceberg/pull/11052 Iceberg workloads which exceed S3's prefix limits will see HTTP 503 (SlowDown) error responses. The ideal customer experience is for Iceberg to retry these 503 errors persistently, such that the wo