badalprasadsingh opened a new issue, #1560:
URL: https://github.com/apache/iceberg-go/issues/1560

   ### Apache Iceberg version
   
   main (development)
   
   ### Please describe the bug 🐞
   
   The REST catalog's vended-credential reuses the cached `io.IO/credentials` 
until the exact expiration timestamp.
   
   For long-running pipelines, there should be a safety buffer. 
   
   When a request is issued just before expiry, in-flight latency can push the 
actual `S3/GCS/ADLS` call past the token's expiry, causing intermittent 
failures.
   
   ## Proposed Solution
   
   Iceberg-Java enforces a [5-minute 
prefetch](https://github.com/apache/iceberg/blob/60975ecd8d9352cfe62448dd59915b7d7bd57011/aws/src/main/java/org/apache/iceberg/aws/s3/VendedCredentialsProvider.java#L133)
 buffer for proactively refreshing before expiration. We can also do something 
similar.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to