Re: Object Store Integration Tests in Pre-submit

2025-07-26 Thread Brahma Reddy Battula
Hey Chris, Hope you mean "https://issues.apache.org/jira/browse/INFRA-27071"; Regards, Brahma On Fri, Jul 25, 2025 at 4:38 AM Chris Nauroth wrote: > > Great, thanks everyone! I went ahead and filed an infra ticket to ask for > buckets/credentials: > > https://issues.apache.org/jira/browse/INFR

Re: Object Store Integration Tests in Pre-submit

2025-07-24 Thread Chris Nauroth
Great, thanks everyone! I went ahead and filed an infra ticket to ask for buckets/credentials: https://issues.apache.org/jira/browse/INFRA-24353 I'll keep you posted on progress. Steve, yes, I'm planning to start a HADOOP-19343 merge discuss/vote soon. Chris Nauroth On Thu, Jul 24, 2025 at 4:

Re: Object Store Integration Tests in Pre-submit

2025-07-24 Thread Steve Loughran
Didn't know about the ASF credentials. We'd want them to be used somewhere to generate those session credentials, with those credentials the only secrets that a test run would have. I"d thought of somehow generating restricted session credentials to the target bucket only, and with a duration of 6

Re: Object Store Integration Tests in Pre-submit

2025-07-23 Thread Ayush Saxena
Hi Chris, I recall needing to run the S3A tests a while back when I was working on a change related to DistCp. At the time, I considered using GitHub Actions to run those tests using AWS credentials provided by the ASF. As far as I know, such credentials are available [1], but I never pursued it f

Object Store Integration Tests in Pre-submit

2025-07-23 Thread Chris Nauroth
Hello everyone, For years, we've relied on specific contributors to run and verify the integration tests for object store integrations like S3A, because the tests require credentials for specific cloud providers. I'd like to explore if we have any path forward today to bringing those tests into th