Re: [Discuss] S3 buckets or IT tests

2023-03-14 Thread Karan Kumar
Thanks everyone. I have closed the ticket https://issues.apache.org/jira/browse/INFRA-23952 since min.io seems like the path ahead. On Tue, Mar 7, 2023 at 12:24 AM Austin Bennett wrote: > +1 for Minio to keep things sufficiently simple. Full functional testing [ > ex: using s3 ] is great.

Re: [Discuss] S3 buckets or IT tests

2023-03-06 Thread Austin Bennett
+1 for Minio to keep things sufficiently simple. Full functional testing [ ex: using s3 ] is great. But, it doesn't seem critical for this use case? On Sun, Mar 5, 2023, 8:27 PM Abhishek Agarwal wrote: > I would prefer using something like min.io than running tests against S3. > Primarily

Re: [Discuss] S3 buckets or IT tests

2023-03-05 Thread Abhishek Agarwal
I would prefer using something like min.io than running tests against S3. Primarily because tests no longer remain portable if we use S3. Which also makes them harder to debug. Setting up minio using GHA seems straightforward (https://github.com/mozilla/sccache/pull/1513/files). On Mon, Mar 6,

Re: [Discuss] S3 buckets or IT tests

2023-03-05 Thread Karan Kumar
Oh yes, https://issues.apache.org/jira/browse/INFRA-23952 Is the ticket I am talking about. As the INFRA folks require approval to proceed, can one of the PMC's drop a comment regarding approval/rejection on the same jira. If we are not able to procure a bucket, then we can start exploring mini

Re: [Discuss] S3 buckets or IT tests

2023-02-22 Thread Gian Merlino
I think the ticket you're referring to is https://issues.apache.org/jira/browse/INFRA-23952. It would definitely be valuable to run S3 integration tests as part of the automated test suite in GitHub Actions. If Infra is willing to provide a bucket for this purpose then we would certainly be

[Discuss] S3 buckets or IT tests

2023-02-15 Thread Karan Kumar
Hey Folks S3 read write tests currently are not executed in github actions since we do not have public creds to read/write from s3. Have raised an ASF infra ticket https://apachedruidworkspace.slack.com/archives/C030CMF6B70/p1675916945323839 so that they can give us a bucket. They require a PMC