Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-08 Thread Jarek Potiuk
> > > That's a good idea. We do need to thank Github to give free resources to > ASF projects, but it's better if we can make it a business: we allow > individual projects to sign deals with Github to get dedicated resources. > It's a bit wasteful to ask every project to set up its own dev ops, >

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-08 Thread shane knapp ☠
On Wed, Apr 7, 2021 at 6:30 AM Hyukjin Kwon wrote: > Thanks Martin for your feedback. > > > What was your reason to migrate from Apache Jenkins to Github Actions ? > > I am sure there were more reasons for migrating from Amplap Jenkins > to GitHub

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Hyukjin Kwon
- builds FYI, cc'ing Spark dev was dropped during the discussion. If you haven't subscribed to builds@a.g, you have seen the partial discussions only. Please subscribe bui...@apache.org mailing list to participate in the discussion further. 2021년 4월 8일 (목) 오후 1:50, Wenchen Fan 님이 작성: > > for

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Wenchen Fan
> for example, having sub-groups where each group shares the resources - currently one GitHub organisation shares all resources across the projects. That's a good idea. We do need to thank Github to give free resources to ASF projects, but it's better if we can make it a business: we allow

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Hyukjin Kwon
Thanks Martin for your feedback. > What was your reason to migrate from Apache Jenkins to Github Actions ? I am sure there were more reasons for migrating from Amplap Jenkins to GitHub Actions but as far as I can remember: - To reduce the maintenance

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Martin Grigorov
On Wed, Apr 7, 2021 at 3:41 PM Hyukjin Kwon wrote: > Hi Greg, > > I raised this thread to figure out a way that we can work together to > resolve this issue, gather feedback, and to understand how other projects > work around. > Several projects I observed, as far as I can tell, have made enough

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Hyukjin Kwon
Hi Greg, I raised this thread to figure out a way that we can work together to resolve this issue, gather feedback, and to understand how other projects work around. Several projects I observed, as far as I can tell, have made enough efforts to save the resources in GitHub Actions but still

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Greg Stein
On Wed, Apr 7, 2021 at 12:25 AM Hyukjin Kwon wrote: > Hi all, > > I am an Apache Spark PMC, You are a member of the Apache Spark PMC. You are *not* a PMC. Please stop with that terminology. The Foundation has about 200 PMCs, and you are a member of one of them. You are NOT a "PMC" .. you're a

Re: Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-07 Thread Jarek Potiuk
Just a comment here - as I commented also in the ticket The document https://cwiki.apache.org/confluence/display/BUILDS/GitHub+Actions+status gives complete overview of where the Github Actions are for the ASF project. And we have some nice experiences in Apache Airflow that we will be able to

Increase the number of parallel jobs in GitHub Actions at ASF organization level

2021-04-06 Thread Hyukjin Kwon
Hi all, I am an Apache Spark PMC, and would like to know the future plan about GitHub Actions in ASF. Please also see the INFRA ticket I filed: https://issues.apache.org/jira/browse/INFRA-21646. I am aware of the limited GitHub Actions resources that are shared across all projects in ASF, and