Now. Our previous infrastructure with self-hosted runners is broken just now, when we have the money. And we need to fix it to start using them.
This will allow us to speed up our builds a lot - but we need someone who might complete the dev-ops work on setting up Kubernetes Controller as a self-hosted runner on AWS. This work has been largely completed by Hussein before - https://github.com/actions/actions-runner-controller - but it needs to be wrapped up, completed and authentication set-up with the ASF infrastructure. I believe Hussein has a bit less time now, but we need at least one or two people who would like to lead completion of it and I am sure Hussein, myself, Ash will want to be involved - I think we want to avoid the situation we had before that generally on Ash was able to fix things that were broken. And pretty much only I was able to act on some parts of it - like deploying a new runner to our image. We want to avoid a bus factor here again. Luckily - this time we are betting on a proven and standard approach that is prepared by GitHub, So - unlike the previous solution - this will be largely just deploying what is there and some discussions with the ASF Infrastructure team to connect the controller (and they've done that in the past for other projects). So we are looking (among committers) - for people who would be willing to take on the work. I am super happy to help, but I really want to take a back-driver seat this time around. Can we have someone who would like to lead it - and likely someone else to do it together ? I imagine we will end up with a simple doc describing the deployment and typical operations we will do there - similarly as we do with release management now - so that eventually more people might help in case we need some changes etc. J. On Fri, Aug 2, 2024 at 4:48 AM Wei Lee <weilee...@gmail.com> wrote: > Awesome! > > > On Jul 29, 2024, at 3:08 AM, Utkarsh Sharma < > utkarsh.sha...@astronomer.io.INVALID> wrote: > > > > Sounds great! :) > > > > On Sun, Jul 28, 2024 at 4:17 PM Pierre Jeambrun <pierrejb...@gmail.com> > > wrote: > > > >> Great news! > >> > >> On Sat 27 Jul 2024 at 01:15, Sadha Chilukoori <sage.quoti...@gmail.com> > >> wrote: > >> > >>> That's wonderful news. > >>> > >>> On Fri, Jul 26, 2024 at 12:34 PM Oliveira, Niko > >>> <oniko...@amazon.com.invalid> > >>> wrote: > >>> > >>>> Hello folks, > >>>> > >>>> This is a short note to announce that the AWS Open Source Credits > >> Program > >>>> has approved us for another round of credits this year. $31,000 of > >>> credits > >>>> have been deposited in our Apache Airflow AWS account as of yesterday! > >>>> > >>>> These credits help to run portions of our hosted testing > >> infrastructure. > >>>> > >>>> Cheers, > >>>> Niko > >>>> > >>> > >> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@airflow.apache.org > For additional commands, e-mail: dev-h...@airflow.apache.org > >
