Forgot to clarify that I will create the repo :) Thanks On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy <aizha...@apache.org> wrote:
> Hi everyone,, > > We have finally pushed through the process of getting the IP clearance for > this donation. Thanks for driving a lot of the effort, Jakob! > > As per Apache Infra response [1], we now can create a new > 'airflow-on-k8s-operator' repo under apache/airflow and move the code. > > > [1] > https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel > > On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy < > aizha...@apache.org> wrote: > >> Hi Tao and everyone, >> >> Sorry that we haven't updated you in a while. We have just changed the >> licenses into appropriate ones and currently still dealing with its >> dependencies. But it is moving now. +Jakob Homan <jgho...@gmail.com> I >> think was about to start a vote soon. >> >> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fengta...@gmail.com> wrote: >> >>> Hey, >>> >>> Is the Airflow k8s Operator project now part of airflow code base now? Or >>> still waiting for IP clearance? >>> >>> Thanks, >>> -Tao >>> >>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy < >>> aizha...@apache.org> >>> wrote: >>> >>> > Thanks everyone for participating in the discussion! I see there is a >>> > consensus among the community on this regard, therefore we will move >>> > forward with the process. >>> > >>> > Next step is to get IP clearance as described here [1]. This step is >>> done >>> > by the receiving PMC, and @Jakob Homan <jgho...@gmail.com> has agreed >>> to >>> > help. Thank you! >>> > >>> > I am closing this thread now, and Jakob will start a new one when it is >>> > time to vote. >>> > >>> > Thanks everyone, >>> > Aizhamal >>> > >>> > [1] http://incubator.apache.org/ip-clearance/index.html >>> > >>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła < >>> kamil.breg...@polidea.com> >>> > wrote: >>> > >>> > > +1 >>> > > >>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk < >>> jarek.pot...@polidea.com> >>> > > wrote: >>> > > > >>> > > > +1 for aieflow-on-k8s-operator. Good enough :) >>> > > > >>> > > > J. >>> > > > >>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fengta...@gmail.com> >>> > > napisał: >>> > > > >>> > > > > +1 on `airflow-on-k8s-operator` as well >>> > > > > >>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <r...@rywalker.com> >>> wrote: >>> > > > > >>> > > > > > +1 from me for sure. Thanks for pushing this through Aizhamal. >>> > > > > > >>> > > > > > GCP just named their flink operator ( >>> > > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator >>> > > > > > ) *flink-on-k8s-operator.* >>> > > > > > >>> > > > > > So for name, I prefer either *k8s-operator-for-airflow* or >>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better >>> because >>> > > > > > *airflow* is the first word rather than the last. >>> > > > > > >>> > > > > > -Ry >>> > > > > > >>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. >>> Potiuk@ >>> > > > > > polidea. com ( jarek.pot...@polidea.com ) > napisał: >>> > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > Fantastic! Strong +1 from me. >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > To alleviate some of the concerns - we @Polidea are just >>> > starting a >>> > > > > > > project for big and serious customer where we will most >>> likely >>> > use >>> > > and >>> > > > > > > extend Kubernetes Operator. >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > We have 3 people that could become contributors and >>> commiters day >>> > > one, >>> > > > > so >>> > > > > > > we can already help building community for it. Looking >>> forward to >>> > > > > > > following the Apache way in this case ! >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > J. >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. >>> > com ( >>> > > > > > > fengta...@gmail.com ) > wrote: >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> +1 as well. One question: does the original author still >>> > actively >>> > > > > > maintain >>> > > > > > >> or would like to continue maintaining the code base after >>> the >>> > > repo is >>> > > > > > >> moved >>> > > > > > >> >>> > > > > > >> to Airflow? >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. >>> > manit@ >>> > > > > > gmail. com >>> > > > > > >> ( sumeet.ma...@gmail.com ) >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> wrote: >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> Strong +1 >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < >>> > > aizhamal@ >>> > > > > > apache. >>> > > > > > >>> org ( aizha...@apache.org ) > >>> > > > > > >>> >>> > > > > > >>> wrote: >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Hello Airflow community, >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Over the last year, an engineer at Google developed, and >>> open >>> > > > > sourced >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> a >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it >>> to >>> > > deploy >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> Airflow >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> on their k8s cluster freely. >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> There have been discussions among community members that >>> it >>> > > would be >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> great >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> to donate the operator to Apache to be part of Airflow. >>> That >>> > > way it >>> > > > > is >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> easy >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> to accept contributions from the community, improve and >>> > > maintain it >>> > > > > > >>>> collectively and transparently, along with the Airflow-k8s >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> integration. >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> This idea has been discussed at Google, and we have >>> obtained >>> > all >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> necessary >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> approvals to donate the operator. >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> This discussion is to gather opinions from the community >>> > > whether you >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> all >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> think that it is a good idea. I personally think that this >>> > > would be >>> > > > > a >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> great >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> addition to Airflow. >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Please express your thoughts or concerns if you have any. >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> The discussion will run for 72 hours, and if there is >>> > consensus >>> > > on >>> > > > > > >>>> accepting the donation, we will move the code under the >>> Apache >>> > > > > > >>>> organization, to be owned by the Airflow community. If >>> > > consensus is >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> not >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> evident, we can have a vote after this discussion. >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Thanks, >>> > > > > > >>>> >>> > > > > > >>>> Aizhamal >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >> >>> > > > > > >> >>> > > > > > > >>> > > > > > > >>> > > > > > >>> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=r...@rywalker.com ) >>> > > > > > >>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk < >>> > > > > jarek.pot...@polidea.com >>> > > > > > > wrote: >>> > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > The name is indeed misleading. My proposal would be >>> > > > > > > k8s-operator-for-airflow - this might make it unambiguous . >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. >>> Potiuk@ >>> > > > > > polidea. >>> > > > > > > com ( jarek.pot...@polidea.com ) > napisał: >>> > > > > > > >>> > > > > > > >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> Fantastic! Strong +1 from me. >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> To alleviate some of the concerns - we @Polidea are just >>> > starting >>> > > a >>> > > > > > >> project for big and serious customer where we will most >>> likely >>> > > use and >>> > > > > > >> extend Kubernetes Operator. >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> We have 3 people that could become contributors and >>> commiters >>> > day >>> > > one, >>> > > > > > so >>> > > > > > >> we can already help building community for it. Looking >>> forward >>> > to >>> > > > > > >> following the Apache way in this case ! >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> J. >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ >>> gmail. >>> > com >>> > > ( >>> > > > > > >> fengta...@gmail.com ) > wrote: >>> > > > > > >> >>> > > > > > >> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> +1 as well. One question: does the original author still >>> > actively >>> > > > > > maintain >>> > > > > > >>> or would like to continue maintaining the code base after >>> the >>> > > repo is >>> > > > > > >>> moved >>> > > > > > >>> to Airflow? >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. >>> > > manit@ >>> > > > > > gmail. com >>> > > > > > >>> ( sumeet.ma...@gmail.com ) >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> wrote: >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Strong +1 >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < >>> > > aizhamal@ >>> > > > > > apache. >>> > > > > > >>>> org ( aizha...@apache.org ) > >>> > > > > > >>>> wrote: >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> Hello Airflow community, >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> Over the last year, an engineer at Google developed, and >>> open >>> > > > > sourced >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> a >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it >>> to >>> > > deploy >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> Airflow >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> on their k8s cluster freely. >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> There have been discussions among community members that >>> it >>> > > would >>> > > > > be >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> great >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> to donate the operator to Apache to be part of Airflow. >>> That >>> > > way it >>> > > > > > is >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> easy >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> to accept contributions from the community, improve and >>> > > maintain it >>> > > > > > >>>>> collectively and transparently, along with the >>> Airflow-k8s >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> integration. >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> This idea has been discussed at Google, and we have >>> obtained >>> > > all >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> necessary >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> approvals to donate the operator. >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> This discussion is to gather opinions from the community >>> > > whether >>> > > > > you >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> all >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> think that it is a good idea. I personally think that >>> this >>> > > would >>> > > > > be a >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>> great >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> addition to Airflow. >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> Please express your thoughts or concerns if you have any. >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> The discussion will run for 72 hours, and if there is >>> > > consensus on >>> > > > > > >>>>> accepting the donation, we will move the code under the >>> > Apache >>> > > > > > >>>>> organization, to be owned by the Airflow community. If >>> > > consensus is >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>> not >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> evident, we can have a vote after this discussion. >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> Thanks, >>> > > > > > >>>>> Aizhamal >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/ >>> > > airflow-operator ( >>> > > > > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator >>> ) >>> > > > > > >>>>> >>> > > > > > >>>>> >>> > > > > > >>>> >>> > > > > > >>>> >>> > > > > > >>> >>> > > > > > >>> >>> > > > > > >> >>> > > > > > >> >>> > > > > > > >>> > > > > > > >>> > > > > > > >>> > > > > >>> > > >>> > >>> >>
