Awesome, thanks Aizhamal, Jakob and everyone involved. On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy <aizha...@apache.org> wrote:
> Forgot to clarify that I will create the repo :) Thanks > > On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy < > aizha...@apache.org> > wrote: > > > Hi everyone,, > > > > We have finally pushed through the process of getting the IP clearance > for > > this donation. Thanks for driving a lot of the effort, Jakob! > > > > As per Apache Infra response [1], we now can create a new > > 'airflow-on-k8s-operator' repo under apache/airflow and move the code. > > > > > > [1] > > > https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel > > > > On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy < > > aizha...@apache.org> wrote: > > > >> Hi Tao and everyone, > >> > >> Sorry that we haven't updated you in a while. We have just changed the > >> licenses into appropriate ones and currently still dealing with its > >> dependencies. But it is moving now. +Jakob Homan <jgho...@gmail.com> I > >> think was about to start a vote soon. > >> > >> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fengta...@gmail.com> wrote: > >> > >>> Hey, > >>> > >>> Is the Airflow k8s Operator project now part of airflow code base now? > Or > >>> still waiting for IP clearance? > >>> > >>> Thanks, > >>> -Tao > >>> > >>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy < > >>> aizha...@apache.org> > >>> wrote: > >>> > >>> > Thanks everyone for participating in the discussion! I see there is a > >>> > consensus among the community on this regard, therefore we will move > >>> > forward with the process. > >>> > > >>> > Next step is to get IP clearance as described here [1]. This step is > >>> done > >>> > by the receiving PMC, and @Jakob Homan <jgho...@gmail.com> has > agreed > >>> to > >>> > help. Thank you! > >>> > > >>> > I am closing this thread now, and Jakob will start a new one when it > is > >>> > time to vote. > >>> > > >>> > Thanks everyone, > >>> > Aizhamal > >>> > > >>> > [1] http://incubator.apache.org/ip-clearance/index.html > >>> > > >>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła < > >>> kamil.breg...@polidea.com> > >>> > wrote: > >>> > > >>> > > +1 > >>> > > > >>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk < > >>> jarek.pot...@polidea.com> > >>> > > wrote: > >>> > > > > >>> > > > +1 for aieflow-on-k8s-operator. Good enough :) > >>> > > > > >>> > > > J. > >>> > > > > >>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fengta...@gmail.com > > > >>> > > napisał: > >>> > > > > >>> > > > > +1 on `airflow-on-k8s-operator` as well > >>> > > > > > >>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <r...@rywalker.com> > >>> wrote: > >>> > > > > > >>> > > > > > +1 from me for sure. Thanks for pushing this through > Aizhamal. > >>> > > > > > > >>> > > > > > GCP just named their flink operator ( > >>> > > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator > >>> > > > > > ) *flink-on-k8s-operator.* > >>> > > > > > > >>> > > > > > So for name, I prefer either *k8s-operator-for-airflow* or > >>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better > >>> because > >>> > > > > > *airflow* is the first word rather than the last. > >>> > > > > > > >>> > > > > > -Ry > >>> > > > > > > >>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. > >>> Potiuk@ > >>> > > > > > polidea. com ( jarek.pot...@polidea.com ) > napisał: > >>> > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > Fantastic! Strong +1 from me. > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > To alleviate some of the concerns - we @Polidea are just > >>> > starting a > >>> > > > > > > project for big and serious customer where we will most > >>> likely > >>> > use > >>> > > and > >>> > > > > > > extend Kubernetes Operator. > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > We have 3 people that could become contributors and > >>> commiters day > >>> > > one, > >>> > > > > so > >>> > > > > > > we can already help building community for it. Looking > >>> forward to > >>> > > > > > > following the Apache way in this case ! > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > J. > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ > gmail. > >>> > com ( > >>> > > > > > > fengta...@gmail.com ) > wrote: > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> +1 as well. One question: does the original author still > >>> > actively > >>> > > > > > maintain > >>> > > > > > >> or would like to continue maintaining the code base after > >>> the > >>> > > repo is > >>> > > > > > >> moved > >>> > > > > > >> > >>> > > > > > >> to Airflow? > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < > sumeet. > >>> > manit@ > >>> > > > > > gmail. com > >>> > > > > > >> ( sumeet.ma...@gmail.com ) > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> wrote: > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> Strong +1 > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < > >>> > > aizhamal@ > >>> > > > > > apache. > >>> > > > > > >>> org ( aizha...@apache.org ) > > >>> > > > > > >>> > >>> > > > > > >>> wrote: > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Hello Airflow community, > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Over the last year, an engineer at Google developed, and > >>> open > >>> > > > > sourced > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> a > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it > >>> to > >>> > > deploy > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> Airflow > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> on their k8s cluster freely. > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> There have been discussions among community members that > >>> it > >>> > > would be > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> great > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> to donate the operator to Apache to be part of Airflow. > >>> That > >>> > > way it > >>> > > > > is > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> easy > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> to accept contributions from the community, improve and > >>> > > maintain it > >>> > > > > > >>>> collectively and transparently, along with the > Airflow-k8s > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> integration. > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> This idea has been discussed at Google, and we have > >>> obtained > >>> > all > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> necessary > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> approvals to donate the operator. > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> This discussion is to gather opinions from the community > >>> > > whether you > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> all > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> think that it is a good idea. I personally think that > this > >>> > > would be > >>> > > > > a > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> great > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> addition to Airflow. > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Please express your thoughts or concerns if you have > any. > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> The discussion will run for 72 hours, and if there is > >>> > consensus > >>> > > on > >>> > > > > > >>>> accepting the donation, we will move the code under the > >>> Apache > >>> > > > > > >>>> organization, to be owned by the Airflow community. If > >>> > > consensus is > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> not > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> evident, we can have a vote after this discussion. > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Thanks, > >>> > > > > > >>>> > >>> > > > > > >>>> Aizhamal > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > >>> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=r...@rywalker.com ) > >>> > > > > > > >>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk < > >>> > > > > jarek.pot...@polidea.com > >>> > > > > > > wrote: > >>> > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > The name is indeed misleading. My proposal would be > >>> > > > > > > k8s-operator-for-airflow - this might make it unambiguous . > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. > >>> Potiuk@ > >>> > > > > > polidea. > >>> > > > > > > com ( jarek.pot...@polidea.com ) > napisał: > >>> > > > > > > > >>> > > > > > > > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> Fantastic! Strong +1 from me. > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> To alleviate some of the concerns - we @Polidea are just > >>> > starting > >>> > > a > >>> > > > > > >> project for big and serious customer where we will most > >>> likely > >>> > > use and > >>> > > > > > >> extend Kubernetes Operator. > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> We have 3 people that could become contributors and > >>> commiters > >>> > day > >>> > > one, > >>> > > > > > so > >>> > > > > > >> we can already help building community for it. Looking > >>> forward > >>> > to > >>> > > > > > >> following the Apache way in this case ! > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> J. > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ > >>> gmail. > >>> > com > >>> > > ( > >>> > > > > > >> fengta...@gmail.com ) > wrote: > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> +1 as well. One question: does the original author still > >>> > actively > >>> > > > > > maintain > >>> > > > > > >>> or would like to continue maintaining the code base after > >>> the > >>> > > repo is > >>> > > > > > >>> moved > >>> > > > > > >>> to Airflow? > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < > sumeet. > >>> > > manit@ > >>> > > > > > gmail. com > >>> > > > > > >>> ( sumeet.ma...@gmail.com ) > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> wrote: > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Strong +1 > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < > >>> > > aizhamal@ > >>> > > > > > apache. > >>> > > > > > >>>> org ( aizha...@apache.org ) > > >>> > > > > > >>>> wrote: > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> Hello Airflow community, > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> Over the last year, an engineer at Google developed, > and > >>> open > >>> > > > > sourced > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> a > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use > it > >>> to > >>> > > deploy > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> Airflow > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> on their k8s cluster freely. > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> There have been discussions among community members > that > >>> it > >>> > > would > >>> > > > > be > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> great > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> to donate the operator to Apache to be part of Airflow. > >>> That > >>> > > way it > >>> > > > > > is > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> easy > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> to accept contributions from the community, improve and > >>> > > maintain it > >>> > > > > > >>>>> collectively and transparently, along with the > >>> Airflow-k8s > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> integration. > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> This idea has been discussed at Google, and we have > >>> obtained > >>> > > all > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> necessary > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> approvals to donate the operator. > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> This discussion is to gather opinions from the > community > >>> > > whether > >>> > > > > you > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> all > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> think that it is a good idea. I personally think that > >>> this > >>> > > would > >>> > > > > be a > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>> great > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> addition to Airflow. > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> Please express your thoughts or concerns if you have > any. > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> The discussion will run for 72 hours, and if there is > >>> > > consensus on > >>> > > > > > >>>>> accepting the donation, we will move the code under the > >>> > Apache > >>> > > > > > >>>>> organization, to be owned by the Airflow community. If > >>> > > consensus is > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>> not > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> evident, we can have a vote after this discussion. > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> Thanks, > >>> > > > > > >>>>> Aizhamal > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/ > >>> > > airflow-operator ( > >>> > > > > > >>>>> > https://github.com/GoogleCloudPlatform/airflow-operator > >>> ) > >>> > > > > > >>>>> > >>> > > > > > >>>>> > >>> > > > > > >>>> > >>> > > > > > >>>> > >>> > > > > > >>> > >>> > > > > > >>> > >>> > > > > > >> > >>> > > > > > >> > >>> > > > > > > > >>> > > > > > > > >>> > > > > > > > >>> > > > > > >>> > > > >>> > > >>> > >> >
