Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Hello Gaetan, Just to let you know (and keep you informed) - the "AIP-26 - Production-ready Airflow Docker Image and helm chart " is now approved and I am working on it. I split it in

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Hi > For the governance I am happy to be added to the OWNERS list and I think > Daniel will be happy as well :). Feel free to submit a pull request so that I can approve directly. > [...] then official release of the helm chart needs to be voted by the PMC Hum, as of today, each approved PR res

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Hi All! Good to hear from you @gsemet. > - do you want to take full "ownership" of it, if so, how to proceed ? How the governance of the chart should be managed? Yes I think that adding me and Jarek would be a good starting point with the helm chart. We can figure out long-term governance later.

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Hello Gaetan! Nice to hear from you! On Mon, Oct 14, 2019 at 10:53 AM Gaetan Semet wrote: > Hi. > > I am Gaetan Semet (gsemet), the main maintainer of the stable/airflow > chart. > I am pretty thrilled by this conversation, and would be glad to see the > chart switch to an official image. While

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Hi. I am Gaetan Semet (gsemet), the main maintainer of the stable/airflow chart. I am pretty thrilled by this conversation, and would be glad to see the chart switch to an official image. While the chart is pretty stable and already used in production by many, I have limited time to maintain it,

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Hello everyone, I think we had some useful feedback and good points raised/reflected in the document. I think there is one remaining question about pinning dependencies and upgrading PIP dependencies with security fixes, but I think we can make it separate AIP. Are there any other concerns, or sho

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Issue created! https://github.com/helm/charts/issues/17933 . Thanks Jonathan for feedback and bringing this up! On Mon, Oct 14, 2019 at 8:29 AM Jarek Potiuk wrote: > Thanks! Good points Jonathan. I will loop in the OWNERS indeed. I am also > in contact with Daniel from Bitnami who manages the Bi

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Thanks! Good points Jonathan. I will loop in the OWNERS indeed. I am also in contact with Daniel from Bitnami who manages the Bitnami Airflow image and helm chart and hopefully we can work out an approach where we can work together :). Helm Hub is also good. I updated the AIP to reflect those. On

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

As a user of the official Helm Chart within The Trade Desk and contributor of a few things there, I'm happy that the intention is to reuse it. Like Marcin, I also got the opposite impression from reading the earlier thread messages, so thanks for clarifying. There are many valuable contribution

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Sounds great for me. Thanks On Sun, 13 Oct 2019, 11:16 Jarek Potiuk, wrote: > It's likely we are both talking about the same :). > > I was never proposing to create a new helm chart to Apache Airflow repo. I > just proposed that the official docker image is made part of Airflow and > change the

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

It's likely we are both talking about the same :). I was never proposing to create a new helm chart to Apache Airflow repo. I just proposed that the official docker image is made part of Airflow and change the official helm chart to use it. Official Helm charts are distributed via the helm github

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Maybe I didn't put that clear enough, but my comment referred to the chart not the image. In fact I've been always running the stable/airflow chart with a custom built image, without any issues. Upgrading it to the official Airflow image seems like a simple PR, which I'm sure would get accepted. F

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Some more comments about Production-ready image and security/patches aspect. I updated the motivation section in AIP-26 to explain why we are working on community-driven image. I als

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

Sorry - I missed that comment - it was not that you got ignored, I just missed it in the flood of emails I had :(. sorry. The chart (and corresponding puckel image) is quite ok for the past but if we want to move forward, we need to make sure that the image, charts etc. are driven and managed by t

Re: [PROPOSAL] Production-ready Airflow docker image and helm chart proposal

What are the issues with the existing stable/airflow chart in helm public repo? I've used it on a number of occasions and it's good enough to deploy Airflow with Celery executor and run Kubernetes pods from Airflow using in_cluster mode. Not sure if it allows to deploy Kubernetes executor though.

[PROPOSAL] Production-ready Airflow docker image and helm chart proposal

I just created "AIP-26 - Production-ready Airflow Docker Image and helm chart " proposal and would love community feedback and comments. I would love to know what is your expectation