Re: Deployment guide for airflow on kubernetes

2019-04-10 Thread Greg Neiheisel
Just to throw a few more ideas out there, we have another airflow helm chart that wires up a few additional components, like a statsd-exporter, pgbouncer, and a few extra namespace level things like resourcequotas, and limitranges, etc. Also supports Local, Celery and Kubernetes executors, along wi

Re: Deployment guide for airflow on kubernetes

2019-04-10 Thread Barni Seetharaman
+1 on the helm chart. On Tue, Apr 9, 2019 at 11:42 PM Ashwin Sai Shankar wrote: > Thanks, Maxime and Barni! > > On Tue, Apr 9, 2019 at 12:19 AM Maxime Beauchemin < > maximebeauche...@gmail.com> wrote: > > > Also looks like there's a Helm chart here. > > https://github.com/helm/charts/tree/master

Re: Deployment guide for airflow on kubernetes

2019-04-09 Thread Ashwin Sai Shankar
Thanks, Maxime and Barni! On Tue, Apr 9, 2019 at 12:19 AM Maxime Beauchemin < maximebeauche...@gmail.com> wrote: > Also looks like there's a Helm chart here. > https://github.com/helm/charts/tree/master/stable/airflow > > I haven't used it personally, but looks good at first glance > > On Mon, Ap

Re: Deployment guide for airflow on kubernetes

2019-04-09 Thread Maxime Beauchemin
Also looks like there's a Helm chart here. https://github.com/helm/charts/tree/master/stable/airflow I haven't used it personally, but looks good at first glance On Mon, Apr 8, 2019 at 9:43 PM Barni Seetharaman wrote: > Please checkout > https://github.com/GoogleCloudPlatform/airflow-operator >

Re: Deployment guide for airflow on kubernetes

2019-04-08 Thread Barni Seetharaman
Please checkout https://github.com/GoogleCloudPlatform/airflow-operator Regs Barni On Mon, Apr 8, 2019 at 5:58 PM Ashwin Sai Shankar wrote: > Hi Airflow users, > Is there a step by step deployment guide to deploy airflow on kubernetes > and airflow on celery? > We want to scale out our airflow

Deployment guide for airflow on kubernetes

2019-04-08 Thread Ashwin Sai Shankar
Hi Airflow users, Is there a step by step deployment guide to deploy airflow on kubernetes and airflow on celery? We want to scale out our airflow deployment and I'm looking for some docs around it. Thanks, Ash