Hi!
In airflow on kube deployment, which of the following options would you
recommend to store dags in a production env and why? This is for about 1000
dags and everyday ~20 commits are made to dags folder
a)EFS/NFS volume
b) git sync (every container is going to do a git pull before running task)
Hi Airflow devs,
I am to new airflow and trying to figure out some details which will help
me choose the right deployment for my company. I want to create a
distributed airflow deployment either using Kube or Celery executor, and
had a few questions.
1. I see that airflow on kube is a recent featu
d at first glance
>
> On Mon, Apr 8, 2019 at 9:43 PM Barni Seetharaman >
> wrote:
>
> > Please checkout
> > https://github.com/GoogleCloudPlatform/airflow-operator
> >
> > Regs
> > Barni
> >
> > On Mon, Apr 8, 2019 at 5:58 PM Ashwin Sai Sha
ator.
> >
> > If You use KubernetesPodOperator with KubernetesExecutor then following
> > thing will happen:
> >
> > AirflowScheduler -> will create KubernetesExecutor Pod in k8s -> which
> will
> > create KubernetesPodOperator Pod in k8s.
> >
>
Hi Airflow users,
Is there a step by step deployment guide to deploy airflow on kubernetes
and airflow on celery?
We want to scale out our airflow deployment and I'm looking for some docs
around it.
Thanks,
Ash
Hi Airflow users,
What is the difference between Kube executor vs pod operator?
http://airflow.apache.org/kubernetes.html
Thanks,
Ash
