We need two versions but most likely would not use either... That being
artifactory and git (would really love for this to be pluggable!)
We have our own dag fetch logic which right now pulls from git, caches,
then redirect airflow to that directory. For us we have airflow automated
so you pu
Also relatively new to Airflow here. Same as David above, Option 1 is not
an option for us either for the same reasons.
What I would like to see is that it can be user selectable / modifiable.
Use Case:
We have a DAG with thousands of task dependencies/tasks. After 24hrs of
progressing, we need t
Hey Matt,
Thanks for the reply. I am trying to get Airfloe working on a Windows 8 and
a Windows Server 2013 machine, so not sure if Docker would work. But thanks
for the link I will check it out!
Best,
Praveen.
On Fri, Mar 2, 2018 at 6:33 AM Matthew Housley
wrote:
> Hi Praveen,
>
> which versio
Hi Praveen,
which version of Windows are you running? If you are on a recent version of
Windows that supports Docker, running Airflow in containers might be your
best option. Take a look at this project:
https://github.com/puckel/docker-airflow
best,
Matt
On Thu, Mar 1, 2018 at 11:56 AM Praveen
Hello all,
I am trying to figure out if Airflow does indeed work on Windows? And if
so, is there any guide to installing it on windows
After some research on google and Stackoverflow, i have only found
contradictory and somewhat out of date information. Would really appreciate
some help on this.
I'm curious to hear which DagFetcher abstraction people would build or want
to use.
So far it sounded like the most popular and flexible approach would be a
`GitDagFetcher` where all SHAs and refs become a possibility, as opposed to
say a TarballOnS3DagFetcher which would require more manual artif
