fixed here: https://github.com/apache/incubator-airflow/pull/2513
On Mon, Sep 25, 2017 at 10:28 AM, Driesprong, Fokko
wrote:
> Hi Shoumitra,
>
> So if I understand correctly, the query finishes but the connection does
> not close. What is the result of the query? Maybe you can also share some
>
dagrun_timeout is one of the many totally broken features that should be
avoided like the plague.
On Mon, Jul 17, 2017 at 10:36 AM, Ben Schoener wrote:
> I instantiate my dags with a timeout (dagrun_timeout=timedelta(hours=1)),
> but this doesn't seem to have any effect. My DAGs can run for well
for what it's worth we've been running airflow on ECS for a few years
already.
On Wed, Jul 12, 2017 at 12:21 PM, Grant Nicholas <
grantnicholas2...@u.northwestern.edu> wrote:
> Is having a static set of workers necessary? Launching a job on Kubernetes
> from a cached docker image takes a few seco
sub dags don't really work well if you that's what you mean by
"parent/child DAGs"
On Thu, Jan 12, 2017 at 12:31 PM, Maxime Beauchemin <
maximebeauche...@gmail.com> wrote:
> Is there any error in the logs of the task instance (on the worker) towards
> the end? Perhaps the airflow process is unabl
i haven't seen exactly that bug but we do have an issue where
admin/dagmodel/ does not display *any* circles for any DAG not defined in
its own file, which sounds possible related.
On Tue, Sep 27, 2016 at 11:57 PM, siddharth anand wrote:
> I will close as unable to reproduce. If you are seeing i
Hi -
I am experiencing the following situation while evaluating airflow;
wondering if this rings any bells with anyone:
1. *airflow 1.7.1.2* is running in a *docker* container on amazon *ECS*
2. *dagrun_timeout* = timedelta(hours=24) for this DAG
3. running redshift queries with the Pos
Apologies if this is a dumb question, but I'm looking for a way to retry an
entire DAG if a single task fails, rather than retry just that task.
The context is that of a job starter + sensor, and if the sensor fails it
means the job needs to be restarted, not just re-sensored.
>From reading the d
