答复: 答复: How to know the DAG is starting to run

2018-05-14 Thread Song Liu
" could be done only once in pipeline level. A task could do it but something like this is better built-in into the pipeline. 发件人: Jiening Wen 发送时间: 2018年5月14日 11:13 收件人: dev@airflow.incubator.apache.org 主题: RE: 答复: How to know the DAG is starting to run I

RE: 答复: How to know the DAG is starting to run

2018-05-14 Thread Jiening Wen
- From: Song Liu [mailto:song...@outlook.com] Sent: Saturday 12 May 2018 9:06 AM To: dev@airflow.incubator.apache.org Subject: 答复: 答复: How to know the DAG is starting to run [External] Yes, I want to know the event about the creation of a DagRun. 发件人: crisp...@gmail.

答复: 答复: How to know the DAG is starting to run

2018-05-12 Thread Song Liu
Yes, I want to know the event about the creation of a DagRun. 发件人: crisp...@gmail.com 代表 Chris Palmer 发送时间: 2018年5月11日 15:46 收件人: dev@airflow.incubator.apache.org 主题: Re: 答复: How to know the DAG is starting to run It's not even clear to me what it means

Re: 答复: How to know the DAG is starting to run

2018-05-11 Thread Chris Palmer
It's not even clear to me what it means for a DAG to start running. The creation of a DagRun for a specific execution date is completely independent of the scheduling of any TaskInstances for that DagRun. There could be a significant delay between those two events, either deliberately encoded into

答复: How to know the DAG is starting to run

2018-05-11 Thread Song Liu
Overriding the "DAG.run" sounds like a workaround, so that if it's running a first operation of DAG then do some setup etc. 发件人: Victor Noagbodji 发送时间: 2018年5月11日 12:50 收件人: dev@airflow.incubator.apache.org 主题: Re: How to know the DAG is starting to run Hey, I

答复: How to know the DAG is starting to run

2018-05-11 Thread Song Liu
Yes, I have though this approach, but more elegant way is doing in the DAG since we don't want to add this "pipeline environment setup" as a single operator, which should be done in the DAG more gracefully. 发件人: James Meickle 发送时间: 2018年5月11日 12:09 收件人: dev@airfl