Re: [RESULT][VOTE]Release Airflow 1.8.0 based on Airflow 1.8.0rc5

2017-03-20 Thread siddharth anand
I've updated - http://incubator.apache.org/projects/airflow.html (under the News section) - CWiki Announcements : https://cwiki.apache.org/confluence/display/AIRFLOW/Announcements#Announcements-March19,2017

Re: Airflow best practices

2017-03-20 Thread Maxime Beauchemin
Gerard, this is an outstanding resource! We need to make sure people can discover it easily. I scanned the docs and tend to agree with everything mentioned. Though I'm unclear on whether and how to fold some/most of this in the Airflow docs. I guess the theoretical boundary might be that the Airfl

Re: Reminder : LatestOnlyOperator

2017-03-20 Thread Ruslan Dautkhanov
Thanks Boris. It does make sense. Although how it's different from depends_on_past task-level parameter? In both cases, a task will be skipped if there is another TI of this task is still running (from a previous dagrun), right? Thanks, Ruslan On Sat, Mar 18, 2017 at 7:11 PM, Boris Tyukin wrot

[ANNOUNCE] Apache Airflow 1.8.0-incubating Released

2017-03-20 Thread Bolke de Bruin
The Apache Airflow (incubating) Team is proud to announce the release of Apache Airflow 1.8.0-incubating. This is a source code only release. ABOUT AIRFLOW Airflow is a platform to programmatically author, schedule and monitor workflows. Use airflow to author workflows as directed acyclic graph

Re: [ANNOUNCE] Apache Airflow 1.8.0-incubating Released

2017-03-20 Thread Michael Gong
what's the difference between the Airflow 1.8.0-incubating release and the Airflow 1.8.0 release ? From: Bolke de Bruin Sent: Monday, March 20, 2017 5:30 PM To: dev@airflow.incubator.apache.org; annou...@apache.org Subject: [ANNOUNCE] Apache Airflow 1.8.0-incub

Re: Reminder : LatestOnlyOperator

2017-03-20 Thread Boris Tyukin
depends_on_past is looking at previous task instance which sounds the same as "latestonly" but the difference becomes apparent if you look at this example. Let's say you have a dag, scheduled to run every day and it has been failing for the past 3 days. The whole purpose of that dag is to populate

Re: [ANNOUNCE] Apache Airflow 1.8.0-incubating Released

2017-03-20 Thread Bolke de Bruin
They are one and the same. However, the official name is "Apache Airflow 1.8.0 incubating" which is per Apache requirements. Bolke Sent from my iPhone > On 20 Mar 2017, at 11:15, Michael Gong wrote: > > what's the difference between the Airflow 1.8.0-incubating release and the > Airflow 1.8

Re: [RESULT][VOTE]Release Airflow 1.8.0 based on Airflow 1.8.0rc5

2017-03-20 Thread Maxime Beauchemin
Ok I just pushed the package to pypi and currently running a test install on a virgin virtualenv as we speak. Note that: * I checked out the `1.8.0+apache.incubating` tag * I altered `setup.cfg` * removed my name and replace it by "Apache Airflow" * removed my email and replaced with "dev@

Re: [RESULT][VOTE]Release Airflow 1.8.0 based on Airflow 1.8.0rc5

2017-03-20 Thread Arthur Wiedmer
Max, The download url will not work : it is pointing to https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0 instead of https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0-incubating Also, we should add a long description mentioning that this is a convenience clone b

Re: [RESULT][VOTE]Release Airflow 1.8.0 based on Airflow 1.8.0rc5

2017-03-20 Thread Maxime Beauchemin
Somehow `pip install airflow --no-cache-dir` works. It must use the tarball uploaded on Pypi somehow. Max On Mon, Mar 20, 2017 at 4:44 PM, Arthur Wiedmer wrote: > Max, > > The download url will not work : > > it is pointing to > https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0