Re: DAG level service level agreements

2016-09-20 Thread Maxime Beauchemin
Hi, You can just add your SLA parameter to your `default_args` and you should get a single email with the list of tasks that didn't make the SLA soon after the timedelta is expired. Max On Tue, Sep 20, 2016 at 5:36 PM, Ali Naqvi wrote: > Hi folks, > I know that currently SLAs are implemented f

DAG level service level agreements

2016-09-20 Thread Ali Naqvi
Hi folks, I know that currently SLAs are implemented for tasks via a simple ``` sla=datetime.timedelta(hours=1) ``` , but I was wondering is there a way to implement a dag level SLA in airflow. Best Regards, Ali

Re: Airflow Contributors & Roadmapping Meeting 10/07

2016-09-20 Thread Gurer Kiratli
All, Here is the signup sheet that you can use. https://cwiki.apache.org/confluence/display/AIRFLOW/Contributor+Meetings?flashId=-254062785 Sid, I think the nature of the roadmap meeting is different than the sync up. We might want to have one roadmap meeting each quarter and sync up meetings a

Airflow Talk - A Practical Introduction to Airflow

2016-09-20 Thread Maxime Beauchemin
Great talk by Matt Davis from PyBay 2016! https://www.youtube.com/watch?v=4iDjegukrkI&index=17&list=PL85KuAjbN_gtGn4v1ELSWJlTFZF_5Ciog Max

Version issue when running Airflow on master after running 'python setup.py develop'

2016-09-20 Thread siddharth anand
Max, It looks like `python setup.py develop` no longer works on master. Any ideas? Opened the JIRA below: https://issues.apache.org/jira/browse/AIRFLOW-522 -s

Re: Airflow Meetup tomorrow

2016-09-20 Thread siddharth anand
Jeff, We (Agari) use https://zoom.us/ it's super lightweight and easy to use. You can easily record the presentation (to reshare later), share your desktop, etc... The video/audio quality is great. The free version limits each meeting to 40 minutes, which is how they get people to pay for it.. I'

Re: Airflow Meetup tomorrow

2016-09-20 Thread Jeff Balogh
Unfortunately, we moved to a new office earlier this month and don't have our VC setup going yet, so we won't be able to stream or record the event tomorrow. On Tue, Sep 20, 2016 at 11:21 AM, Sumit Maheshwari wrote: > Big +1 for live streaming.. > > > > On Tue, Sep 20, 2016 at 11:14 PM, siddharth

Re: Airflow Meetup tomorrow

2016-09-20 Thread Sumit Maheshwari
Big +1 for live streaming.. On Tue, Sep 20, 2016 at 11:14 PM, siddharth anand wrote: > Jeff, > For the meet-up tomorrow, I'm assuming there will be a streaming feed and > possibly also a video conferencing component since a lot of the committers > and community members are remote (committers :

Airflow Meetup tomorrow

2016-09-20 Thread siddharth anand
Jeff, For the meet-up tomorrow, I'm assuming there will be a streaming feed and possibly also a video conferencing component since a lot of the committers and community members are remote (committers : bolke, jeremiah, sumit, li xuanji aka zodiac). Can you update the Meetup with a link for the str

Re: Airflow Contributors & Roadmapping Meeting 10/07

2016-09-20 Thread siddharth anand
Hi Gurer, I can see it as more efficient since you folks are hosting an onsite event that includes lunch. If folks are expected to make a physical appearance, then it makes sense to make the event longer to offset commute costs (in terms of time). As mentioned above, I think that might be a little

Re: Airflow Contributors & Roadmapping Meeting 10/07

2016-09-20 Thread Gurer Kiratli
Hi Sid, Thanks for your feedback. I think creating a signup page is a great idea. I will do that and share and as you said we can collect feedback through there. For the 2 hours, as I put in the agenda the first hour is to catch up and the second hour is to discuss about the roadmap and future of

Re: How to get PRs reviewed?

2016-09-20 Thread siddharth anand
Hi George, I'll be reviewing 1752 today - I've commented on https://github.com/apache/incubator-airflow/pull/1752 A few of us (Jlowin and I) had babies in the past week so are "reviewing" diapers and various baby antics. But, I'll have time to test the commit above. -s On Mon, Sep 19, 2016 at 10: