Re: Proposed roadmap for Airflow 2.0

2019-10-09 Thread Chao-Han Tsai
Although Airflow has the concept of task priority like Ash mentioned, it does not pre-empt running tasks. On Wed, Oct 9, 2019 at 12:42 AM Ash Berlin-Taylor wrote: > There's already a concept called priority_weight on tasks > http://airflow.apache.org/concepts.html?highlight=priority_weight#pools

Re: Setting to add choice of schedule at end or schedule at start of interval

2019-10-09 Thread James Coder
I just wanted to share this with everyone related to this topic. I have a case where I need a scheduled dag run with following schedule: Sun: 10 PM Monday-Thursday: 8 AM, 11AM, 3:40 PM, 4:00 PM, 7:30 PM, 10PM Friday: 8 AM, 11AM, 3:40 PM, 4:00 PM, 7:30 PM There are most certainly a few ways to addre

Re: ApacheCon EU ticket

2019-10-09 Thread Tomasz Urbaszek
Sure! Thank you very much! Tomek On Wed, Oct 9, 2019 at 9:51 AM Aizhamal Nurmamat kyzy wrote: > @Tomasz Urbaszek I got another ticket for > the ApacheCon EU that you can use :) Are you still interested? > > On Fri, Oct 4, 2019 at 6:26 PM Jarek Potiuk > wrote: > >> Yep. That's the only Airflow

Re: ApacheCon EU ticket

2019-10-09 Thread Aizhamal Nurmamat kyzy
@Tomasz Urbaszek I got another ticket for the ApacheCon EU that you can use :) Are you still interested? On Fri, Oct 4, 2019 at 6:26 PM Jarek Potiuk wrote: > Yep. That's the only Airflow talk :) > > J. > > On Fri, Oct 4, 2019 at 5:26 PM Driesprong, Fokko > wrote: > > > I already got a ticket,

Re: Proposed roadmap for Airflow 2.0

2019-10-09 Thread Ash Berlin-Taylor
There's already a concept called priority_weight on tasks http://airflow.apache.org/concepts.html?highlight=priority_weight#pools (the doc about it is in relation to pools, but everything is run in a pool of "default_pool" if not specified.) Is that what you want? On 9 October 2019 07:38:38 BS