Re: Task is Stuck in Up_For_Retry

2018-08-16 Thread Taylor Edmiston
Does a scheduler restart make a difference? *Taylor Edmiston* Blog | CV | LinkedIn | AngelList | Stack Overflow

Task is Stuck in Up_For_Retry

2018-08-16 Thread ramandumcs
Hi All, We are using airflow 1.9 with Local Executor more. Intermittently we are observing that tasks are getting stuck in "up_for_retry" mode and are getting retried again and again exceeding their configured max retries count. like we have configured max retries as 2 but task is retried 15 ti

Re: Plan to change type of dag_id from String to Number?

2018-08-16 Thread Ash Berlin-Taylor
The performance of SQLite doesn't matter is it is restricted to a single worker anyway -- it's definitely not recommended for running in production. -ash > On 16 Aug 2018, at 08:33, George Leslie-Waksman wrote: > > These performance characteristics are metadata database backend dependent > as

Re: Plan to change type of dag_id from String to Number?

2018-08-16 Thread George Leslie-Waksman
These performance characteristics are metadata database backend dependent as well. If there are benchmarks, I would hope we look at them across sqlite, mysql, postgresql, and any other supported backends before we take action. On Thu, Aug 9, 2018 at 12:41 PM Maxime Beauchemin < maximebeauche...@gm

Re: apache-airflow v1.10.0 on PyPi?

2018-08-16 Thread Ash Berlin-Taylor
1.10.0 isn't officially released yet, so that's why it's not on PyPi/tagged yet. (As we are still in the Incubation phase of the project we need our mentors to also sign off on our RC after we, the Airflow community, have voted on it) But yes, we should push the tags to Github. I've done that: