Re: [2.0 spring cleaning] Remove `dag >> task`?

2019-07-04 Thread Bas Harenslak
Big +1 on removing lesser known and confusing options and streamlining the way to use Airflow. Bas > On 3 Jul 2019, at 22:28, Felix Uellendall wrote: > > Definitly +1 for removing this whatever this is supposed to mean :D > > -feluelle > Original Message > On Jul 3, 2019,

Re: [VOTE] Labelling scheme for the upcoming official docker images of Airflow

2019-07-04 Thread Jarek Potiuk
The vote has concluded. The status is PASS. I updated the AIP-10 document https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-10+Multi-layered+and+multi-stage+official+Airflow+CI+image to reflect this. Felix - I think keeping python is a bit better. We are using the official "python:3.6-slim"

Re: [PROPOSE] Introduce and encourage pre-commit hooks framework to Airflow developer workflow

2019-07-04 Thread Kamil BreguĊ‚a
+1 At first I was skeptical about this tool. I prefer to run it by hand, but I am more and more convinced that using it as a pre-commit makes sense. On Wed, Jul 3, 2019 at 10:58 PM Felix Uellendall wrote: > > +1 (non-binding), I love that. I use a git pre-commit bash script but I think > the

Re: Meta DB transaction isolation level

2019-07-04 Thread Pala Muthiah
We found at times some read queries lock up the task instance table, piling up connections and task heartbeat transactions, which takes longer to recover. In READ COMMITTED, such long running and full table locks should be avoided in many cases. Basically we are trying to improve performance and