Re: Airflow DAG Serialisation

2019-07-27 Thread Kevin Yang
Nice job Zhou! Really excited, exactly what we wanted for the webserver scaling issue. Want to add another big drive for Airbnb to start think about this previously to support the effort: it can not only bring consistency between webservers but also bring consistency between webserver and schedule

Re: [VOTE] Changes in import paths

2019-07-27 Thread Jarek Potiuk
Ok. I see that indeed voting could have been organised a bit better - dev list does not seem to cope well with such a complex case :). As Kamil noticed - we already have a formal AIP-21 in the Wiki - which I sh

Re: Airflow DAG Serialisation

2019-07-27 Thread Driesprong, Fokko
Looks great Zhou, I have one thing that pops in my mind while reading the AIP; should keep the caching on the webserver level. As the famous quote goes: *"There are only two hard things in Computer Science: cache invalidation and naming things." -- Phil Karlton* Right now, the fundamental change

Re: [VOTE] Changes in import paths

2019-07-27 Thread Kamil BreguĊ‚a
Document is also available as AIP on wiki: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-21%3A+Changes+in+import+paths On Sat, Jul 27, 2019, 9:07 AM Driesprong, Fokko wrote: > I agree with all, this is a bit chaotic. For the sake of clarity, I would > suggest moving the Google Doc to t

Re: [VOTE] Changes in import paths

2019-07-27 Thread Driesprong, Fokko
I agree with all, this is a bit chaotic. For the sake of clarity, I would suggest moving the Google Doc to the Wiki as an AIP. Create a structural code improvement AIP and then and add a matrix of users/cases where everybody can add his vote per case. This gives also the opportunity for changing yo