Hi all, I have updated our meeting notes document to summarize the discussion from our dev call for Airflow 2.0 on Monday.
Thank you all who joined the call. *Doc Link*: https://cwiki.apache.org/confluence/display/AIRFLOW/Meeting+Notes#MeetingNotes-#9:19Oct2020 <https://cwiki.apache.org/confluence/display/AIRFLOW/Meeting+Notes#MeetingNotes-%239:19Oct2020> To all those who attended, can you please double-check and add if I have missed anything? To all those who didn't join, if you disagree to anything in the Summary please voice your opinion. Also please let me know if someone wants to include an item in Next call's Agenda. Including the Summary here too (might potentially break formatting): *Discussion and key Decisions* - *Providers* - Need to split each release into a separate PyPI package - Possibly not needed for alpha2, possibly for beta - Also need to split documentation for 2.0 - Need to figure out updating and maintaining versions across providers - Not needed immediately, but needed for weeks to come - Provider versioning strategy to be documented especially for contributors and committers for the future - should be automated in the future - *Alpha build / testing status* - Great to see significant engagement from the community in 2.0 testing - Vikram reported that alpha testing going well, but still in progress - Alpha2 build: Targeting a second alpha build by the end of this week - Beta1 build pushed to next week to allow more time testing with alpha builds - Google cloud composer team - will start testing with beta1 - *API* - From the API permissions standpoint, all of the changes are made and merged. - Kamil made updates to the task instance endpoint. - API is feature complete - *Scheduler HA* - - Jarek reported that they saw a deadlock once with MySQL 5.7 and added logging to see if it shows up again. Not a blocker since it is possible to disable locking on MySQL 5.7, but wanted to know if anyone else sees this. - Ping and Kevin testing Scheduler HA with a very large DAG with 21,000 tasks to benchmark in the AirBnb environment. Ash, Kevin, Ping to discuss offline. - *Smart Sensors* - Yingbao commented that it was being used in AirBnb for almost a year, very stable. - Ry suggested that a demo should be created for 2.0 production release to explain the capability - *Upgrade script to 2.0 / doc* - Daniel working on upgrade doc “Upgrading from 1.10.x to 2.0” - We need to check to see what all can we add to the upgrade check scripts to make it easier to migrate to 2.0 - Database migration tests - need to be validated as well, before 2.0 RC, including the performance of the migration to 2.0. - *UI / UX Improvements* - Very positive feedback on the UX and the auto-refresh button - Ryan Hamilton is also making accessibility-related changes to the UI. The timeline on the main 2.0 planning page has also been updated to reflect the above. *Doc Link*: https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+2.0+-+Planning Best regards, Vikram
