Hey everyone, Apologies for the very delayed meeting notes from the last dev call. I updated our meeting notes document in the Airflow 3.x wiki <https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+3.x>to capture the notes. The link for those notes is here <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=373886699#Airflow3.xDevCall:Meetingnotes-Summary.8>
To everyone who attended the meeting, please check the summary and add anything that I may have missed. For those who could not join, please let us know if you disagree with anything discussed and agreed upon in the meeting. Also, please do ask questions if something is unclear. Our next meeting is scheduled for the day after tomorrow 11th of September at the same time. The agenda is focused fairly tactically on the Airflow 3.1 beta release. With a short agenda, I am updating the meeting for 30 minutes instead of the full hour. Please let me know if you would like to add anything to the agenda <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=373886699#Airflow3.xDevCall:Meetingnotes-ProposedAgenda.9> . Best regards, Vikram -- Below is the summary from the call: - Development Updates and Presentations (Please keep the updates to less than 10 minutes): - AIP-72 Task Execution Interface aka Task SDK <https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-72+Task+Execution+Interface+aka+Task+SDK> update (Ash, Kaxil) - Kaxil gave a detailed overview of the progress on this including the following highlights. - Secrets masker merged. This code is now shared between Task SDK and Airflow core - A couple of major PRs are landing this week. Includes: TP's DAG model removal and Kaxil's operator defaults schema changes (expect temporary breakage) - Schema defaults implementation is now in place with an updated contract between server/client with precedence hierarchy for defaults - A lot of the imports have now been cleaned up. It is 70% complete (12/17 issues merged), led by Ephraim. - Handling of the Configuration code in progress, with Amogh moving config to shared library (complex due to widespread usage) - AIP-86 Deadline Alerts <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=323488182> update (Dennis, Ramit) - Dennis gave an overview of the progress, following up from the email to the dev list saying that the Async callbacks are working and will ship in 3.1 as planned. - However, "Sync callbacks" will be delayed to 3.2. - Dennis raised the question about whether the sync callbacks should wait for AIP-92 proposal implementation, since there is a possible conflict on callback architecture with that proposal. - The consensus with the team at the dev call was that Deadline Alert Sync callbacks should continue with the existing design as proposed, rather than waiting for AIP-92. - The action item was for Dennis to update the AIP (for Deadline Alerts) with this current status plus design update, and follow up with a lazy consensus email to the dev list. - Airflow 3.1 test plan update <https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+3.1+Test+Plan> (Rahul) - Rahul walked through an update of the 3.1 test plan and said testing was in progress with regression tests running on main and also with feature validation of the scoped AIPs on main. - Rahul also highlighted that there were many open issues which needed to be triaged for the 3.1 milestone and that he was working on Amogh on testing for the import modifications. - Rahul then handed off to Shahar for internationalizations, by saying that the translation owners were taking responsibility for testing their respective translations - Language translations update (Shahar) - Shahar said that there were would a English freeze a week early to enable translation completion before release - Additionally, there would be pre-commit check as enforcement to prevent English changes during the freeze - At this point, 4 translations needed committer sponsors (Catalan, Hungarian, Italian, and Portuguese) and the goal was to have 100% translation coverage before 3.1 release. -- Vikram Koka Chief Strategy Officer Email: [email protected] <https://www.astronomer.io/>
