Nice! On Fri, Jul 29, 2022 at 9:32 PM Michael Robinson via users < [email protected]> wrote:
> View this email in your browser > <https://mailchi.mp/627a8910cc73/apache-airflow-newsletter-july-2022?e=ce16eef4ef> > > This month in the Airflow community, we released Airflow 2.3.3 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1bd27974f1&e=ce16eef4ef> > and over 40 Airflow Providers packages > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=aaec9074c7&e=ce16eef4ef>, > including the new Common SQL shared provider and the new Tabular provider. > We learned and networked at an Airflow Meetup in Tel Aviv > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=51d4c8cc3e&e=ce16eef4ef> > and Google’s Airflow Day 2022 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2f955a2dfd&e=ce16eef4ef>, > and over on the dev list we discussed Dynamic Yield’s “Magic Loop” > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7cf95cdc1d&e=ce16eef4ef> > for minimizing delays caused by many concurrent dynamic DAGs, among > other topics. > > The newsletter is moving to a new platform, Mailchimp. Please subscribe > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=096e67c8c1&e=ce16eef4ef> > to ensure you always receive the latest issue. > > We can always use speakers for meetups. If you want to present your > Airflow contribution, demo your project, or share your experience at a > Community Meetup this year, let us know > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e7fc2b5028&e=ce16eef4ef>. > You could win some excellent swag! > > - > > August 9: “Airflow 101: Essential Tips for Beginners” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=166096c917&e=ce16eef4ef> > - > > August 10: “Build a Robust Data Pipeline with Airflow, dbt, and Great > Expectations – with Interactivity” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7dbc8d0b3e&e=ce16eef4ef> > - > > August 17: “Using Plugins for Webserver” with Faizan Qazi (details TBA > on Clowder > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=88a3d50cba&e=ce16eef4ef> > ) > > We released Airflow 2.3.3. You can find the build artifacts using these > links: > > - PyPI > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0d09446543&e=ce16eef4ef> > | Notes > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e2c70b8cbd&e=ce16eef4ef> > | Constraints > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=901d8a64b3&e=ce16eef4ef> > - Docker image: apache/airflow:2.3.3 > > We released Airflow Providers packages. You can find them using these > links: > > - Sources > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=22c14f066e&e=ce16eef4ef> > | Guide > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=63b31b2c5a&e=ce16eef4ef> > > *@uranusjr > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5143e93b2b&e=ce16eef4ef>* > > *#24989 Implement expand_kwargs() > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f4d747431b&e=ce16eef4ef>* > Implements a new ExpandInput type, "list-of-dicts", to support this new > shape of mapped kwargs. > To nominate a PR > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7d9a79856a&e=ce16eef4ef> > for a future issue, flag it by adding *#protm* to a comment. > > If you missed any of these, you can catch a recap, watch on-demand, or dig > into the slides: > > - > > July 28: “Apache Airflow TLV Meetup Summer Edition” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=48722ecbf9&e=ce16eef4ef> > - > > July 27: “Airflow, Spark, Trinio and Data Engineering Best Practices” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4aa33f35f0&e=ce16eef4ef> > > - > > July 26: “Using Airflow with Tensorflow and MLFlow” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=31433f5b8d&e=ce16eef4ef> > - > > July 15: “Data Engineering: Bulk Up Your Data Eng Skills using > Airflow, Spark & DASK” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bc6157ff5d&e=ce16eef4ef> > - > > July 14: “Apache Airflow – Future of Data Workflows” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b776db73d0&e=ce16eef4ef> > - > > July 12: “Anatomy of an Operator” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4aa8403602&e=ce16eef4ef> > > - > > July 7: "Airflow Day 2022 on Google Open Source Live" > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=052c3897b0&e=ce16eef4ef> > > > > - > > July 6: “Introduction to Building Pipelines in GCP using Airflow” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ea6a2f2893&e=ce16eef4ef> > > > - > > “Is Airflow the Right Choice for Machine Learning, Too?,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6213fd2ecd&e=ce16eef4ef> > by Samhita Alla, BetterProgramming/Medium > - > > “Deutsche Bank uses Cloud Composer Workload Automation,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9e495b03f8&e=ce16eef4ef> > cnxtoday.com > - > > “Shopify’s Practical Guidelines from Running Airflow for ML and Data > Workflows at Scale,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=143cd0347e&e=ce16eef4ef> > by Reza Rahimi, infoq.com > - > > “Magic Loop in Airflow – Reloaded,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c3257fbba3&e=ce16eef4ef> > by Jarek Potiuk, Apache Airflow/Medium > - > > “Shared Volumes in Airflow – the Good, the Bad, and the Ugly,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9046873bce&e=ce16eef4ef> > by Jarek Potiuk, Apache Airflow/Medium > - > > “Running Airflow on ARM M1/M2? Hell Yes, but Upgrade to 2.3+,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a782285305&e=ce16eef4ef> > by Jarek Potiuk, Apache Airflow/Medium > - > > “Generic Airflow Transfers Made Easy,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eeb6b8d1cb&e=ce16eef4ef> > by Jarek Potiuk, Apache Airflow/Medium > - > > “Airflow’s Magic Loop,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cac6eafbf4&e=ce16eef4ef> > by Itay Bittan, Towards Data Science/Medium > - > > “Load Data from Postgres to BigQuery with Airflow,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7d83f3800a&e=ce16eef4ef> > by Giorgos Myrianthous, Towards Data Science/Medium > - > > “Automated Alerts for Airflow from Slack,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=aa3832265c&e=ce16eef4ef> > by Chris Young, Towards Data Science/Medium > > > - > > *Votes: * > - > > Airflow 2.3.3rc1 release (approved) > - > > Airflow 2.3.3 release (approved) > - > > Airflow Providers (RC1) (approved) > - > > July’s PR of the Month (approved) > - > > Release Airflow Python client 2.3.0 based on 2.3.0rc1 (pending) > - > > *Lazy consensus:* > - > > Deprecate “dependency detector” pluggability (passed) > - > > *Discussed:* > - > > “Magic Loop” as first-class citizen in Airflow > - > > Airflow scheduling delay metric definition > - > > Grouping of concerns > - > > Migrate Airflow code to use PEP 563 (postponed evaluation of > annotations) > - > > Standard way of getting provider version? > - > > Trimming down Airflow versions in issues > - > > Deprecating the SLA feature? > - > > Implementing a testing framework for Airflow > - > > Consolidate DAG scheduling params > - > > *Proposed:* > - > > Provider’s mixed governance model > - > > Simplification of WWW asset compilation for Breeze/dev env > > > - > > Airflow 2.4.0 > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d0f3d39055&e=ce16eef4ef> > > This release will focus on new features. > > - > > Airflow Helm Chart 1.7.0 > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cfff66719b&e=ce16eef4ef> > > The next release for the Airflow Helm Chart, fixing bugs and adding more > features. > For more info about upcoming releases and in-development projects, visit > the current projects issue (#10176 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4c64a96866&e=ce16eef4ef> > ). > > The newsletter is moving to a new platform, Mailchimp. Please subscribe > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=05b5c570d8&e=ce16eef4ef> > to ensure you always receive the latest issue. > Is there an event or publication the community should know about? Let us > know at [email protected] <[email protected]> or > [email protected]. > Want to change how you receive these emails? > You can update your preferences > <https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=b4d78fe0f4> > or unsubscribe from this list > <https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=b4d78fe0f4> > . > > >
