> View this email in your browser > <https://mailchi.mp/dc4b7128a1d6/apache-airflow-newsletter-may-2023?e=ce16eef4ef> > > > May was another action-packed month in the Airflow Community, which is now > over 2400 contributors strong! > > We released Airflow 2.6.1, Airflow 2.6.0, and two sets of Providerspackages. > > We held events in London, New York and Paris. > > We planned meetups in Charlotte, NC, and New York. > > We got even more excited about Airflow Summit, happening in September! > > As always, check the Airflow Meetups > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=088a3415a4&e=ce16eef4ef> > page to find your local community, and please reach out with items for the > next issue. > > Thanks for reading! > > > Register > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e0e8fc3306&e=ce16eef4ef> > today for updates on Airflow Summit 2023! > View the list of talks here > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fbe1bcca98&e=ce16eef4ef>. > > Still on the fence about registering? The early bird rate has been extended > until June 10th. > > Airflow > > May (or rather the very end of April) saw another eagerly anticipated minor > release in the project, Airflow 2.6 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=54194b80b8&e=ce16eef4ef>. > This release includes over 30 other new features, over 50 improvements, and > over 25 bug fixes. Important features and improvements to be aware of include: > > Additional notification support with notifiers > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9d75f42f91&e=ce16eef4ef>, > an easy and extensible way to add notifications to your DAGs using > on_*_callback. The SlackNotifer,which comes included in the Slack provider > package, will be particularly relevant to many Airflow users. > > Awesome improvements to the Grid View, which now includes a built-in Graph > View that is filterable, and includes a minimap for easier navigation of > complex DAGs. > > No more tasks stuck in queued, due a consolidation in the logic that handles > when to fail or retry tasks when they get stuck. > > Trigger logs now available in the webserver integrated with your task logs, > for easier debugging of deferrable operators. > > A new continuous timetable > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e57d6e63e0&e=ce16eef4ef> > that ensures you always have a single DAG run running. > > For more details, check out the full release notes > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=71aa3a061b&e=ce16eef4ef>. > > Airflow 2.6.1 > PyPI > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=03d6d0f876&e=ce16eef4ef> > | Release Notes > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=305a7a7ce8&e=ce16eef4ef> > | Docs > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a5d689fda9&e=ce16eef4ef> > | Sources > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0e203a669b&e=ce16eef4ef> > | Docker > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=39033e53d2&e=ce16eef4ef> > > Airflow 2.6.0 > PyPI > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2a77953c2e&e=ce16eef4ef> > | Release Notes > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=db9a3d521d&e=ce16eef4ef> > | Docs > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7f19b6f8a7&e=ce16eef4ef> > | Sources > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3ff3816fef&e=ce16eef4ef> > | Docker > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eb4799c360&e=ce16eef4ef> > Ecosystem > > In the ecosystem, Astronomer published a Providers release and an MLFlow > Provider, and OpenLineage released three versions of its Airflow integration: > > Astronomer Providers 1.16.0 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=25c6738817&e=ce16eef4ef> > MLFlow Provider 1.1.0 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=38c7bbb6a4&e=ce16eef4ef> > OpenLineage Airflow Integration 0.26.0 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=efd3465e85&e=ce16eef4ef> > > OpenLineage Airflow Integration 0.25.0 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=861ed50627&e=ce16eef4ef> > OpenLineage Airflow Integration 0.24.0 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a709c61451&e=ce16eef4ef> > Providers > > Providers are now limited to Airflow 2.4+ only. For the source release, PyPI > packages and docs, see: > > Sources > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7bf3aebf2e&e=ce16eef4ef> > | PyPI > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0727ff535e&e=ce16eef4ef> > | Docs > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=852b3b708e&e=ce16eef4ef> > > June 1: PyData DC > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f1d608b695&e=ce16eef4ef>, > Virtual Meetup > > June 6: Airflow 101 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5b079b1710&e=ce16eef4ef>, > Webinar > > June 8: Charlotte Airflow Meetup > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2e35cdbbbe&e=ce16eef4ef>, > In-person Meetup > > June 20: How to use Snowpark with Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1d49d4e818&e=ce16eef4ef>, > Webinar > > June 21: NYC Airflow Meetup > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a1943c88cc&e=ce16eef4ef>, > In-person Meetup > > June 26-29: Snowflake Summit 2023 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c5c38c393a&e=ce16eef4ef>, > Las Vegas In-person Conference > > June 27: OpenLineage Meetup @ Astronomer > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=00d15a53bd&e=ce16eef4ef>, > In-person Meetup > > September 19-21: Airflow Summit > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bbf1805560&e=ce16eef4ef>, > Toronto In-person Conference > > > May 31: DataGalaxy Tech Summit > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e08429c5cd&e=ce16eef4ef>, > Virtual Conference > > May 25: Airflow Meetup @ XPertise > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ef2b7058d0&e=ce16eef4ef>, > London Event > > May 10: CTO Connect > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=93ee95cb5b&e=ce16eef4ef>, > NYC Conference > > May 9: What’s New in Airflow Airflow 2.6 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ce77f500ad&e=ce16eef4ef>, > Webinar > > May 9: Meetup Airflow Paris @ Algolia > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=23448d0265&e=ce16eef4ef>, > Paris Event > > May 2: Simplified DAG Authoring with the Astro SKD > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cc78c1e746&e=ce16eef4ef>, > Webinar > > > @potiuk > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cf0c2a96af&e=ce16eef4ef> > #27264 | Add Python 3.11 support > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=63549bbe9d&e=ce16eef4ef> > > > Python 3.11 was released as scheduled on October 25, 2022 and this is the > first attempt to see how far Airflow (mostly dependencies) are from being > ready to officially support 3.11. > > To nominate a PR, add a comment with #protm in the body or wait for the vote > on the dev list. > > Apache Kafka ❤️ Apache Airflow: A no-install click-and-play demo of the Kafka > Airflow provider > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=19a789b3fd&e=ce16eef4ef> > by Tamara Janina Fingerlin on Medium > Amazon DynamoDB Value Sensor for Apache Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=8a87bb14c4&e=ce16eef4ef> > by Mark Richman on Medium > Avoiding the pitfalls of top-level DAG code > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=72ca538b34&e=ce16eef4ef> > by Kenten Danas on Medium > > Votes: > > May 2023 PR of the Month > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9b95d7cda8&e=ce16eef4ef> > Airflow Providers prepared on May 24, 2023 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3baae4a23a&e=ce16eef4ef> > extended) on AIP-50 (part 2) to finalize it > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ee87267931&e=ce16eef4ef> > Airflow Providers prepared on May 19, 2023 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=47ea8d4322&e=ce16eef4ef> > Release Airflow Python Client 2.6.1 from 2.6.1rc1 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4c698b473d&e=ce16eef4ef> > Airflow Providers prepared on May 16, 2023 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=863e174b9f&e=ce16eef4ef> > Release Airflow 2.6.1 from 2.6.1rc3 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=01d0643fba&e=ce16eef4ef> > Release Airflow 2.6.1 from 2.6.1rc2 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=76e5e70516&e=ce16eef4ef> > Release Airflow 2.6.1 from 2.6.1rc1 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6d25e88101&e=ce16eef4ef> > Release Airflow Python Client 2.6.0 from 2.6.0rc3 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ae400072ce&e=ce16eef4ef> > Release Airflow Python Client 2.6.0 from 2.6.0rc2 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7011e1bb8a&e=ce16eef4ef> > Discussed: > > Re: API-56 Extensible user management > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=05000dc6da&e=ce16eef4ef> > Huge dependency bump in main (thanks to Google efforts) > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=32f13d7b71&e=ce16eef4ef> > Preparing for dropping Python 3.7 support > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dceea7bcd8&e=ce16eef4ef> > Lazy Consensus: > > Add Apprise Provider > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=058d4ac52f&e=ce16eef4ef> > Bring back min-airflow-version-support for preinstalled providers (Bazel) > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=16a3cf6516&e=ce16eef4ef> > Improved security process for Apache Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=55e85e6e84&e=ce16eef4ef> > CVEs: > CVE-2023-33234: Apache Airflow CNCF Kubernetes Provider: > KubernetesPodOperator RCE via connection configuration > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=baf71897bd&e=ce16eef4ef> > CVE-2023-25754: Apache Airflow: Privilege escalation using airflow logs > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5b85f997f9&e=ce16eef4ef> > CVE-2023-29247: Stored XSS on Apache Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dc07ea9267&e=ce16eef4ef> > Announced: > Python 3.7 removed from main branch of Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f80abf6ab7&e=ce16eef4ef> > Python 3.11 support merged for Apache Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2348390083&e=ce16eef4ef> > Airflow Providers prepared on May 19, 2023 are released > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1300d0ff64&e=ce16eef4ef> > Change in self-hosted vs. public runners for CI jobs > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c0b347e108&e=ce16eef4ef> > Apache Airflow 2.6.1 Released > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=891fff4380&e=ce16eef4ef> > Support for 3.11 is round the corner (Papermill, Cloudera holding us back). > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=39e34710e8&e=ce16eef4ef> > Call for Presentations, Community Over Code 2023 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f95dc0150f&e=ce16eef4ef> > Proposed: > > Solidifying and improving security handling process for Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=473d318512&e=ce16eef4ef> > > AIP-52: Automatic setup and teardown of tasks > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=54510b887f&e=ce16eef4ef> > AIP-53: OpenLineage in Airflow > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=35b2ea5f95&e=ce16eef4ef> > See the Wiki > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0bc1fad943&e=ce16eef4ef> > for more of the project’s approved AIPs. > > Please subscribe to this newsletter to ensure you always receive the latest > issue: http://eepurl.com/hXUA3r > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=23091a1fa9&e=ce16eef4ef>. > > Know of an upcoming event or publication the community should know about? Let > us know at vi...@astronomer.io <mailto:vi...@astronomer.io> or > michael.robin...@astronomer.io <mailto:michael.robin...@astronomer.io>. > > Want to change how you receive these emails? > You can update your preferences > <https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=79afc42573> > or unsubscribe from this list > <https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=79afc42573>. >
