I love how the newsletter changes and evolves every month :). Great job! On Fri, Jul 1, 2022 at 5:59 PM Michael Robinson <michael.robin...@astronomer.io.invalid> wrote:
> Hi everyone, here’s the latest issue of the Airflow Newsletter! Please > subscribe using this link: http://eepurl.com/hXUA3r > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c7e2d07421&e=ce16eef4ef> > . > > -Michael > > View this email in your browser > <https://mailchi.mp/e9626a0b81b2/airflow-newsletter-june-2022?e=ce16eef4ef> > > June was another productive month in the Airflow community! We released > Airflow 2.3.2, featuring a faster grid view and many bug fixes, and we > conducted our annual user survey. Over on the dev list, we voted on > data-driven scheduling, OpenTelemetry support, and a providers packages > release. > > Also this month we're excited to introduce a new feature in the newsletter > -- the *Dev List Digest*! There you'll get a high-level view of what we > voted on and discussed this month on the list. > > The results of this year’s Airflow user survey are in! Thanks to all the > respondents. Your participation helps set the course for the project. This > year, the survey contained 36 questions in 5 categories, and we received > just over 200 responses. For the results and in-depth analysis, read this > blog post > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b60a2e1d7d&e=ce16eef4ef> > by > John Thomas and Ewa Tatarczak on the Airflow website. > > *We released Apache Airflow 2.3.2!* > > *[image: :package:] *PyPI: https://pypi.org/project/apache-airflow/2.3.2/ > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=dab54da7da&e=ce16eef4ef> > > *[image: :books:] *Docs: > https://airflow.apache.org/docs/apache-airflow/2.3.2/ > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d09ec8a851&e=ce16eef4ef> > > *[image: :hammer_and_wrench:] *Release Notes: > https://airflow.apache.org/docs/apache-airflow/2.3.2/release_notes.html > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4a513d0338&e=ce16eef4ef> > > *[image: :ship:] *Docker Image: “docker pull apache/airflow:2.3.2” > > *[image: :busstop:] *Constraints: > https://github.com/apache/airflow/tree/constraints-2.3.2 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7a312882ef&e=ce16eef4ef> > > ------------------------------ > > *We released Apache Airflow Providers packages!* > > *Google:* > > *[image: :package:] *PyPI: > https://pypi.org/project/apache-airflow-providers-google/ > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e17fe4530c&e=ce16eef4ef> > > *[image: :books:]* Docs: > https://airflow.apache.org/docs/apache-airflow-providers-google/8.1.0/ > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=850f4d9b83&e=ce16eef4ef> > > *[image: :hammer_and_wrench:]* Changelog: > https://airflow.apache.org/docs/apache-airflow-providers-google/8.1.0/#changelog > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=222c6f0fd5&e=ce16eef4ef> > > *Oracle:* > > *[image: :package:]* PyPI: > https://pypi.org/project/apache-airflow-providers-oracle/ > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b4733a37de&e=ce16eef4ef> > > *[image: :books:]* Docs: > https://airflow.apache.org/docs/apache-airflow-providers-oracle/3.1.0/ > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bec5199eca&e=ce16eef4ef> > > *[image: :hammer_and_wrench:]* Changelog: > https://airflow.apache.org/docs/apache-airflow-providers-oracle/stable/index.html#changelog > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7e36cd9c25&e=ce16eef4ef> > > If you missed any of these, you can catch a recap, watch on-demand, or dig > into the slides: > > - > > “Data Pipeline Tutorial: Automatically Summarize Podcasts with Airflow” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=61f1b8becd&e=ce16eef4ef>webinar > by Vik Paruchuri from Dataquest, Jun 1 > - > > “Airflow 101” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f2593934ab&e=ce16eef4ef> > webinar by Marc Lamberti, June 2 (all funds raised donated to Code to > Inspire > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=634408653f&e=ce16eef4ef> > ) > - > > “ML in Production with Airflow” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=260fbc8ca6&e=ce16eef4ef> > webinar by Kenten Danas and Santona Tuli from Astronomer, June 14 > - > > “Airflow + Selenium: The Perfect Toolkit for Web-scraping” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7f752ac3da&e=ce16eef4ef> > meetup with Alvaro Avila from Moonshot Partners, June 15th > - > > “Apache Airflow Technical Essentials > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b2a9207859&e=ce16eef4ef>” > online course by Lee Gaines from O’Reilly, June 21 > - > > “The Python Task Decorator” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=059155c03e&e=ce16eef4ef> > webinar by Kenten Danas and Viraj Parekh from Astronomer, June 21 > - > > “Writing Functional DAGs with Decorators” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d3503207ca&e=ce16eef4ef> > webinar by Kenten Danas from Astronomer, June 28 > - “Data + AI Summit” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fe2cb19b4e&e=ce16eef4ef> > conference by Databricks, June 27-30 > > We can always use speakers for meetups. If you want to present your > Airflow contribution, demo your project, or share your experience at a > Community Meetup this year, let us know by filling out this form > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=20b13666ad&e=ce16eef4ef>. > You could win some excellent swag! > > - > > July 7: Airflow Day 2022 on Google Open Source Live: > https://www.meetup.com/google-open-source/events/285970398/ > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=91e543b102&e=ce16eef4ef> > - > > July 12: “Anatomy of an Operator” webinar: > https://www.astronomer.io/events/webinars/anatomy-of-an-operator > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4499662e1f&e=ce16eef4ef> > > > - > > July 15: “Data Engineering: Bulk Up Your Data Eng Skills using > Airflow, Spark & DASK”: https://www.meetup.com/at-wix/events/286306470/ > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0d9c1388b9&e=ce16eef4ef> > > *Add Task Logs to Grid Details Panel* (#24249 > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cd811eb98e&e=ce16eef4ef> > ) > > Author: *Pierre Jeambrun* (pierrejeambraun > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=fcde6c520f&e=ce16eef4ef> > ) > > This PR added task logs to the details panel to reduce the number of steps > required to find out what's happening in an instance. > > Before this addition, users who spotted a failing task instance in the > tree/grid view had to navigate to a separate page to figure out what went > wrong. > *Bowrna Prabhakaran* (bowrna > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4feb53241f&e=ce16eef4ef> > ) > > *Where are you based?* I am based out of Tamil Nadu, India. > > *What is your current role?* I am currently not working. Previously I was > working as a Backend Engineer in vue.ai > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b743eff2a0&e=ce16eef4ef>. > After my maternity break, I had to leave my job due to burnout. > > *Why did you start contributing to the project?* After leaving my job, I > got an opportunity to intern with Outreachy for Airflow. I worked on a > "Rewriting Breeze from Bash to Python" project and I had an amazing > experience. That way I keep contributing to Airflow and learning a lot. > > *What do you use it for?* I haven't used Airflow in production in any of > my previous jobs. I wrote my first DAG as an example DAG for MSSQL. I am > learning more about Airflow by contributing to it and how others in the > community use Airflow. > > *When was your first PR and what was it?* My first PR was in the old > breeze to auto-reload the zshrc file to enable autocomplete of breeze > commands. It happened in Oct 2021. > > *What was your latest?* My latest PR includes making tests run parallel > in the breeze (with a lot of help from Jarek Potiuk), clear specific DAG > run task instance API, and moving a few of Airflow CLI commands to use > Python rich. > *What do you like about working on OSS projects?* I really love the > vibrant community and how people from diverse locations converse and make > the project better together. I am happy to be part of the Airflow community. > > - “Using Airflow Decorators to Author DAGs,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=3eafba2694&e=ce16eef4ef> > by Giorgos Myrianthous, Towards Data Science Blog > - > > “The State of Data Engineering 2022,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f586364de3&e=ce16eef4ef> > by Einat Orr, LakeFS Blog > - > > “Introducing New Astro CLI Commands to Make DAG Testing Easier,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1019f802b8&e=ce16eef4ef> > by David Koenitzer, Astronomer Blog > - “Apache Airflow Summit 2022 – Trends and Topics,” > > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=19823e93a9&e=ce16eef4ef> > by Markus, NextLytics Blog > > > - > > *Votes: * > - > > Airflow Providers packages releases (approved) > - AIP-48 Data Driven Scheduling (approved) > - > > Airflow 2.3.2 release (approved) > - > > AIP-49 OpenTelemetry Support (approved) > - > > Provider’s mixed governance model (in-process) > - > > Remove “Label when reviewed” workflow (approved) > - > > *Discuss:* > - > > Templated fields and dynamic task mapping > - > > User survey planning > - Proposed: Use "server" time from default.cfg for template engine > variables > - > > Hiding/archiving the JIRA project for Airflow > - > > Airflow scheduling delay metric definition > > We're moving the newsletter to a new platform, Mailchimp. Please subscribe > to ensure you always receive the latest issue: http://eepurl.com/hXUA3r > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c7e2d07421&e=ce16eef4ef> > . > That’s all, Air-folks. See you in July! 👋 > [image: https://twitter.com/ApacheAirflow] > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=98065a1eb2&e=ce16eef4ef> > [image: Website] > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6509912e34&e=ce16eef4ef> > [image: GitHub] > <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6f701b9196&e=ce16eef4ef> > Want to change how you receive these emails? > You can update your preferences > <https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=2809f8cd3a> > or unsubscribe from this list > <https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=2809f8cd3a> > . > > > > > > This email was sent to michael.robin...@astronomer.io > *why did I get this?* > <https://apache.us14.list-manage.com/about?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=2809f8cd3a> > unsubscribe from this list > <https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=2809f8cd3a> > update subscription preferences > <https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=2809f8cd3a> > > Apache Airflow · 1000 N West Street · Suite 1200 · Wilmington, DE 19801 · > USA > > [image: Email Marketing Powered by Mailchimp] > <http://www.mailchimp.com/email-referral/?utm_source=freemium_newsletter&utm_medium=email&utm_campaign=referral_marketing&aid=fe7ef7a8dbb32933f30a10466&afl=1> > > >