Re: [VOTE] Release Airflow 2.7.2 from 2.7.2rc1

2023-10-11 Thread Phani Kumar
+1 non-binding

On Thu, Oct 12, 2023 at 7:49 AM Rahul Vats  wrote:

> +1 (non-binding)
>
> Regards,
> Rahul Vats
> 9953794332
>
>
> On Thu, 12 Oct 2023 at 05:14, Jed Cunningham 
> wrote:
>
> > +1 (binding)
> >
> > Checked signatures, checksums, licences, compared sources. Used it with
> the
> > helm chart with a few different configs
> >
>


Re: [VOTE] Release Airflow 2.7.2 from 2.7.2rc1

2023-10-11 Thread Rahul Vats
+1 (non-binding)

Regards,
Rahul Vats
9953794332


On Thu, 12 Oct 2023 at 05:14, Jed Cunningham 
wrote:

> +1 (binding)
>
> Checked signatures, checksums, licences, compared sources. Used it with the
> helm chart with a few different configs
>


Re: [VOTE] Release Airflow 2.7.2 from 2.7.2rc1

2023-10-11 Thread Jed Cunningham
+1 (binding)

Checked signatures, checksums, licences, compared sources. Used it with the
helm chart with a few different configs


Re: [VOTE] Release Airflow 2.7.2 from 2.7.2rc1

2023-10-11 Thread Hussein Awala
+1 (binding) I checked the signatures, the checksums, the licences and the
source code and I checked my changes, they all look good.

On Mon, Oct 9, 2023 at 10:56 AM Ephraim Anierobi 
wrote:

> Hey fellow Airflowers,
>
> I have cut Airflow 2.7.2rc1. This email is calling a vote on the release,
> which will last at least 72 hours, from Monday, October 9, 2023 at 8:55 am
> UTC
> until Thursday, October 12, 2023, at 8:55 am UTC
> <
> https://www.timeanddate.com/worldclock/fixedtime.html?msg=8=20231012T0855=1440
> >,
> and until 3 binding +1 votes have been received.
>
> The status of testing of the release is kept at
> https://github.com/apache/airflow/issues/34830
>
> Consider this my (binding) +1.
>
> Airflow 2.7.2rc1 is available at:
> https://dist.apache.org/repos/dist/dev/airflow/2.7.2rc1/
>
> *apache-airflow-2.7.2-source.tar.gz* is a source release that comes with
> INSTALL instructions.
> *apache-airflow-2.7.2.tar.gz* is the binary Python "sdist" release.
> *apache_airflow-2.7.2-py3-none-any.whl* is the binary Python wheel "binary"
> release.
>
> Public keys are available at:
> https://dist.apache.org/repos/dist/release/airflow/KEYS
>
> Please vote accordingly:
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Only votes from PMC members are binding, but all members of the community
> are encouraged to test the release and vote with "(non-binding)".
>
> The test procedure for PMC members is described in:
>
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-pmc-members
>
> The test procedure for Contributors who would like to test this RC is
> described in:
>
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md\#verify-the-release-candidate-by-contributors
>
>
> Please note that the version number excludes the `rcX` string, so it's now
> simply 2.7.2. This will allow us to rename the artifact without modifying
> the artifact checksums when we actually release.
>
> Release Notes:
> https://github.com/apache/airflow/blob/2.7.2rc1/RELEASE_NOTES.rst
>
> Changes since 2.7.1:
>
> *Bug Fixes*
> - Check if the lower of provided values are sensitives in config
> endpoint (#34712)
> - Add support for ZoneInfo and generic UTC to fix datetime
> serialization (#34683, #34804)
> - Fix AttributeError: 'Select' object has no attribute 'count' during
> the airflow db migrate command (#34348)
> - Make dry run optional for patch task instance  (#34568)
> - Fix non deterministic datetime deserialization (#34492)
> - Use iterative loop to look for mapped parent (#34622)
> - Fix is_parent_mapped value by checking if any of the parent
> ``taskgroup`` is mapped (#34587)
> - Avoid top-level airflow import to avoid circular dependency (#34586)
> - Add more exemptions to lengthy metric list (#34531)
> - Fix dag warning endpoint permissions (#34355)
> - Fix task instance access issue in the batch endpoint (#34315)
> - Correcting wrong time showing in grid view (#34179)
> - Fix www ``cluster_activity`` view not loading due to
> ``standaloneDagProcessor`` templating (#34274)
> - Set ``loglevel=DEBUG`` in 'Not syncing ``DAG-level`` permissions'
> (#34268)
> - Make param validation consistent for DAG validation and triggering
> (#34248)
> - Ensure details panel is shown when any tab is selected (#34136)
> - Fix issues related to ``access_control={}`` (#34114)
> - Fix not found ``ab_user`` table in the CLI session (#34120)
> - Fix FAB-related logging format interpolation (#34139)
> - Fix query bug in ``next_run_datasets_summary`` endpoint (#34143)
> - Fix for TaskGroup toggles for duplicated labels (#34072)
> - Fix the required permissions to clear a TI from the UI (#34123)
> - Reuse ``_run_task_session`` in mapped ``render_template_fields`` (#33309)
> - Fix scheduler logic to plan new dag runs by ignoring manual runs (#34027)
> - Add missing audit logs for Flask actions add, edit and delete (#34090)
> - Hide Irrelevant Dag Processor from Cluster Activity Page (#33611)
> - Remove infinite animation for pinwheel, spin for 1.5s (#34020)
> - Restore rendering of provider configuration with ``version_added``
> (#34011)
> *Doc Only Changes*
> - Clarify audit log permissions (#34815)
> - Add explanation for Audit log users (#34814)
> - Import ``AUTH_REMOTE_USER`` from FAB in WSGI middleware example (#34721)
> - Add information about drop support MsSQL as DB Backend in the future
> (#34375)
> - Document how to use the system's timezone database (#34667)
> - Clarify what landing time means in doc (#34608)
> - Fix screenshot in dynamic task mapping docs (#34566)
> - Fix class reference in Public Interface documentation (#34454)
> - Clarify var.value.get  and var.json.get usage (#34411)
> - Schedule default value description (#34291)
> - Docs for triggered_dataset_event (#34410)
> - Add DagRun events (#34328)
> - Provide tabular overview about trigger form param types (#34285)
> - Add link to Amazon Provider Configuration in Core 

Re: Apache Airflow Newsletter | September 2023

2023-10-11 Thread Briana Okyere
So this one came through okay?

On Wed, Oct 11, 2023 at 11:19 AM Kaxil Naik  wrote:

> Just checking the formatting of the newsletter
>
> On Wed, 11 Oct 2023 at 19:18, Kaxil Naik  wrote:
>
>> This month, we FINALLY hosted Airflow Summit 2023! Thank you to everyone
>> who made the trip, spoke, and contributed to the event’s success. Hats off
>> to another year!  This September in the Airflow Community we:
>>
>>-
>>
>>*Released *Airflow 2.7.1 
>>-
>>
>>*Welcomed *Pankaj Koti and Amogh Desai as committers
>>
>>
>>
>>-
>>
>>*Gathered 500+ data enthusiasts *at Airflow Summit 2023 in Toronto! Read
>>our takeaways here
>>
>>.
>>
>> As always, please reach out  with items for
>> the next issue.
>>
>> Thanks for reading!
>>
>> *Airflow 2.7.1*
>>
>> Airflow 2.7.1 was released on September 7th and includes some significant
>> changes, improvements, and several bug fixes.* Most notably:*
>>
>>-
>>
>>*CronTriggerTimetable is now less aggressive when trying to skip a
>>run
>>
>> *
>>-
>>
>>*conf.set() becomes case insensitive to match conf.get() behavior
>>
>> *
>>
>> *PyPI  | Release Notes
>>  | Docs
>>  | Sources
>> 
>>  | Docker
>>  | 
>> Constraints
>> *
>>
>>
>> *Providers*
>>
>> New versions of 54 Airflow Providers packages were released.
>>
>> For all source releases, PyPI packages and docs, see:
>>
>>-
>>
>>*Sources
>>
>> 
>>  | PyPI
>>
>> 
>>  | Docs
>>*
>>
>> *Ecosystem*
>>
>> Initial releases:
>>
>>-
>>
>>*Astronomer Providers 1.18.0
>>*
>>-
>>
>>*Astronomer Cosmos 1.1.3
>>*
>>
>>
>>
>>-
>>
>>*10/4 Meet-up: DC Airflow Happy Hour @City Tap
>> 
>> *(Washington,
>>DC, free)
>>-
>>
>>*10/5 Webinar: Power your LLMOps with Airflow’s Weaviate Provider
>>
>> 
>>  *(Virtual,
>>free)
>>-
>>
>>*10/25 Workshop: BUILD.local Workshop with Snowflake
>>
>> 
>>  *(SF,
>>free)
>>- *10/26 Webinar: The Laurel Algorithm: MLOps, AI, and Airflow for
>>Perfect Timekeeping
>>
>> 
>>  *(Virtual,
>>free)
>>
>>
>>-
>>
>>*9/6 Meetup: Low Key Data Happy Hour
>> 
>> *(Toronto,
>>free)
>>-
>>
>>*9/14 Webinar: Efficient data quality checks with Airflow 2.7
>>
>> 
>>  *(Virtual,
>>free)
>>-
>>
>>*9/19-21 Conference: Airflow Summit  
>> *(Toronto,
>>paid)
>>-
>>
>>*9/20 Meet-up: (After) Party Under the Stars
>> *(Toronto,
>>free)
>>-
>>
>>*9/26 Workshop: BUILD.local
>>
>> 
>>  *(NYC,
>>free)
>>- *9/28 Webinar: Develop ML Pipelines with the Astro Cloud IDE
>>
>> 
>>  *(Virtual,
>>free)
>>
>>
>>
>> @ vincbeck 
>> #28900 | Convert DagFileProcessor.execute_callbacks to Internal API
>> 
>> This required a VERY heavy lift on @vincbeck’s part to update the dag
>> 

Re: Apache Airflow Newsletter | September 2023

2023-10-11 Thread Kaxil Naik
This month, we FINALLY hosted Airflow Summit 2023! Thank you to everyone
who made the trip, spoke, and contributed to the event’s success. Hats off
to another year!  This September in the Airflow Community we:

   -

   *Released *Airflow 2.7.1 
   -

   *Welcomed *Pankaj Koti and Amogh Desai as committers
   


   -

   *Gathered 500+ data enthusiasts *at Airflow Summit 2023 in Toronto! Read
   our takeaways here
   
   .

As always, please reach out  with items for
the next issue.

Thanks for reading!

*Airflow 2.7.1*

Airflow 2.7.1 was released on September 7th and includes some significant
changes, improvements, and several bug fixes.* Most notably:*

   -

   *CronTriggerTimetable is now less aggressive when trying to skip a run
   
*
   -

   *conf.set() becomes case insensitive to match conf.get() behavior
   
*

*PyPI  | Release Notes
 | Docs
 | Sources

| Docker
 | Constraints
*


*Providers*

New versions of 54 Airflow Providers packages were released.

For all source releases, PyPI packages and docs, see:

   -

   *Sources
   

| PyPI
   

| Docs
   *

*Ecosystem*

Initial releases:

   -

   *Astronomer Providers 1.18.0
   *
   -

   *Astronomer Cosmos 1.1.3 *



   -

   *10/4 Meet-up: DC Airflow Happy Hour @City Tap
   
*(Washington,
   DC, free)
   -

   *10/5 Webinar: Power your LLMOps with Airflow’s Weaviate Provider
   

*(Virtual,
   free)
   -

   *10/25 Workshop: BUILD.local Workshop with Snowflake
   

*(SF,
   free)
   - *10/26 Webinar: The Laurel Algorithm: MLOps, AI, and Airflow for
   Perfect Timekeeping
   

*(Virtual,
   free)


   -

   *9/6 Meetup: Low Key Data Happy Hour
   
*(Toronto,
   free)
   -

   *9/14 Webinar: Efficient data quality checks with Airflow 2.7
   

*(Virtual,
   free)
   -

   *9/19-21 Conference: Airflow Summit  *(Toronto,
   paid)
   -

   *9/20 Meet-up: (After) Party Under the Stars
    *(Toronto,
   free)
   -

   *9/26 Workshop: BUILD.local
   

*(NYC,
   free)
   - *9/28 Webinar: Develop ML Pipelines with the Astro Cloud IDE
   

*(Virtual,
   free)



@ vincbeck 
#28900 | Convert DagFileProcessor.execute_callbacks to Internal API

This required a VERY heavy lift on @vincbeck’s part to update the dag
processor to execute callbacks through either Airflow's internal API or the
metadata database.

To nominate a PR, add a comment with *#protm* in the body or wait for the
vote on the dev list.

   -

   *Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow,
   Part 1
   

*
   by* George Yates *on the Astronomer Blog
   -

   *Creating a DAG in Apache Airflow for Beginners: A Comprehensive Guide
   

Re: Apache Airflow Newsletter | September 2023

2023-10-11 Thread Kaxil Naik
Just checking the formatting of the newsletter

On Wed, 11 Oct 2023 at 19:18, Kaxil Naik  wrote:

> This month, we FINALLY hosted Airflow Summit 2023! Thank you to everyone
> who made the trip, spoke, and contributed to the event’s success. Hats off
> to another year!  This September in the Airflow Community we:
>
>-
>
>*Released *Airflow 2.7.1 
>-
>
>*Welcomed *Pankaj Koti and Amogh Desai as committers
>
>
>
>-
>
>*Gathered 500+ data enthusiasts *at Airflow Summit 2023 in Toronto! Read
>our takeaways here
>
>.
>
> As always, please reach out  with items for
> the next issue.
>
> Thanks for reading!
>
> *Airflow 2.7.1*
>
> Airflow 2.7.1 was released on September 7th and includes some significant
> changes, improvements, and several bug fixes.* Most notably:*
>
>-
>
>*CronTriggerTimetable is now less aggressive when trying to skip a run
>
> *
>-
>
>*conf.set() becomes case insensitive to match conf.get() behavior
>
> *
>
> *PyPI  | Release Notes
>  | Docs
>  | Sources
> 
>  | Docker
>  | 
> Constraints
> *
>
>
> *Providers*
>
> New versions of 54 Airflow Providers packages were released.
>
> For all source releases, PyPI packages and docs, see:
>
>-
>
>*Sources
>
> 
>  | PyPI
>
> 
>  | Docs
>*
>
> *Ecosystem*
>
> Initial releases:
>
>-
>
>*Astronomer Providers 1.18.0
>*
>-
>
>*Astronomer Cosmos 1.1.3 *
>
>
>
>-
>
>*10/4 Meet-up: DC Airflow Happy Hour @City Tap
> 
> *(Washington,
>DC, free)
>-
>
>*10/5 Webinar: Power your LLMOps with Airflow’s Weaviate Provider
>
> 
>  *(Virtual,
>free)
>-
>
>*10/25 Workshop: BUILD.local Workshop with Snowflake
>
> 
>  *(SF,
>free)
>- *10/26 Webinar: The Laurel Algorithm: MLOps, AI, and Airflow for
>Perfect Timekeeping
>
> 
>  *(Virtual,
>free)
>
>
>-
>
>*9/6 Meetup: Low Key Data Happy Hour
> 
> *(Toronto,
>free)
>-
>
>*9/14 Webinar: Efficient data quality checks with Airflow 2.7
>
> 
>  *(Virtual,
>free)
>-
>
>*9/19-21 Conference: Airflow Summit  *(Toronto,
>paid)
>-
>
>*9/20 Meet-up: (After) Party Under the Stars
> *(Toronto,
>free)
>-
>
>*9/26 Workshop: BUILD.local
>
> 
>  *(NYC,
>free)
>- *9/28 Webinar: Develop ML Pipelines with the Astro Cloud IDE
>
> 
>  *(Virtual,
>free)
>
>
>
> @ vincbeck 
> #28900 | Convert DagFileProcessor.execute_callbacks to Internal API
> 
> This required a VERY heavy lift on @vincbeck’s part to update the dag
> processor to execute callbacks through either Airflow's internal API or the
> metadata database.
>
> To nominate a PR, add a comment with *#protm* in the body or wait for the
> vote on the dev list.
>
>-
>
>*Comparing Data Orchestration: Databricks