Tested the RC1 against the Amazon system tests and the results can be viewed here: https://aws-mwaa.github.io/open-source/system-tests/version/ddcd30e7c7f5daeab5f74fb3224a4d5e33cec95d_8.4.0rc1.html
I would still like to do some more testing around executors. P.S. I think the Celery issue Vikram is mentioning is this one: https://github.com/apache/airflow/issues/32973 ________________________________ From: Elad Kalif <[email protected]> Sent: Monday, July 31, 2023 11:21:04 PM To: [email protected] Subject: RE: [EXTERNAL] [VOTE] Airflow Providers prepared on July 29, 2023 CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi Vikram good to hear from you. Can you be more specific? I didn't see any thread/report about Celery issue since RC1 was cut On Tue, Aug 1, 2023 at 8:43 AM Vikram Koka <[email protected]> wrote: > Not trying to hold up the release, but I thought there was a "race > condition" bug discovered with the Celery executor as a provider and > Airflow main. > Is that resolved now? > > Or, did I mistake the origin of that? > > On Mon, Jul 31, 2023 at 8:19 AM Beck, Vincent <[email protected] > > > wrote: > > > +1 (non-binding). I tested the Amazon provider package against my testing > > DAGs. > > > > On 2023-07-31, 11:03 AM, "Pankaj Singh" <[email protected] > > <mailto:[email protected]>> wrote: > > > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > > > > > > > > > > > +1 (non binding) > > > > > > On Mon, Jul 31, 2023 at 4:34 PM Ephraim Anierobi < > > [email protected] <mailto:[email protected]>> > > wrote: > > > > > > > +1 binding. Checked files, signatures & licenses > > > > > > On Mon, 31 Jul 2023 at 08:46, Amogh Desai <[email protected] > > <mailto:[email protected]>> > > > wrote: > > > > > > > +1 (non binding) > > > > Tested out cncf provider: > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1 > > < > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1 > > > > > > > with > > > > few examples DAGs. No regressions. > > > > > > > > Thanks & Regards, > > > > Amogh Desai > > > > > > > > On Sun, Jul 30, 2023 at 9:56 PM utkarsh sharma < > [email protected] > > <mailto:[email protected]>> > > > > wrote: > > > > > > > > > +1 non binding. Tested apprise provider > > > > > > https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/ > > <https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/> > > > > > > > > > > On Sun, 30 Jul 2023 at 9:42 PM, Phani Kumar > > > > > <[email protected] <mailto: > > [email protected]>lid> wrote: > > > > > > > > > > > +1 non binding > > > > > > > > > > > > On Sun, 30 Jul 2023, 20:54 Hussein Awala, <[email protected] > > <mailto:[email protected]>> wrote: > > > > > > > > > > > > > +1 (binding) I tested my change and I checked the signatures, > the > > > > > > checksums > > > > > > > and the source code. > > > > > > > > > > > > > > On Sun, Jul 30, 2023 at 4:18 PM rahul Vats < > > [email protected] <mailto:[email protected]> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > I have tested our example DAGS with the below providers and > > they > > > > are > > > > > > > > working perfectly fine! > > > > > > > > > > > > > > > > 1. apache-airflow-providers-amazon==8.4.0rc1 > > > > > > > > 2. apache-airflow-providers-apache-hive==6.1.3rc1 > > > > > > > > 3. apache-airflow-providers-cncf-kubernetes==7.4.0rc1 > > > > > > > > 4. apache-airflow-providers-databricks==4.3.2rc1 > > > > > > > > 5. apache-airflow-providers-google==10.5.0rc1 > > > > > > > > 6. apache-airflow-providers-microsoft-azure==6.2.2rc1 > > > > > > > > 7. apache-airflow-providers-sftp==4.5.0rc1 > > > > > > > > 8. apache-airflow-providers-snowflake==4.4.0rc1 > > > > > > > > > > > > > > > > Also, followed https://github.com/apache/airflow/pull/32948 > > and <https://github.com/apache/airflow/pull/32948 and> > > > > > > tested > > > > > > > > Celery Executor with Breeze, this is very helpful Thank you. > > > > > > > > > > > > > > > > Regards, > > > > > > > > Rahul Vats > > > > > > > > 9953794332 > > > > > > > > > > > > > > > > > > > > > > > > On Sun, 30 Jul 2023 at 17:28, Jarek Potiuk <[email protected] > > <mailto:[email protected]>> > > > > wrote: > > > > > > > > > > > > > > > > > +1 (binding) - tested signatures, checksums, licences, > source > > > > code > > > > > > for > > > > > > > > > both sdist and wheel packages. Checked all my changes - > they > > > are > > > > > in. > > > > > > > > > > > > > > > > > > I also used Breeze capabilities to build the "main" airflow > > > > > > (upcoming > > > > > > > > > 2.7.0) and ran it alongside new providers (with Celery > > > Executor) > > > > - > > > > > > > > > looks like the Celery Executor move works flawlessly. > > > > > > > > > > > > > > > > > > FYI: https://github.com/apache/airflow/pull/32948 < > > https://github.com/apache/airflow/pull/32948> adds some > > > > > examples > > > > > > > > > that anyone can follow to install and run the RC/main > version > > > of > > > > > > > > > Airflow with RC/main versions of providers and test airflow > > > > > manually > > > > > > - > > > > > > > > > it takes less then a minute if you follow simple > > instructions. > > > > > > > > > > > > > > > > > > On Sun, Jul 30, 2023 at 6:30 AM Wei Lee < > [email protected] > > <mailto:[email protected]>> > > > > > wrote: > > > > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > > > We have tested the following providers with our example > > DAGS > > > > > > without > > > > > > > > > encountering an issue. > > > > > > > > > > > > > > > > > > > > apache-airflow-providers-amazon > > > > > > > > > > apache-airflow-providers-apache-hive > > > > > > > > > > apache-airflow-providers-cncf-kubernetes > > > > > > > > > > apache-airflow-providers-databricks > > > > > > > > > > apache-airflow-providers-google > > > > > > > > > > apache-airflow-providers-snowflake > > > > > > > > > > apache-airflow-providers-sftp > > > > > > > > > > apache-airflow-providers-microsoft-azure > > > > > > > > > > > > > > > > > > > > Best, > > > > > > > > > > Wei > > > > > > > > > > > > > > > > > > > > > On Jul 30, 2023, at 1:16 AM, Pankaj Koti < > > > > > > > [email protected] <mailto:[email protected]> > > > > > > > > .INVALID> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > > > > > Tested the below RCs on our example DAGs and there is > no > > > > > > > regression. > > > > > > > > > > > 1. apache-airflow-providers-amazon==8.4.0rc1 > > > > > > > > > > > 2. apache-airflow-providers-apache-hive==6.1.3rc1 > > > > > > > > > > > 3. apache-airflow-providers-cncf-kubernetes==7.4.0rc1 > > > > > > > > > > > 4. apache-airflow-providers-databricks==4.3.2rc1 > > > > > > > > > > > 5. apache-airflow-providers-google==10.5.0rc1 > > > > > > > > > > > 6. apache-airflow-providers-microsoft-azure==6.2.2rc1 > > > > > > > > > > > 7. apache-airflow-providers-sftp==4.5.0rc1 > > > > > > > > > > > 8. apache-airflow-providers-snowflake==4.4.0rc1 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Pankaj Koti > > > > > > > > > > > > > > > > > > > > > > *Senior Software Engineer, *OSS Engineering Team. > > > > > > > > > > > Location: Pune, India > > > > > > > > > > > > > > > > > > > > > > Timezone: Indian Standard Time (IST) > > > > > > > > > > > > > > > > > > > > > > Email: [email protected] <mailto: > > [email protected]> > > > > > > > > > > > > > > > > > > > > > > Mobile: +91 9730079985 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sat, Jul 29, 2023 at 6:27 PM Elad Kalif < > > > > [email protected] <mailto:[email protected]> > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > >> Hey all, > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> I have just cut the new wave Airflow Providers > packages. > > > > This > > > > > > > email > > > > > > > > is > > > > > > > > > > >> calling a vote on the release, > > > > > > > > > > >> > > > > > > > > > > >> which will last for 72 hours - which means that it > will > > > end > > > > on > > > > > > > > August > > > > > > > > > 01, > > > > > > > > > > >> 2023 12:55 PM UTC and until 3 binding +1 votes have > been > > > > > > received. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Consider this my (binding) +1. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Airflow Providers are available at: > > > > > > > > > > >> > > > > > > > > > > >> > > https://dist.apache.org/repos/dist/dev/airflow/providers/ < > > https://dist.apache.org/repos/dist/dev/airflow/providers/> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> *apache-airflow-providers-<PROVIDER>-*.tar.gz* are the > > > > binary > > > > > > > > > > >> > > > > > > > > > > >> Python "sdist" release - they are also official > > "sources" > > > > for > > > > > > the > > > > > > > > > provider > > > > > > > > > > >> packages. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> *apache_airflow_providers_<PROVIDER>-*.whl are the > > binary > > > > > > > > > > >> > > > > > > > > > > >> Python "wheel" release. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> The test procedure for PMC members who would like to > > test > > > > the > > > > > RC > > > > > > > > > candidates > > > > > > > > > > >> are described in > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > < > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > >\#verify-the-release-by-pmc-members > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> and for Contributors: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > < > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > >\#verify-by-contributors > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Public keys are available at: > > > > > > > > > > >> > > > > > > > > > > >> > https://dist.apache.org/repos/dist/release/airflow/KEYS > > <https://dist.apache.org/repos/dist/release/airflow/KEYS> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Please vote accordingly: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> [ ] +1 approve > > > > > > > > > > >> > > > > > > > > > > >> [ ] +0 no opinion > > > > > > > > > > >> > > > > > > > > > > >> [ ] -1 disapprove with the reason > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Only votes from PMC members are binding, but members > of > > > the > > > > > > > > community > > > > > > > > > are > > > > > > > > > > >> > > > > > > > > > > >> encouraged to test the release and vote with > > > > "(non-binding)". > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Please note that the version number excludes the 'rcX' > > > > string. > > > > > > > > > > >> > > > > > > > > > > >> This will allow us to rename the artifact without > > > modifying > > > > > > > > > > >> > > > > > > > > > > >> the artifact checksums when we actually release. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> The status of testing the providers by the community > is > > > kept > > > > > > here: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> https://github.com/apache/airflow/issues/32936 < > > https://github.com/apache/airflow/issues/32936> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> You can find packages as well as detailed changelog > > > > following > > > > > > the > > > > > > > > > below > > > > > > > > > > >> links: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-amazon/8.4.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-amazon/8.4.0rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-beam/5.2.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-apache-beam/5.2.0rc1/ > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-drill/2.4.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-drill/2.4.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-druid/3.4.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-druid/3.4.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-hive/6.1.3rc1/ > > <https://pypi.org/project/apache-airflow-providers-apache-hive/6.1.3rc1/ > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-pinot/4.1.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-pinot/4.1.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-spark/4.1.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-spark/4.1.2rc1/> > > > > > > > > > > >> > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/ < > > https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-celery/3.3.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-celery/3.3.0rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1/ > > < > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1/ > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-common-sql/1.6.1rc1/ > < > > https://pypi.org/project/apache-airflow-providers-common-sql/1.6.1rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-daskexecutor/1.0.0rc1/ > > < > https://pypi.org/project/apache-airflow-providers-daskexecutor/1.0.0rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-databricks/4.3.2rc1/ > < > > https://pypi.org/project/apache-airflow-providers-databricks/4.3.2rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-exasol/4.2.2rc1/ < > > https://pypi.org/project/apache-airflow-providers-exasol/4.2.2rc1/> > > > > > > > > > > >> > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-google/10.5.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-google/10.5.0rc1/> > > > > > > > > > > >> > > > > > > https://pypi.org/project/apache-airflow-providers-jdbc/4.0.1rc1/ > < > > https://pypi.org/project/apache-airflow-providers-jdbc/4.0.1rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-microsoft-azure/6.2.2rc1/ > > < > > > https://pypi.org/project/apache-airflow-providers-microsoft-azure/6.2.2rc1/ > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.4.2rc1/ > > < > > > https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.4.2rc1/ > > > > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-mysql/5.2.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-mysql/5.2.0rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-neo4j/3.3.2rc1/ > > <https://pypi.org/project/apache-airflow-providers-neo4j/3.3.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-openlineage/1.0.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-openlineage/1.0.0rc1/ > > > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-oracle/3.7.2rc1/ < > > https://pypi.org/project/apache-airflow-providers-oracle/3.7.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-postgres/5.6.0rc1/ > < > > https://pypi.org/project/apache-airflow-providers-postgres/5.6.0rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-presto/5.1.2rc1/ < > > https://pypi.org/project/apache-airflow-providers-presto/5.1.2rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-redis/3.3.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-redis/3.3.0rc1/> > > > > > > > > > > >> > > > > > > https://pypi.org/project/apache-airflow-providers-sftp/4.5.0rc1/ > < > > https://pypi.org/project/apache-airflow-providers-sftp/4.5.0rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-slack/7.3.2rc1/ > > <https://pypi.org/project/apache-airflow-providers-slack/7.3.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-snowflake/4.4.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-snowflake/4.4.0rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-sqlite/3.4.3rc1/ < > > https://pypi.org/project/apache-airflow-providers-sqlite/3.4.3rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-trino/5.2.1rc1/ > > <https://pypi.org/project/apache-airflow-providers-trino/5.2.1rc1/> > > > > > > > > > > >> > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-vertica/3.5.1rc1/ < > > https://pypi.org/project/apache-airflow-providers-vertica/3.5.1rc1/> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Cheers, > > > > > > > > > > >> > > > > > > > > > > >> Elad Kalif > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > > > > > > > To unsubscribe, e-mail: > [email protected] > > <mailto:[email protected]> > > > > > > > > > > For additional commands, e-mail: > > [email protected] <mailto:[email protected]> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > > > > > > To unsubscribe, e-mail: [email protected] > > <mailto:[email protected]> > > > > > > > > > For additional commands, e-mail: > [email protected] > > <mailto:[email protected]> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [email protected] > > For additional commands, e-mail: [email protected] > > >
