Tested the RC1 against the Amazon system tests and the results can be viewed here: https://aws-mwaa.github.io/open-source/system-tests/version/ddcd30e7c7f5daeab5f74fb3224a4d5e33cec95d_8.4.0rc1.html
I would still like to do some more testing around executors. P.S. I think the Celery issue Vikram is mentioning is this one: https://github.com/apache/airflow/issues/32973 ________________________________ From: Elad Kalif <elad...@apache.org> Sent: Monday, July 31, 2023 11:21:04 PM To: dev@airflow.apache.org Subject: RE: [EXTERNAL] [VOTE] Airflow Providers prepared on July 29, 2023 CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi Vikram good to hear from you. Can you be more specific? I didn't see any thread/report about Celery issue since RC1 was cut On Tue, Aug 1, 2023 at 8:43 AM Vikram Koka <vik...@astronomer.io.invalid> wrote: > Not trying to hold up the release, but I thought there was a "race > condition" bug discovered with the Celery executor as a provider and > Airflow main. > Is that resolved now? > > Or, did I mistake the origin of that? > > On Mon, Jul 31, 2023 at 8:19 AM Beck, Vincent <vincb...@amazon.com.invalid > > > wrote: > > > +1 (non-binding). I tested the Amazon provider package against my testing > > DAGs. > > > > On 2023-07-31, 11:03 AM, "Pankaj Singh" <ags.pankaj1...@gmail.com > > <mailto:ags.pankaj1...@gmail.com>> wrote: > > > > > > CAUTION: This email originated from outside of the organization. Do not > > click links or open attachments unless you can confirm the sender and > know > > the content is safe. > > > > > > > > > > > > > > +1 (non binding) > > > > > > On Mon, Jul 31, 2023 at 4:34 PM Ephraim Anierobi < > > ephraimanier...@gmail.com <mailto:ephraimanier...@gmail.com>> > > wrote: > > > > > > > +1 binding. Checked files, signatures & licenses > > > > > > On Mon, 31 Jul 2023 at 08:46, Amogh Desai <amoghdesai....@gmail.com > > <mailto:amoghdesai....@gmail.com>> > > > wrote: > > > > > > > +1 (non binding) > > > > Tested out cncf provider: > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1 > > < > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1 > > > > > > > with > > > > few examples DAGs. No regressions. > > > > > > > > Thanks & Regards, > > > > Amogh Desai > > > > > > > > On Sun, Jul 30, 2023 at 9:56 PM utkarsh sharma < > utkarshar...@gmail.com > > <mailto:utkarshar...@gmail.com>> > > > > wrote: > > > > > > > > > +1 non binding. Tested apprise provider > > > > > > https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/ > > <https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/> > > > > > > > > > > On Sun, 30 Jul 2023 at 9:42 PM, Phani Kumar > > > > > <phani.ku...@astronomer.io.inva <mailto: > > phani.ku...@astronomer.io.inva>lid> wrote: > > > > > > > > > > > +1 non binding > > > > > > > > > > > > On Sun, 30 Jul 2023, 20:54 Hussein Awala, <huss...@awala.fr > > <mailto:huss...@awala.fr>> wrote: > > > > > > > > > > > > > +1 (binding) I tested my change and I checked the signatures, > the > > > > > > checksums > > > > > > > and the source code. > > > > > > > > > > > > > > On Sun, Jul 30, 2023 at 4:18 PM rahul Vats < > > rah.sharm...@gmail.com <mailto:rah.sharm...@gmail.com> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > I have tested our example DAGS with the below providers and > > they > > > > are > > > > > > > > working perfectly fine! > > > > > > > > > > > > > > > > 1. apache-airflow-providers-amazon==8.4.0rc1 > > > > > > > > 2. apache-airflow-providers-apache-hive==6.1.3rc1 > > > > > > > > 3. apache-airflow-providers-cncf-kubernetes==7.4.0rc1 > > > > > > > > 4. apache-airflow-providers-databricks==4.3.2rc1 > > > > > > > > 5. apache-airflow-providers-google==10.5.0rc1 > > > > > > > > 6. apache-airflow-providers-microsoft-azure==6.2.2rc1 > > > > > > > > 7. apache-airflow-providers-sftp==4.5.0rc1 > > > > > > > > 8. apache-airflow-providers-snowflake==4.4.0rc1 > > > > > > > > > > > > > > > > Also, followed https://github.com/apache/airflow/pull/32948 > > and <https://github.com/apache/airflow/pull/32948 and> > > > > > > tested > > > > > > > > Celery Executor with Breeze, this is very helpful Thank you. > > > > > > > > > > > > > > > > Regards, > > > > > > > > Rahul Vats > > > > > > > > 9953794332 > > > > > > > > > > > > > > > > > > > > > > > > On Sun, 30 Jul 2023 at 17:28, Jarek Potiuk <ja...@potiuk.com > > <mailto:ja...@potiuk.com>> > > > > wrote: > > > > > > > > > > > > > > > > > +1 (binding) - tested signatures, checksums, licences, > source > > > > code > > > > > > for > > > > > > > > > both sdist and wheel packages. Checked all my changes - > they > > > are > > > > > in. > > > > > > > > > > > > > > > > > > I also used Breeze capabilities to build the "main" airflow > > > > > > (upcoming > > > > > > > > > 2.7.0) and ran it alongside new providers (with Celery > > > Executor) > > > > - > > > > > > > > > looks like the Celery Executor move works flawlessly. > > > > > > > > > > > > > > > > > > FYI: https://github.com/apache/airflow/pull/32948 < > > https://github.com/apache/airflow/pull/32948> adds some > > > > > examples > > > > > > > > > that anyone can follow to install and run the RC/main > version > > > of > > > > > > > > > Airflow with RC/main versions of providers and test airflow > > > > > manually > > > > > > - > > > > > > > > > it takes less then a minute if you follow simple > > instructions. > > > > > > > > > > > > > > > > > > On Sun, Jul 30, 2023 at 6:30 AM Wei Lee < > weilee...@gmail.com > > <mailto:weilee...@gmail.com>> > > > > > wrote: > > > > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > > > We have tested the following providers with our example > > DAGS > > > > > > without > > > > > > > > > encountering an issue. > > > > > > > > > > > > > > > > > > > > apache-airflow-providers-amazon > > > > > > > > > > apache-airflow-providers-apache-hive > > > > > > > > > > apache-airflow-providers-cncf-kubernetes > > > > > > > > > > apache-airflow-providers-databricks > > > > > > > > > > apache-airflow-providers-google > > > > > > > > > > apache-airflow-providers-snowflake > > > > > > > > > > apache-airflow-providers-sftp > > > > > > > > > > apache-airflow-providers-microsoft-azure > > > > > > > > > > > > > > > > > > > > Best, > > > > > > > > > > Wei > > > > > > > > > > > > > > > > > > > > > On Jul 30, 2023, at 1:16 AM, Pankaj Koti < > > > > > > > pankaj.k...@astronomer.io <mailto:pankaj.k...@astronomer.io> > > > > > > > > .INVALID> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > > > > > Tested the below RCs on our example DAGs and there is > no > > > > > > > regression. > > > > > > > > > > > 1. apache-airflow-providers-amazon==8.4.0rc1 > > > > > > > > > > > 2. apache-airflow-providers-apache-hive==6.1.3rc1 > > > > > > > > > > > 3. apache-airflow-providers-cncf-kubernetes==7.4.0rc1 > > > > > > > > > > > 4. apache-airflow-providers-databricks==4.3.2rc1 > > > > > > > > > > > 5. apache-airflow-providers-google==10.5.0rc1 > > > > > > > > > > > 6. apache-airflow-providers-microsoft-azure==6.2.2rc1 > > > > > > > > > > > 7. apache-airflow-providers-sftp==4.5.0rc1 > > > > > > > > > > > 8. apache-airflow-providers-snowflake==4.4.0rc1 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Pankaj Koti > > > > > > > > > > > > > > > > > > > > > > *Senior Software Engineer, *OSS Engineering Team. > > > > > > > > > > > Location: Pune, India > > > > > > > > > > > > > > > > > > > > > > Timezone: Indian Standard Time (IST) > > > > > > > > > > > > > > > > > > > > > > Email: pankaj.k...@astronomer.io <mailto: > > pankaj.k...@astronomer.io> > > > > > > > > > > > > > > > > > > > > > > Mobile: +91 9730079985 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Sat, Jul 29, 2023 at 6:27 PM Elad Kalif < > > > > elad...@apache.org <mailto:elad...@apache.org> > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > >> Hey all, > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> I have just cut the new wave Airflow Providers > packages. > > > > This > > > > > > > email > > > > > > > > is > > > > > > > > > > >> calling a vote on the release, > > > > > > > > > > >> > > > > > > > > > > >> which will last for 72 hours - which means that it > will > > > end > > > > on > > > > > > > > August > > > > > > > > > 01, > > > > > > > > > > >> 2023 12:55 PM UTC and until 3 binding +1 votes have > been > > > > > > received. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Consider this my (binding) +1. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Airflow Providers are available at: > > > > > > > > > > >> > > > > > > > > > > >> > > https://dist.apache.org/repos/dist/dev/airflow/providers/ < > > https://dist.apache.org/repos/dist/dev/airflow/providers/> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> *apache-airflow-providers-<PROVIDER>-*.tar.gz* are the > > > > binary > > > > > > > > > > >> > > > > > > > > > > >> Python "sdist" release - they are also official > > "sources" > > > > for > > > > > > the > > > > > > > > > provider > > > > > > > > > > >> packages. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> *apache_airflow_providers_<PROVIDER>-*.whl are the > > binary > > > > > > > > > > >> > > > > > > > > > > >> Python "wheel" release. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> The test procedure for PMC members who would like to > > test > > > > the > > > > > RC > > > > > > > > > candidates > > > > > > > > > > >> are described in > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > < > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > >\#verify-the-release-by-pmc-members > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> and for Contributors: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > < > > > https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md > > >\#verify-by-contributors > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Public keys are available at: > > > > > > > > > > >> > > > > > > > > > > >> > https://dist.apache.org/repos/dist/release/airflow/KEYS > > <https://dist.apache.org/repos/dist/release/airflow/KEYS> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Please vote accordingly: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> [ ] +1 approve > > > > > > > > > > >> > > > > > > > > > > >> [ ] +0 no opinion > > > > > > > > > > >> > > > > > > > > > > >> [ ] -1 disapprove with the reason > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Only votes from PMC members are binding, but members > of > > > the > > > > > > > > community > > > > > > > > > are > > > > > > > > > > >> > > > > > > > > > > >> encouraged to test the release and vote with > > > > "(non-binding)". > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Please note that the version number excludes the 'rcX' > > > > string. > > > > > > > > > > >> > > > > > > > > > > >> This will allow us to rename the artifact without > > > modifying > > > > > > > > > > >> > > > > > > > > > > >> the artifact checksums when we actually release. > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> The status of testing the providers by the community > is > > > kept > > > > > > here: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> https://github.com/apache/airflow/issues/32936 < > > https://github.com/apache/airflow/issues/32936> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> You can find packages as well as detailed changelog > > > > following > > > > > > the > > > > > > > > > below > > > > > > > > > > >> links: > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-amazon/8.4.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-amazon/8.4.0rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-beam/5.2.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-apache-beam/5.2.0rc1/ > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-drill/2.4.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-drill/2.4.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-druid/3.4.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-druid/3.4.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-hive/6.1.3rc1/ > > <https://pypi.org/project/apache-airflow-providers-apache-hive/6.1.3rc1/ > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-pinot/4.1.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-pinot/4.1.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apache-spark/4.1.2rc1/ > > < > https://pypi.org/project/apache-airflow-providers-apache-spark/4.1.2rc1/> > > > > > > > > > > >> > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/ < > > https://pypi.org/project/apache-airflow-providers-apprise/1.0.1rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-celery/3.3.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-celery/3.3.0rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1/ > > < > > > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/7.4.0rc1/ > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-common-sql/1.6.1rc1/ > < > > https://pypi.org/project/apache-airflow-providers-common-sql/1.6.1rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-daskexecutor/1.0.0rc1/ > > < > https://pypi.org/project/apache-airflow-providers-daskexecutor/1.0.0rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-databricks/4.3.2rc1/ > < > > https://pypi.org/project/apache-airflow-providers-databricks/4.3.2rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-exasol/4.2.2rc1/ < > > https://pypi.org/project/apache-airflow-providers-exasol/4.2.2rc1/> > > > > > > > > > > >> > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-google/10.5.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-google/10.5.0rc1/> > > > > > > > > > > >> > > > > > > https://pypi.org/project/apache-airflow-providers-jdbc/4.0.1rc1/ > < > > https://pypi.org/project/apache-airflow-providers-jdbc/4.0.1rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-microsoft-azure/6.2.2rc1/ > > < > > > https://pypi.org/project/apache-airflow-providers-microsoft-azure/6.2.2rc1/ > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.4.2rc1/ > > < > > > https://pypi.org/project/apache-airflow-providers-microsoft-mssql/3.4.2rc1/ > > > > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-mysql/5.2.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-mysql/5.2.0rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-neo4j/3.3.2rc1/ > > <https://pypi.org/project/apache-airflow-providers-neo4j/3.3.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-openlineage/1.0.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-openlineage/1.0.0rc1/ > > > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-oracle/3.7.2rc1/ < > > https://pypi.org/project/apache-airflow-providers-oracle/3.7.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-postgres/5.6.0rc1/ > < > > https://pypi.org/project/apache-airflow-providers-postgres/5.6.0rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-presto/5.1.2rc1/ < > > https://pypi.org/project/apache-airflow-providers-presto/5.1.2rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-redis/3.3.0rc1/ > > <https://pypi.org/project/apache-airflow-providers-redis/3.3.0rc1/> > > > > > > > > > > >> > > > > > > https://pypi.org/project/apache-airflow-providers-sftp/4.5.0rc1/ > < > > https://pypi.org/project/apache-airflow-providers-sftp/4.5.0rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-slack/7.3.2rc1/ > > <https://pypi.org/project/apache-airflow-providers-slack/7.3.2rc1/> > > > > > > > > > > >> > > > > > > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-snowflake/4.4.0rc1/ < > > https://pypi.org/project/apache-airflow-providers-snowflake/4.4.0rc1/> > > > > > > > > > > >> > > > > > > > > > https://pypi.org/project/apache-airflow-providers-sqlite/3.4.3rc1/ < > > https://pypi.org/project/apache-airflow-providers-sqlite/3.4.3rc1/> > > > > > > > > > > >> > > > > > > > https://pypi.org/project/apache-airflow-providers-trino/5.2.1rc1/ > > <https://pypi.org/project/apache-airflow-providers-trino/5.2.1rc1/> > > > > > > > > > > >> > > > > > > > > > > https://pypi.org/project/apache-airflow-providers-vertica/3.5.1rc1/ < > > https://pypi.org/project/apache-airflow-providers-vertica/3.5.1rc1/> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> Cheers, > > > > > > > > > > >> > > > > > > > > > > >> Elad Kalif > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > > > > > > > To unsubscribe, e-mail: > dev-unsubscr...@airflow.apache.org > > <mailto:dev-unsubscr...@airflow.apache.org> > > > > > > > > > > For additional commands, e-mail: > > dev-h...@airflow.apache.org <mailto:dev-h...@airflow.apache.org> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > > > > > > > > To unsubscribe, e-mail: dev-unsubscr...@airflow.apache.org > > <mailto:dev-unsubscr...@airflow.apache.org> > > > > > > > > > For additional commands, e-mail: > dev-h...@airflow.apache.org > > <mailto:dev-h...@airflow.apache.org> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: dev-unsubscr...@airflow.apache.org > > For additional commands, e-mail: dev-h...@airflow.apache.org > > >
