potiuk opened a new issue, #68225: URL: https://github.com/apache/airflow/issues/68225
I have a kind request for all the contributors to the latest provider distributions release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDERS.md#verify-the-release-candidate-by-contributors) Let us know in the comments, whether the issue is addressed. These are providers that require testing as there were some substantial changes introduced: ## Provider [amazon: 9.30.0rc2](https://pypi.org/project/apache-airflow-providers-amazon/9.30.0rc2) - [ ] [Add `GlueCatalogBatchDeletePartitionOperator` (#66721)](https://github.com/apache/airflow/pull/66721): @john-jac - [ ] [Add `OpenSearchServerlessCreateCollectionOperator` (#66549)](https://github.com/apache/airflow/pull/66549): @john-jac Linked issues: - [Linked Issue #39378](https://github.com/apache/airflow/issues/39378): @eladkal - [ ] [Propagate verify and botocore_config in AWS Batch triggers (#67508)](https://github.com/apache/airflow/pull/67508): @KarshVashi Linked issues: - [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Propogate verify and botocore_config in redshift cluster triggers (#67876)](https://github.com/apache/airflow/pull/67876): @KarshVashi Linked issues: - [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Add ExecuteCallback support to AWS ECS Executor (#63657)](https://github.com/apache/airflow/pull/63657): @shivaam Linked issues: - [Linked Issue #65392](https://github.com/apache/airflow/pull/65392): @anishgirianish - [Linked Issue #63035](https://github.com/apache/airflow/pull/63035): @SameerMesiah97 - [Linked Issue #62645](https://github.com/apache/airflow/pull/62645): @ferruzzi - [Linked Issue #62887](https://github.com/apache/airflow/issues/62887): @ferruzzi - [ ] [Add Amazon Bedrock AgentCore Runtime operators (#67984)](https://github.com/apache/airflow/pull/67984): @AlejandroMorgante - [ ] [Add `DmsModifyTaskOperator` (#67524)](https://github.com/apache/airflow/pull/67524): @AlejandroMorgante - [ ] [Fix SageMaker processing stopped state handling (#67291)](https://github.com/apache/airflow/pull/67291): @Codingaditya17 Linked issues: - [Linked Issue #67281](https://github.com/apache/airflow/issues/67281): @dym-ok - [ ] [Fix EMR Serverless task failure on transient AWS throttling errors (#67222)](https://github.com/apache/airflow/pull/67222): @Subham-KRLX Linked issues: - [Linked Issue #67178](https://github.com/apache/airflow/issues/67178): @ROOBALJINDAL - [ ] [Fix duplicated logs and memory issue with S3 log handler (#67144)](https://github.com/apache/airflow/pull/67144): @jvstein - [ ] [fix: EksPodOperator 401 with cross-account AssumeRole via aws_conn_id (#65335)](https://github.com/apache/airflow/pull/65335): @anmolxlight Linked issues: - [Linked Issue #64749](https://github.com/apache/airflow/pull/64749): @anmolxlight - [ ] [Fix inconsistency in S3 transfer operators (#67378)](https://github.com/apache/airflow/pull/67378): @yuseok89 Linked issues: - [Linked Issue #37213](https://github.com/apache/airflow/issues/37213): @jroachgolf84 - [ ] [Fix/ecs task log level parsing (#67180)](https://github.com/apache/airflow/pull/67180): @zachliu - [ ] [Fix IDC domain S3 path resolution (#67987)](https://github.com/apache/airflow/pull/67987): @qaziashikin - [ ] [Remove further findings from positional session check (#67712)](https://github.com/apache/airflow/pull/67712): @jscheffl Linked issues: - [Linked Issue #67661](https://github.com/apache/airflow/pull/67661): @jscheffl - [Linked Issue #67150](https://github.com/apache/airflow/pull/67150): @jason810496 - [ ] [Remove redundant TODO comment in RedshiftHook (#67485)](https://github.com/apache/airflow/pull/67485): @23tae - [ ] [Add prek hook to enforce HTTPException is imported from fastapi (#67367)](https://github.com/apache/airflow/pull/67367): @jason810496 Linked issues: - [Linked Issue #67363](https://github.com/apache/airflow/pull/67363): @dkranchii - [ ] [Update Notebook Operator to pull S3 project bucket from tooling env (#67915)](https://github.com/apache/airflow/pull/67915): @qaziashikin ## Provider [apache.spark: 6.1.0rc2](https://pypi.org/project/apache-airflow-providers-apache-spark/6.1.0rc2) - [ ] [Add `ResumableJobMixin` with `SparkSubmitOperator` as a case study for surviving worker failures (standalone) (#67118)](https://github.com/apache/airflow/pull/67118): @amoghrajesh - [ ] [Spark: track YARN cluster apps via RM REST API to free JVM (#65991)](https://github.com/apache/airflow/pull/65991): @nailo2c Linked issues: - [Linked Issue #24171](https://github.com/apache/airflow/issues/24171): @tokoko - [ ] [Use K8s API to track Spark on K8s instead of JVM based spark-submit (#67715)](https://github.com/apache/airflow/pull/67715): @amoghrajesh Linked issues: - [Linked Issue #65991](https://github.com/apache/airflow/pull/65991): @nailo2c - [ ] [Enhance `ResumableJobMixin.get_job_status` with context for better job status tracking (#68009)](https://github.com/apache/airflow/pull/68009): @amoghrajesh - [ ] [Rename resumablemixin file to match class name (#68137)](https://github.com/apache/airflow/pull/68137): @amoghrajesh - [ ] [Auto-sync provider README.rst Requirements with pyproject.toml (#67669)](https://github.com/apache/airflow/pull/67669): @potiuk Linked issues: - [Linked Issue #67554](https://github.com/apache/airflow/pull/67554): @jscheffl - [ ] [Document REST scheme and port connection fields for Spark (#67682)](https://github.com/apache/airflow/pull/67682): @amoghrajesh Linked issues: - [Linked Issue #67118](https://github.com/apache/airflow/pull/67118): @amoghrajesh ## Provider [clickhousedb: 1.0.0rc1](https://pypi.org/project/apache-airflow-providers-clickhousedb/1.0.0rc1) **:tada: New provider** - [ ] Initial release does not list PR references in changelog. Please run smoke tests. ## Provider [cncf.kubernetes: 10.18.0rc2](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/10.18.0rc2) - [ ] [Enforce execution_timeout in deferrable KubernetesPodOperator (#67229)](https://github.com/apache/airflow/pull/67229): @paultmathew Linked issues: - [Linked Issue #66449](https://github.com/apache/airflow/pull/66449): @SameerMesiah97 - [Linked Issue #64051](https://github.com/apache/airflow/pull/64051): @SameerMesiah97 - [ ] [Fix scheduler crashloop from `KubernetesExecutor` completed-pod adoption (#67850)](https://github.com/apache/airflow/pull/67850): @kaxil Linked issues: - [Linked Issue #66400](https://github.com/apache/airflow/pull/66400): @potiuk - [Linked Issue #67813](https://github.com/apache/airflow/issues/67813): @adrianrego - [Linked Issue #67822](https://github.com/apache/airflow/pull/67822): @Revanth14 - [Linked Issue #61839](https://github.com/apache/airflow/pull/61839): @atrbgithub - [Linked Issue #35579](https://github.com/apache/airflow/pull/35579): @dirrao - [ ] [Fix monitoring-pod leak in KubernetesJobOperator (#67333)](https://github.com/apache/airflow/pull/67333): @jykae Linked issues: - [Linked Issue #67332](https://github.com/apache/airflow/issues/67332): @jykae - [ ] [Fix `KubernetesPodOperator` emitting orphan timestamps for empty container writes (#67652)](https://github.com/apache/airflow/pull/67652): @kaxil Linked issues: - [Linked Issue #36571](https://github.com/apache/airflow/issues/36571): @karakanb - [ ] [Fix multiple_outputs no-op on deferrable KubernetesPodOperator (#67226)](https://github.com/apache/airflow/pull/67226): @paultmathew Linked issues: - [Linked Issue #58488](https://github.com/apache/airflow/pull/58488): @AutomationDev85 - [Linked Issue #67224](https://github.com/apache/airflow/issues/67224): @paultmathew - [Linked Issue #58998](https://github.com/apache/airflow/pull/58998): @AutomationDev85 - [ ] [Fix KubernetesPodTrigger.get_task_state KeyError on mapped TIs (#67296) (#67297)](https://github.com/apache/airflow/pull/67297): @paultmathew Linked issues: - [Linked Issue #67296](https://github.com/apache/airflow/issues/67296): @paultmathew - [ ] [Remove further findings from positional session check (#67712)](https://github.com/apache/airflow/pull/67712): @jscheffl Linked issues: - [Linked Issue #67661](https://github.com/apache/airflow/pull/67661): @jscheffl - [Linked Issue #67150](https://github.com/apache/airflow/pull/67150): @jason810496 - [ ] [Allow `kubernetes` and `kubernetes_asyncio` client 36.x in cncf.kubernetes (#68041)](https://github.com/apache/airflow/pull/68041): @kaxil - [ ] [Correct README.rst common compat version reference inconsistency (#67554)](https://github.com/apache/airflow/pull/67554): @jscheffl ## Provider [edge3: 3.8.0rc2](https://pypi.org/project/apache-airflow-providers-edge3/3.8.0rc2) - [ ] [Fix edge executor to support handling execute callback workload (#67679)](https://github.com/apache/airflow/pull/67679): @wjddn279 - [ ] [Add `awaiting_input` task state for Human-in-the-loop, off the triggerer (#68028)](https://github.com/apache/airflow/pull/68028): @kaxil - [ ] [Add async connection testing via workers for security isolation (#62343)](https://github.com/apache/airflow/pull/62343): @anishgirianish Linked issues: - [Linked Issue #59643](https://github.com/apache/airflow/pull/59643): @choo121600 - [ ] [Fix Edge worker fork mode reporting supervisor failures as success (#67887)](https://github.com/apache/airflow/pull/67887): @wjddn279 - [ ] [Fix team name authorization bypass in edgeworker (#64556)](https://github.com/apache/airflow/pull/64556): @gopidesupavan - [ ] [Remove unnecessarily added logging in edge worker (#68019)](https://github.com/apache/airflow/pull/68019): @wjddn279 - [ ] [Fix exceptions of positional session use in Edge provider (2) (#67812)](https://github.com/apache/airflow/pull/67812): @jscheffl - [ ] [Fix exceptions of positional session use in Edge provider (#67661)](https://github.com/apache/airflow/pull/67661): @jscheffl - [ ] [Add prek hook to enforce HTTPException is imported from fastapi (#67367)](https://github.com/apache/airflow/pull/67367): @jason810496 Linked issues: - [Linked Issue #67363](https://github.com/apache/airflow/pull/67363): @dkranchii - [ ] [Remove dead auth code from Airflow2 times in Edge (#67374)](https://github.com/apache/airflow/pull/67374): @jscheffl - [ ] [Add prek hook enforcing the "example" tag on example DAGs (#67354)](https://github.com/apache/airflow/pull/67354): @andreahlert Linked issues: - [Linked Issue #52477](https://github.com/apache/airflow/issues/52477): @jscheffl - [ ] [Bump aiohttp regarding dependabot warning (#67978)](https://github.com/apache/airflow/pull/67978): @jscheffl - [ ] [Replace Sphinx Redoc with Swagger API Docs (#67390)](https://github.com/apache/airflow/pull/67390): @jscheffl - [ ] [Correct README.rst common compat version reference inconsistency (#67554)](https://github.com/apache/airflow/pull/67554): @jscheffl - [ ] [Add some more clarifications on edge roles (#67379)](https://github.com/apache/airflow/pull/67379): @jscheffl - [ ] [docs(edge3): clarify WorkerQueuesBase.team_name is an experimental hint, cross-ref workload.rst (#66718)](https://github.com/apache/airflow/pull/66718): @omkhar <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @kaxil @qaziashikin @jvstein @paultmathew @nailo2c @KarshVashi @yuseok89 @Codingaditya17 @shivaam @jykae @23tae @omkhar @potiuk @jason810496 @john-jac @AlejandroMorgante @amoghrajesh @anmolxlight @gopidesupavan @anishgirianish @andreahlert @zachliu @wjddn279 @Subham-KRLX @jscheffl -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
