hussein-awala opened a new issue, #71847: URL: https://github.com/apache/airflow/issues/71847
### Body I have a kind request for all the contributors to the latest provider distributions release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDERS.md#verify-the-release-candidate-by-contributors) Let us know in the comments, whether the issue is addressed. These are providers that require testing as there were some substantial changes introduced: ## Provider [amazon: 9.35.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/9.35.0rc1) - [ ] [Replace `resume_glue_job_on_retry` with durable execution for `GlueJobOperator` (#71211)](https://github.com/apache/airflow/pull/71211): @amoghrajesh Linked issues: - [Linked Issue #71492](https://github.com/apache/airflow/pull/71492): @amoghrajesh - [ ] [Prevent a broken job from stalling AWS Batch executor sync (#71380)](https://github.com/apache/airflow/pull/71380): @AlexanderBLR - [ ] [Fail Glue job tasks promptly when a verbose job run errors (#71570)](https://github.com/apache/airflow/pull/71570): @rjgoyln Linked issues: - [Linked Issue #71495](https://github.com/apache/airflow/pull/71495): @rjgoyln - [ ] [Make `durable` reach `default_args` and warn when set below Airflow 3.3 (#71531)](https://github.com/apache/airflow/pull/71531): @amoghrajesh - [ ] [Fail Glue job tasks stopped mid-run in deferrable verbose mode (#71495)](https://github.com/apache/airflow/pull/71495): @rjgoyln Linked issues: - [Linked Issue #71490](https://github.com/apache/airflow/issues/71490): @amoghrajesh - [Linked Issue #71211](https://github.com/apache/airflow/pull/71211): @amoghrajesh - [ ] [Include Bedrock ingestion job failure reasons in the error messages (#71124)](https://github.com/apache/airflow/pull/71124): @ferruzzi - [ ] [Narrow AirflowException to specific exceptions in DataSync operator (#70152)](https://github.com/apache/airflow/pull/70152): @haseebmalik18 - [ ] [Move SendGrid and SES email backend setup docs to their providers (#71571)](https://github.com/apache/airflow/pull/71571): @eladkal - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova - [ ] [Fix incorrect documented defaults for MwaaTriggerDagRunOperator waiter params (#71740)](https://github.com/apache/airflow/pull/71740): @maupatel - [ ] [Document how clearing tasks works with task state store on durable operators (#71358)](https://github.com/apache/airflow/pull/71358): @amoghrajesh ## Provider [anthropic: 0.3.0rc1](https://pypi.org/project/apache-airflow-providers-anthropic/0.3.0rc1) - [ ] [Record Anthropic agent session token usage and cost in XCom (#71463)](https://github.com/apache/airflow/pull/71463): @kaxil - [ ] [Add a budget argument to AnthropicAgentSessionOperator (#71462)](https://github.com/apache/airflow/pull/71462): @kaxil - [ ] [Interrupt a running Anthropic session before archiving it (#71465)](https://github.com/apache/airflow/pull/71465): @kaxil - [ ] [Fix misleading error when an Anthropic agent session stops on its budget (#71461)](https://github.com/apache/airflow/pull/71461): @kaxil - [ ] [Document Anthropic advisor rosters and pinned inference regions (#71464)](https://github.com/apache/airflow/pull/71464): @kaxil ## Provider [apache.hdfs: 4.13.0rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.13.0rc1) - [ ] [Add HdfsRemoteLogIO.from_config and register hdfs remote logging scheme (#71278)](https://github.com/apache/airflow/pull/71278): @baha-bouali Linked issues: - [Linked Issue #67056](https://github.com/apache/airflow/pull/67056): @jason810496 - [Linked Issue #70265](https://github.com/apache/airflow/issues/70265): @jason810496 - [Linked Issue #70270](https://github.com/apache/airflow/issues/70270): @jason810496 ## Provider [apache.iceberg: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-apache-iceberg/2.1.0rc1) - [ ] [Add IcebergTableSnapshotTrigger for event-driven scheduling (#71387)](https://github.com/apache/airflow/pull/71387): @1fanwang ## Provider [apache.kafka: 1.16.0rc1](https://pypi.org/project/apache-airflow-providers-apache-kafka/1.16.0rc1) - [ ] [Kafka: Return consumed message results on request (#69740)](https://github.com/apache/airflow/pull/69740): @Vamsi-klu Linked issues: - [Linked Issue #56494](https://github.com/apache/airflow/issues/56494): @JosephCatrambone-Gridware ## Provider [apache.livy: 4.6.1rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/4.6.1rc1) - [ ] [Make `durable` reach `default_args` and warn when set below Airflow 3.3 (#71531)](https://github.com/apache/airflow/pull/71531): @amoghrajesh ## Provider [apache.spark: 6.3.2rc1](https://pypi.org/project/apache-airflow-providers-apache-spark/6.3.2rc1) - [ ] [Make SparkSubmitOperator durable execution inert below Airflow 3.3 (#71534)](https://github.com/apache/airflow/pull/71534): @amoghrajesh - [ ] [Make `durable` reach `default_args` and warn when set below Airflow 3.3 (#71531)](https://github.com/apache/airflow/pull/71531): @amoghrajesh - [ ] [Document how clearing tasks works with task state store on durable operators (#71358)](https://github.com/apache/airflow/pull/71358): @amoghrajesh ## Provider [cncf.kubernetes: 10.21.1rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/10.21.1rc1) - [ ] [Make KPO durable execution inert below Airflow 3.3 (#71492)](https://github.com/apache/airflow/pull/71492): @amoghrajesh - [ ] [Coerce explicit None _request_timeout in async/sync k8s API clients (#69611)](https://github.com/apache/airflow/pull/69611): @ZhaoMJ - [ ] [added missing argument docs (#71217)](https://github.com/apache/airflow/pull/71217): @Nataneljpwd ## Provider [common.ai: 0.8.0rc1](https://pypi.org/project/apache-airflow-providers-common-ai/0.8.0rc1) - [ ] [Add SandboxToolset for sandboxed agent shell and file access (#68847)](https://github.com/apache/airflow/pull/68847): @zozo123 Linked issues: - [Linked Issue #68845](https://github.com/apache/airflow/issues/68845): @zozo123 - [Linked Issue #68407](https://github.com/apache/airflow/pull/68407): @kaxil - [ ] [Support require_approval in LLMSchemaCompareOperator (#71051)](https://github.com/apache/airflow/pull/71051): @guan404ming - [ ] [Bound SQL toolset query results by size, not just row count (#71317)](https://github.com/apache/airflow/pull/71317): @kaxil - [ ] [Support custom redaction and message length cap in LLMRetryPolicy (#70830)](https://github.com/apache/airflow/pull/70830): @Lee-W - [ ] [Let the agent retry on a rejected DataFusion query instead of failing (#71445)](https://github.com/apache/airflow/pull/71445): @ColtenOuO - [ ] [Show which LLM providers each Common AI connection type reaches (#70497)](https://github.com/apache/airflow/pull/70497): @Lee-W - [ ] [Document the dedicated pydantic-ai vendor connection types (#71774)](https://github.com/apache/airflow/pull/71774): @Lee-W - [ ] [Document the common-ai MCPHook (#71817)](https://github.com/apache/airflow/pull/71817): @Lee-W - [ ] [Document the common-ai LangChain and LlamaIndex connection types (#71818)](https://github.com/apache/airflow/pull/71818): @Lee-W - [ ] [Fix and expand the common-ai provider's When to use guidance (#71820)](https://github.com/apache/airflow/pull/71820): @Lee-W - [ ] [Add LLMSchemaCompareOperator to the common-ai operator index table (#71738)](https://github.com/apache/airflow/pull/71738): @ColtenOuO ## Provider [common.sql: 2.1.1rc1](https://pypi.org/project/apache-airflow-providers-common-sql/2.1.1rc1) - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova ## Provider [databricks: 7.19.0rc1](https://pypi.org/project/apache-airflow-providers-databricks/7.19.0rc1) - [ ] [Add Databricks SQL warehouse lifecycle operators (#70088)](https://github.com/apache/airflow/pull/70088): @Vamsi-klu Linked issues: - [Linked Issue #21377](https://github.com/apache/airflow/issues/21377): @dinowernli - [ ] [Add performance_target parameter to DatabricksSubmitRunOperator (#71374)](https://github.com/apache/airflow/pull/71374): @li-xiang-db - [ ] [Add Databricks-native retry settings to task operators (#69182)](https://github.com/apache/airflow/pull/69182): @Beat-Nick - [ ] [Make `durable` reach `default_args` and warn when set below Airflow 3.3 (#71531)](https://github.com/apache/airflow/pull/71531): @amoghrajesh - [ ] [Document how clearing tasks works with task state store on durable operators (#71358)](https://github.com/apache/airflow/pull/71358): @amoghrajesh ## Provider [edge3: 4.3.1rc1](https://pypi.org/project/apache-airflow-providers-edge3/4.3.1rc1) - [ ] [UI: Stop using React.FC and the React type namespace (#71563)](https://github.com/apache/airflow/pull/71563): @ryanahamilton ## Provider [fab: 3.8.1rc1](https://pypi.org/project/apache-airflow-providers-fab/3.8.1rc1) - [ ] [Validate issuer and audience of Azure AD id_tokens in FAB auth manager (#71735)](https://github.com/apache/airflow/pull/71735): @potiuk - [ ] [Add pnpm overrides after audit review in fab provider (#71448)](https://github.com/apache/airflow/pull/71448): @vincbeck - [ ] [Fix SSO docs pointing at the pre-Airflow 3 OAuth redirect path (#71624)](https://github.com/apache/airflow/pull/71624): @MannXo Linked issues: - [Linked Issue #71569](https://github.com/apache/airflow/issues/71569): @fjmacagno - [ ] [Document API token response details (#71583)](https://github.com/apache/airflow/pull/71583): @feberbo ## Provider [git: 0.4.3rc1](https://pypi.org/project/apache-airflow-providers-git/0.4.3rc1) - [ ] [Fix malformed GitDagBundle error message for missing repository path (#70622)](https://github.com/apache/airflow/pull/70622): @WonYong-Jang - [ ] [Document commit SHA support for GitDagBundle tracking_ref (#69735)](https://github.com/apache/airflow/pull/69735): @coleheflin Linked issues: - [Linked Issue #71388](https://github.com/apache/airflow/issues/71388): @coleheflin ## Provider [google: 22.4.0rc1](https://pypi.org/project/apache-airflow-providers-google/22.4.0rc1) - [ ] [Support sovereign console links (#70001)](https://github.com/apache/airflow/pull/70001): @auyua9 Linked issues: - [Linked Issue #69805](https://github.com/apache/airflow/pull/69805): @molcay - [ ] [Add synchronous Vertex AI Agent Engine query operator (#70933)](https://github.com/apache/airflow/pull/70933): @AlejandroMorgante Linked issues: - [Linked Issue #68479](https://github.com/apache/airflow/pull/68479): @AlejandroMorgante - [ ] [Add Cloud Run job links during execution (#70179)](https://github.com/apache/airflow/pull/70179): @VladaZakharova - [ ] [Prepare Cloud Batch jobs before template rendering (#70835)](https://github.com/apache/airflow/pull/70835): @shivaam Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Improve BigQuerytoSQL column lineage rendering (#70816)](https://github.com/apache/airflow/pull/70816): @VladaZakharova - [ ] [Make `durable` reach `default_args` and warn when set below Airflow 3.3 (#71531)](https://github.com/apache/airflow/pull/71531): @amoghrajesh - [ ] [Use latest Google Ads API version by default (#71280)](https://github.com/apache/airflow/pull/71280): @VladaZakharova - [ ] [Restore the evaluation extra of google-cloud-aiplatform (#71520)](https://github.com/apache/airflow/pull/71520): @potiuk Linked issues: - [Linked Issue #71273](https://github.com/apache/airflow/pull/71273): @potiuk - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova ## Provider [hashicorp: 4.8.1rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/4.8.1rc1) - [ ] [Halve external vault API lookup requests per airflow secret lookup (#71701)](https://github.com/apache/airflow/pull/71701): @amoghrajesh ## Provider [jdbc: 5.5.1rc1](https://pypi.org/project/apache-airflow-providers-jdbc/5.5.1rc1) - [ ] [Use built-in exceptions for JDBC sqlalchemy connection extras (#70535)](https://github.com/apache/airflow/pull/70535): @mitre88 Linked issues: - [Linked Issue #66279](https://github.com/apache/airflow/pull/66279): @justinpakzad ## Provider [keycloak: 0.9.0rc2](https://pypi.org/project/apache-airflow-providers-keycloak/0.9.0rc2) - [ ] [Grant team Op role access to team Dags in Keycloak auth manager (#71572)](https://github.com/apache/airflow/pull/71572): @coleheflin Linked issues: - [Linked Issue #71319](https://github.com/apache/airflow/issues/71319): @dhkim1920 - [ ] [Make KeycloakAuthManager cache configurable (#70839)](https://github.com/apache/airflow/pull/70839): @stephen-bracken - [ ] [Add KeycloakJWTMiddleware to KeycloakAuthManager (#70800)](https://github.com/apache/airflow/pull/70800): @stephen-bracken Linked issues: - [Linked Issue #70550](https://github.com/apache/airflow/pull/70550): @stephen-bracken - [ ] [Fix Airflow JWT getting cleared in KeycloakAuthManager /login_callback route (#71077)](https://github.com/apache/airflow/pull/71077): @stephen-bracken Linked issues: - [Linked Issue #70800](https://github.com/apache/airflow/pull/70800): @stephen-bracken - [ ] [Fix login loop when the login callback carries an expired Airflow JWT in KeycloakAuthManager (#71506)](https://github.com/apache/airflow/pull/71506): @stegololz Linked issues: - [Linked Issue #70800](https://github.com/apache/airflow/pull/70800): @stephen-bracken - [Linked Issue #71077](https://github.com/apache/airflow/pull/71077): @stephen-bracken - [ ] [Implement bulk authorization methods in KeycloakAuthManager (#70647)](https://github.com/apache/airflow/pull/70647): @abhishekmauryaKsolves Linked issues: - [Linked Issue #70582](https://github.com/apache/airflow/issues/70582): @stephen-bracken - [ ] [Fix Keycloak multi-team permission repair (#71614)](https://github.com/apache/airflow/pull/71614): @fat-catTW Linked issues: - [Linked Issue #71277](https://github.com/apache/airflow/issues/71277): @wilsonjefferson - [ ] [Make Keycloak permission creation quietly idempotent like its sibling helpers (#71505)](https://github.com/apache/airflow/pull/71505): @stegololz Linked issues: - [Linked Issue #70800](https://github.com/apache/airflow/pull/70800): @stephen-bracken - [ ] [Fix Keycloak access for individual roles (#70906)](https://github.com/apache/airflow/pull/70906): @dhkim1920 Linked issues: - [Linked Issue #70251](https://github.com/apache/airflow/issues/70251): @joshua-cogliati-inl - [ ] [Move keycloak JWT tokens to separate cookies (#70550)](https://github.com/apache/airflow/pull/70550): @stephen-bracken Linked issues: - [Linked Issue #61771](https://github.com/apache/airflow/issues/61771): @exolightor - [ ] [Disable separate Keycloak JWTs for Airflow v3.2- (#70981)](https://github.com/apache/airflow/pull/70981): @stephen-bracken - [ ] [Remove groups claim from access tokens in Keycloak clients from the KeycloakAuthManager cli (#71093)](https://github.com/apache/airflow/pull/71093): @stephen-bracken Linked issues: - [Linked Issue #61771](https://github.com/apache/airflow/issues/61771): @exolightor ## Provider [microsoft.azure: 15.0.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/15.0.0rc1) - [ ] [Azure batch 15x migration (#71071)](https://github.com/apache/airflow/pull/71071): @baha-bouali Linked issues: - [Linked Issue #67600](https://github.com/apache/airflow/pull/67600): @arieleli01212 - [Linked Issue #66466](https://github.com/apache/airflow/issues/66466): @potiuk - [Linked Issue #66452](https://github.com/apache/airflow/pull/66452): @wjddn279 - [ ] [Support certificate auth for Microsoft Graph filesystem (#71362)](https://github.com/apache/airflow/pull/71362): @fat-catTW Linked issues: - [Linked Issue #69335](https://github.com/apache/airflow/issues/69335): @belegdol - [ ] [Keep MSGraph request configuration across paginated pages (#71649)](https://github.com/apache/airflow/pull/71649): @SEPURI-SAI-KRISHNA - [ ] [Fix Microsoft Graph filesystem auth by defaulting OAuth2 scope (#70879)](https://github.com/apache/airflow/pull/70879): @haseebmalik18 Linked issues: - [Linked Issue #70822](https://github.com/apache/airflow/issues/70822): @belegdol - [ ] [Check GCSToAzureBlobStorageOperator match_glob support after template… (#70574)](https://github.com/apache/airflow/pull/70574): @bramhanandlingala Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [microsoft.mssql: 4.7.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-mssql/4.7.1rc1) - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova ## Provider [microsoft.psrp: 3.2.7rc1](https://pypi.org/project/apache-airflow-providers-microsoft-psrp/3.2.7rc1) - [ ] [Fix PsrpOperator option checks (#70347)](https://github.com/apache/airflow/pull/70347): @1fanwang ## Provider [mysql: 6.6.2rc1](https://pypi.org/project/apache-airflow-providers-mysql/6.6.2rc1) - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova ## Provider [openlineage: 2.20.1rc1](https://pypi.org/project/apache-airflow-providers-openlineage/2.20.1rc1) - [ ] [Fix incorrect availability versions for OpenLineage config options (#71449)](https://github.com/apache/airflow/pull/71449): @ramitkataria - [ ] [UI: Show owning team on Dag, Dag Run, and Task Instance detail pages (#70312)](https://github.com/apache/airflow/pull/70312): @vincbeck ## Provider [oracle: 4.6.3rc1](https://pypi.org/project/apache-airflow-providers-oracle/4.6.3rc1) - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova ## Provider [postgres: 7.0.2rc1](https://pypi.org/project/apache-airflow-providers-postgres/7.0.2rc1) - [ ] [Add type annotations for Airflow connection in SQL lineage hooks (#70815)](https://github.com/apache/airflow/pull/70815): @VladaZakharova ## Provider [samba: 4.13.0rc1](https://pypi.org/project/apache-airflow-providers-samba/4.13.0rc1) - [ ] [Add auth_protocol support to SambaHook for Kerberos authentication #29590 (#64643)](https://github.com/apache/airflow/pull/64643): @haseebmalik18 Linked issues: - [Linked Issue #29590](https://github.com/apache/airflow/issues/29590): @mrBlackHat777 ## Provider [snowflake: 6.16.1rc1](https://pypi.org/project/apache-airflow-providers-snowflake/6.16.1rc1) - [ ] [Make `durable` reach `default_args` and warn when set below Airflow 3.3 (#71531)](https://github.com/apache/airflow/pull/71531): @amoghrajesh - [ ] [Document how clearing tasks works with task state store on durable operators (#71358)](https://github.com/apache/airflow/pull/71358): @amoghrajesh ## Provider [standard: 1.18.0rc1](https://pypi.org/project/apache-airflow-providers-standard/1.18.0rc1) - [ ] [Support TaskFlow call syntax on stub tasks for the Lang SDK (#69757)](https://github.com/apache/airflow/pull/69757): @jason810496 Linked issues: - [Linked Issue #70209](https://github.com/apache/airflow/pull/70209): @jason810496 - [Linked Issue #70570](https://github.com/apache/airflow/pull/70570): @jason810496 ## Provider [tableau: 5.6.1rc1](https://pypi.org/project/apache-airflow-providers-tableau/5.6.1rc1) - [ ] [Skip Tableau refresh/task run on 409093 resource conflict (#69382)](https://github.com/apache/airflow/pull/69382): @jayamanikharyono <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @guan404ming @ryanahamilton @li-xiang-db @coleheflin @AlejandroMorgante @Nataneljpwd @abhishekmauryaKsolves @WonYong-Jang @rjgoyln @VladaZakharova @ramitkataria @vincbeck @ferruzzi @Lee-W @SEPURI-SAI-KRISHNA @eladkal @auyua9 @feberbo @dhkim1920 @kaxil @Vamsi-klu @Beat-Nick @fat-catTW @jayamanikharyono @stegololz @mitre88 @ColtenOuO @MannXo @zozo123 @ZhaoMJ @maupatel @bramhanandlingala @baha-bouali @shivaam @1fanwang @jason810496 @amoghrajesh @potiuk @haseebmalik18 @stephen-bracken @AlexanderBLR ### Committer - [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
