vincbeck opened a new issue, #69562: URL: https://github.com/apache/airflow/issues/69562
I have a kind request for all the contributors to the latest provider distributions release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDERS.md#verify-the-release-candidate-by-contributors) Let us know in the comments, whether the issue is addressed. These are providers that require testing as there were some substantial changes introduced: ## Provider [airbyte: 5.5.2rc1](https://pypi.org/project/apache-airflow-providers-airbyte/5.5.2rc1) - [ ] [Cap airbyte-api below 1.0.0 to unblock provider tests (#69081)](https://github.com/apache/airflow/pull/69081): @shahar1 Linked issues: - [Linked Issue #68882](https://github.com/apache/airflow/pull/68882): @aaronsteers ## Provider [amazon: 9.32.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/9.32.0rc1) - [ ] [Add CRUD methods to DynamoDBHook (#69142)](https://github.com/apache/airflow/pull/69142): @gocoolp Linked issues: - [Linked Issue #69050](https://github.com/apache/airflow/issues/69050): @gocoolp - [ ] [Add Amazon Provider Neptune Analytics (#64274)](https://github.com/apache/airflow/pull/64274): @ellisms Linked issues: - [Linked Issue #60975](https://github.com/apache/airflow/issues/60975): @CincyBC - [ ] [Add team_name tags to Amazon executor metrics (#69072)](https://github.com/apache/airflow/pull/69072): @justinpakzad Linked issues: - [Linked Issue #68996](https://github.com/apache/airflow/issues/68996): @ferruzzi - [ ] [Add S3CopyPrefixOperator to copy all objects under a prefix (#68946)](https://github.com/apache/airflow/pull/68946): @bentorb - [ ] [Add the ability for SageMakerProcessingOperator to read JSON output files from S3. (#69002)](https://github.com/apache/airflow/pull/69002): @bhavya2109sharma - [ ] [Propagate AWS hook parameters through RedshiftClusterTrigger (#68925)](https://github.com/apache/airflow/pull/68925): @o-nikolas Linked issues: - [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Propagate verify and botocore_config through EC2StateSensorTrigger (#68921)](https://github.com/apache/airflow/pull/68921): @o-nikolas Linked issues: - [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Fix AWS Batch Executor compatibility with Airflow 3 in `try_adopt_task_instances` (#68027)](https://github.com/apache/airflow/pull/68027): @ambaena Linked issues: - [Linked Issue #62192](https://github.com/apache/airflow/pull/62192): @vincbeck - [ ] [prevent path traversal in s3 to sftp/ftp transfer destinations (#68984)](https://github.com/apache/airflow/pull/68984): @Samin061 - [ ] [Fix SageMakerTransformOperator succeeding on a failed deferred job (#69042)](https://github.com/apache/airflow/pull/69042): @steveahnahn Linked issues: - [Linked Issue #68927](https://github.com/apache/airflow/pull/68927): @o-nikolas - [ ] [Close S3 download_file handle after download or failure (#69084)](https://github.com/apache/airflow/pull/69084): @itej13 Linked issues: - [Linked Issue #69077](https://github.com/apache/airflow/issues/69077): @goransh-buh - [ ] [Make Amazon SageMaker triggers inherit AWS base classes (#68927)](https://github.com/apache/airflow/pull/68927): @o-nikolas Linked issues: - [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Fix batchoperator deferrable xcom links (#64745)](https://github.com/apache/airflow/pull/64745): @kakatur - [ ] [Standardize ECS TaskDoneTrigger on region_name and AWS hook parameters (#68923)](https://github.com/apache/airflow/pull/68923): @o-nikolas Linked issues: - [Linked Issue #35278](https://github.com/apache/airflow/issues/35278): @Taragolis - [ ] [Fix CloudWatch remote logging for ephemeral lifecycle executor (#68779)](https://github.com/apache/airflow/pull/68779): @jason810496 Linked issues: - [Linked Issue #66633](https://github.com/apache/airflow/pull/66633): @korex-f - [ ] [Fix Cloudwatch remote logging crash API server if ResourceNotFoundException (#68781)](https://github.com/apache/airflow/pull/68781): @jason810496 ## Provider [anthropic: 0.1.0rc1](https://pypi.org/project/apache-airflow-providers-anthropic/0.1.0rc1) **:tada: New provider** > **Note:** This is a new provider, so the PRs below are collected from the git history of the provider's sources rather than from a changelog diff. The list may therefore include bootstrap and development commits (e.g. release-preparation commits) that are not user-facing changes. - [ ] [Add Anthropic provider (`apache-airflow-providers-anthropic`) (#69003)](https://github.com/apache/airflow/pull/69003): @kaxil ## Provider [celery: 3.22.0rc1](https://pypi.org/project/apache-airflow-providers-celery/3.22.0rc1) - [ ] [Honor json_logs config in Celery worker startup (#68916)](https://github.com/apache/airflow/pull/68916): @hanxdatadog Linked issues: - [Linked Issue #68912](https://github.com/apache/airflow/issues/68912): @hanxdatadog - [ ] [Fix Celery worker JSON logging config for teams (#69139)](https://github.com/apache/airflow/pull/69139): @henry3260 - [ ] [Make PostgreSQL SQLAlchemy driver explicit (postgresql+psycopg2://) (#68314)](https://github.com/apache/airflow/pull/68314): @Dev-iL Linked issues: - [Linked Issue #67801](https://github.com/apache/airflow/issues/67801): @Dev-iL - [ ] [docs: clarify Redis maintenance for CeleryExecutor (#67393)](https://github.com/apache/airflow/pull/67393): @Will-thom Linked issues: - [Linked Issue #55215](https://github.com/apache/airflow/issues/55215): @gudata ## Provider [common.ai: 0.6.0rc1](https://pypi.org/project/apache-airflow-providers-common-ai/0.6.0rc1) - [ ] [Add `env_provider` and `Extra.env` support to MCP stdio transport (#69225)](https://github.com/apache/airflow/pull/69225): @kaxil - [ ] [Replace deprecated `pydantic-ai` MCP classes with `MCPToolset` in `common.ai` (#69006)](https://github.com/apache/airflow/pull/69006): @kaxil - [ ] [Migrate common.ai provider to pydantic-ai 2.x and remove the <2 cap (#69358)](https://github.com/apache/airflow/pull/69358): @kaxil Linked issues: - [Linked Issue #68933](https://github.com/apache/airflow/pull/68933): @github-actions[bot] ## Provider [common.compat: 1.16.0rc1](https://pypi.org/project/apache-airflow-providers-common-compat/1.16.0rc1) - [ ] [Added get_async_hook in common.compat provider (#69208)](https://github.com/apache/airflow/pull/69208): @dabla - [ ] [Fix `RecursionError` in `common.compat` hook lineage `add_extra` polyfill (#68735)](https://github.com/apache/airflow/pull/68735): @kaxil ## Provider [common.sql: 2.0.2rc1](https://pypi.org/project/apache-airflow-providers-common-sql/2.0.2rc1) - [ ] [Fix DatabricksSqlHook crash on empty result with fetch_one handler (#69230)](https://github.com/apache/airflow/pull/69230): @moomindani Linked issues: - [Linked Issue #39448](https://github.com/apache/airflow/issues/39448): @KanikaAdik ## Provider [databricks: 7.17.0rc1](https://pypi.org/project/apache-airflow-providers-databricks/7.17.0rc1) - [ ] [Add durable execution to `DatabricksRunNowOperator` (#69174)](https://github.com/apache/airflow/pull/69174): @amoghrajesh Linked issues: - [Linked Issue #68974](https://github.com/apache/airflow/pull/68974): @amoghrajesh - [ ] [Accept BLOCKED and WAITING_FOR_RETRY Databricks run states (#69193)](https://github.com/apache/airflow/pull/69193): @amoghrajesh - [ ] [Add durable execution to DatabricksSubmitRunOperator (#68974)](https://github.com/apache/airflow/pull/68974): @amoghrajesh - [ ] [Add proxy support to Databricks connections (#68527)](https://github.com/apache/airflow/pull/68527): @Vamsi-klu Linked issues: - [Linked Issue #32576](https://github.com/apache/airflow/issues/32576): @sravanscb - [ ] [Surface databricks API errors as a separate exception (#69019)](https://github.com/apache/airflow/pull/69019): @amoghrajesh - [ ] [Add query tags: DatabricksSqlSensor, DatabricksPartitionSensor (#68704)](https://github.com/apache/airflow/pull/68704): @cruseakshay Linked issues: - [Linked Issue #68582](https://github.com/apache/airflow/issues/68582): @zhaorui2022 - [Linked Issue #66895](https://github.com/apache/airflow/pull/66895): @SkastVnT - [ ] [Add OpenLineage Spark conf injection to DatabricksSubmitRunOperator (#67894)](https://github.com/apache/airflow/pull/67894): @rahul-madaan - [ ] [Include last error cause in Databricks API when retry is exhausted (#69238)](https://github.com/apache/airflow/pull/69238): @amoghrajesh - [ ] [Fix DatabricksSqlHook crash on empty result with fetch_one handler (#69230)](https://github.com/apache/airflow/pull/69230): @moomindani Linked issues: - [Linked Issue #39448](https://github.com/apache/airflow/issues/39448): @KanikaAdik - [ ] [Reconnect to blocked Databricks runs in SubmitRunOperator durable retries (#69195)](https://github.com/apache/airflow/pull/69195): @amoghrajesh - [ ] [Fix DatabricksWorkflowTaskGroup ignoring deps set before with block (#68924)](https://github.com/apache/airflow/pull/68924): @moomindani Linked issues: - [Linked Issue #67369](https://github.com/apache/airflow/pull/67369): @shubhgurav0590 - [Linked Issue #51598](https://github.com/apache/airflow/issues/51598): @cshaddox ## Provider [edge3: 4.1.0rc1](https://pypi.org/project/apache-airflow-providers-edge3/4.1.0rc1) - [ ] [Add team_name tag to Edge executor sync metric (#69005)](https://github.com/apache/airflow/pull/69005): @shivaam Linked issues: - [Linked Issue #68593](https://github.com/apache/airflow/pull/68593): @ferruzzi - [Linked Issue #68996](https://github.com/apache/airflow/issues/68996): @ferruzzi ## Provider [elasticsearch: 6.8.0rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/6.8.0rc1) - [ ] [Show running task logs in the UI with Elasticsearch remote logging (#69090)](https://github.com/apache/airflow/pull/69090): @aeroyorch - [ ] [ElasticsearchSQLHook: add chunked Polars DataFrame support via custom SQL reader (#68411)](https://github.com/apache/airflow/pull/68411): @SameerMesiah97 Linked issues: - [Linked Issue #66290](https://github.com/apache/airflow/issues/66290): @SameerMesiah97 - [Linked Issue #66220](https://github.com/apache/airflow/pull/66220): @SameerMesiah97 ## Provider [exasol: 4.10.4rc1](https://pypi.org/project/apache-airflow-providers-exasol/4.10.4rc1) - [ ] [Fix DatabricksSqlHook crash on empty result with fetch_one handler (#69230)](https://github.com/apache/airflow/pull/69230): @moomindani Linked issues: - [Linked Issue #39448](https://github.com/apache/airflow/issues/39448): @KanikaAdik ## Provider [fab: 3.7.2rc1](https://pypi.org/project/apache-airflow-providers-fab/3.7.2rc1) - [ ] [Fix DAG named "DAGs" colliding with the global DAGs permission resource (#69106)](https://github.com/apache/airflow/pull/69106): @potiuk ## Provider [ftp: 3.15.2rc1](https://pypi.org/project/apache-airflow-providers-ftp/3.15.2rc1) - [ ] [Close FTP file handles when a transfer raises (#69083)](https://github.com/apache/airflow/pull/69083): @itej13 Linked issues: - [Linked Issue #69077](https://github.com/apache/airflow/issues/69077): @goransh-buh ## Provider [git: 0.4.1rc1](https://pypi.org/project/apache-airflow-providers-git/0.4.1rc1) - [ ] [Verify SSH host keys by default in the Git provider hook (#69103)](https://github.com/apache/airflow/pull/69103): @ephraimbuddy ## Provider [google: 22.2.2rc1](https://pypi.org/project/apache-airflow-providers-google/22.2.2rc1) - [ ] [Log SQL query on its own line in BigQueryInsertJobOperator (#69386)](https://github.com/apache/airflow/pull/69386): @AlejandroMorgante Linked issues: - [Linked Issue #43953](https://github.com/apache/airflow/pull/43953): @moiseenkov ## Provider [imap: 3.12.0rc1](https://pypi.org/project/apache-airflow-providers-imap/3.12.0rc1) - [ ] [Add overwrite parameter to IMAP hook to prevent silent file overwrites #65870 (#68838)](https://github.com/apache/airflow/pull/68838): @kada2004 Linked issues: - [Linked Issue #65870](https://github.com/apache/airflow/issues/65870): @vaefremov95 ## Provider [microsoft.azure: 13.5.1rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/13.5.1rc1) - [ ] [Fixed KiotaRequestAdapterHook _is_http_client_closed method wrongly returning True when transport was not opened yet (#69329)](https://github.com/apache/airflow/pull/69329): @dabla - [ ] [Invalidate cached RequestAdapter of KiotaRequestAdapterHook if session of AuthenticationProvider is closed (#69128)](https://github.com/apache/airflow/pull/69128): @dabla - [ ] [Fix msgraph/Power BI auth failure from empty allowed_hosts list (#69014)](https://github.com/apache/airflow/pull/69014): @davidnzhang - [ ] [Fix UnicodeDecodeError in DefaultResponseHandler when response content is binary (#68495)](https://github.com/apache/airflow/pull/68495): @davidnzhang ## Provider [microsoft.winrm: 3.14.4rc1](https://pypi.org/project/apache-airflow-providers-microsoft-winrm/3.14.4rc1) - [ ] [Fix Microsoft WinRM provider import failure under lowest dependencies (#69333)](https://github.com/apache/airflow/pull/69333): @potiuk Linked issues: - [Linked Issue #64643](https://github.com/apache/airflow/pull/64643): @haseebmalik18 ## Provider [neo4j: 3.12.0rc1](https://pypi.org/project/apache-airflow-providers-neo4j/3.12.0rc1) - [ ] [Rename Neo4jOperator `sql` parameter to `cypher` (#68970)](https://github.com/apache/airflow/pull/68970): @eladkal Linked issues: - [Linked Issue #39860](https://github.com/apache/airflow/issues/39860): @ThomasThelen ## Provider [openai: 1.8.0rc1](https://pypi.org/project/apache-airflow-providers-openai/1.8.0rc1) - [ ] [Deprecate OpenAI Assistants and Threads hook methods (#69071)](https://github.com/apache/airflow/pull/69071): @kaxil Linked issues: - [Linked Issue #69068](https://github.com/apache/airflow/pull/69068): @kaxil - [Linked Issue #69070](https://github.com/apache/airflow/pull/69070): @kaxil - [ ] [Add OpenAI Responses and Conversations support (#69070)](https://github.com/apache/airflow/pull/69070): @kaxil Linked issues: - [Linked Issue #69068](https://github.com/apache/airflow/pull/69068): @kaxil - [ ] [Add Workload Identity authentication to OpenAI provider (#69069)](https://github.com/apache/airflow/pull/69069): @kaxil Linked issues: - [Linked Issue #69068](https://github.com/apache/airflow/pull/69068): @kaxil - [ ] [Update OpenAI provider to OpenAI Python SDK 2.x (#69068)](https://github.com/apache/airflow/pull/69068): @kaxil ## Provider [openlineage: 2.19.0rc1](https://pypi.org/project/apache-airflow-providers-openlineage/2.19.0rc1) - [ ] [Add unified emission_policy config for OpenLineage provider (#66992)](https://github.com/apache/airflow/pull/66992): @kacpermuda - [ ] [Add OpenLineage Spark conf injection to DatabricksSubmitRunOperator (#67894)](https://github.com/apache/airflow/pull/67894): @rahul-madaan ## Provider [opensearch: 1.11.0rc1](https://pypi.org/project/apache-airflow-providers-opensearch/1.11.0rc1) - [ ] [Show running task logs in the UI with OpenSearch remote logging (#69407)](https://github.com/apache/airflow/pull/69407): @aeroyorch Linked issues: - [Linked Issue #69090](https://github.com/apache/airflow/pull/69090): @aeroyorch - [ ] [opensearch: generalize extra parameters (#65613)](https://github.com/apache/airflow/pull/65613): @DonHaul ## Provider [oracle: 4.6.2rc1](https://pypi.org/project/apache-airflow-providers-oracle/4.6.2rc1) - [ ] [Use oracledb AuthMode/Purity enums in Oracle hook connection config (#67689)](https://github.com/apache/airflow/pull/67689): @ed-kyu ## Provider [postgres: 7.0.0rc1](https://pypi.org/project/apache-airflow-providers-postgres/7.0.0rc1) - [ ] [Switch the default async Postgres driver from asyncpg to psycopg3 (provider) (#69089)](https://github.com/apache/airflow/pull/69089): @Dev-iL ## Provider [smtp: 3.0.2rc1](https://pypi.org/project/apache-airflow-providers-smtp/3.0.2rc1) - [ ] [Fixed "AttributeError: 'NoneType' object has no attribute 'close'" for SmtpHook (#62409)](https://github.com/apache/airflow/pull/62409): @TopCoder2K ## Provider [snowflake: 6.15.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/6.15.0rc1) - [ ] [Add SnowparkContainerJobOperator (#68259)](https://github.com/apache/airflow/pull/68259): @justinpakzad - [ ] [Add SnowflakeCortexAgentHook (#68942)](https://github.com/apache/airflow/pull/68942): @SameerMesiah97 - [ ] [Fix SnowflakeSqlApiOperator polling to avoid needless sleeps (#69450)](https://github.com/apache/airflow/pull/69450): @amoghrajesh - [ ] [Fix DatabricksSqlHook crash on empty result with fetch_one handler (#69230)](https://github.com/apache/airflow/pull/69230): @moomindani Linked issues: - [Linked Issue #39448](https://github.com/apache/airflow/issues/39448): @KanikaAdik - [ ] [SnowflakeHook: refactor static connection parameter construction (#68597)](https://github.com/apache/airflow/pull/68597): @SameerMesiah97 - [ ] [SnowflakeHook: extract OAuth token lifecycle management into dedicated helper (#68549)](https://github.com/apache/airflow/pull/68549): @SameerMesiah97 ## Provider [ssh: 5.0.4rc1](https://pypi.org/project/apache-airflow-providers-ssh/5.0.4rc1) - [ ] [Fix `SSHRemoteJobOperator` orphaning the remote job on cancellation (#68644)](https://github.com/apache/airflow/pull/68644): @kaxil ## Provider [standard: 1.16.0rc1](https://pypi.org/project/apache-airflow-providers-standard/1.16.0rc1) - [ ] [Propagate `partition_date` to consumers of partitioned assets (#67285)](https://github.com/apache/airflow/pull/67285): @nathadfield Linked issues: - [Linked Issue #68266](https://github.com/apache/airflow/pull/68266): @Lee-W - [Linked Issue #67239](https://github.com/apache/airflow/issues/67239): @nathadfield ## Provider [tableau: 5.6.0rc1](https://pypi.org/project/apache-airflow-providers-tableau/5.6.0rc1) - [ ] [Add timeout and exponential backoff to Tableau refresh wait (#69479)](https://github.com/apache/airflow/pull/69479): @jayamanikharyono - [ ] [Import tableauserverclient lazily in TableauHook (#68971)](https://github.com/apache/airflow/pull/68971): @potiuk <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @AlejandroMorgante @bentorb @TopCoder2K @aeroyorch @nathadfield @jayamanikharyono @gocoolp @DonHaul @bhavya2109sharma @davidnzhang @cruseakshay @henry3260 @justinpakzad @shivaam @kada2004 @Samin061 @shahar1 @Will-thom @potiuk @amoghrajesh @Dev-iL @steveahnahn @Vamsi-klu @SameerMesiah97 @kacpermuda @rahul-madaan @itej13 @dabla @eladkal @jason810496 @ellisms @ephraimbuddy @ambaena @kaxil @kakatur @hanxdatadog @ed-kyu @moomindani @o-nikolas -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
