potiuk opened a new issue, #70953: URL: https://github.com/apache/airflow/issues/70953
I have a kind request for all the contributors to the latest provider distributions release. Could you please help us to test the RC versions of the providers? The guidelines on how to test providers can be found in [Verify providers by contributors](https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDERS.md#verify-the-release-candidate-by-contributors) Let us know in the comments, whether the issue is addressed. These are providers that require testing as there were some substantial changes introduced: ## Provider [airbyte: 6.0.1rc1](https://pypi.org/project/apache-airflow-providers-airbyte/6.0.1rc1) - [ ] [Fix AirbyteJobSensor marking a cancelled job as success in deferrable mode (#69786)](https://github.com/apache/airflow/pull/69786): @steveahnahn Linked issues: - [Linked Issue #64051](https://github.com/apache/airflow/pull/64051): @SameerMesiah97 ## Provider [alibaba: 3.4.0rc1](https://pypi.org/project/apache-airflow-providers-alibaba/3.4.0rc1) - [ ] [Add OSSRemoteLogIO.from_config and register oss remote logging scheme (#70682)](https://github.com/apache/airflow/pull/70682): @baha-bouali Linked issues: - [Linked Issue #67056](https://github.com/apache/airflow/pull/67056): @jason810496 - [Linked Issue #70265](https://github.com/apache/airflow/issues/70265): @jason810496 - [Linked Issue #70269](https://github.com/apache/airflow/issues/70269): @jason810496 ## Provider [amazon: 9.34.0rc1](https://pypi.org/project/apache-airflow-providers-amazon/9.34.0rc1) - [ ] [Cancel the Redshift statement when a user kills the deferred task (#69676)](https://github.com/apache/airflow/pull/69676): @steveahnahn - [ ] [Support setting an S3 object ACL for remote task logs (#70394)](https://github.com/apache/airflow/pull/70394): @FrankYang0529 Linked issues: - [Linked Issue #8917](https://github.com/apache/airflow/issues/8917): @kuhnhu - [ ] [Add `DmsReloadTablesOperator` (#70569)](https://github.com/apache/airflow/pull/70569): @AlejandroMorgante - [ ] [Add deferrable mode to DynamoDBValueSensor (#69799)](https://github.com/apache/airflow/pull/69799): @harshhh817 Linked issues: - [Linked Issue #69051](https://github.com/apache/airflow/issues/69051): @gocoolp - [ ] [Refuse the team agnostic fall-through for a team scoped AWS secret name (#70878)](https://github.com/apache/airflow/pull/70878): @potiuk - [ ] [Retry EKS resource deletion on transient ResourceInUseException (#70260)](https://github.com/apache/airflow/pull/70260): @ramitkataria - [ ] [Apply SageMaker operator template-field checks after rendering (#70485)](https://github.com/apache/airflow/pull/70485): @mitre88 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Resolve S3ToRedshiftOperator connection and kwargs after template rendering (#70486)](https://github.com/apache/airflow/pull/70486): @mitre88 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Move AwsToAwsBaseOperator fallback out of init (#70445)](https://github.com/apache/airflow/pull/70445): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Fix EcsRunTaskOperator deferred logs read from the wrong region (#70474)](https://github.com/apache/airflow/pull/70474): @ColtenOuO Linked issues: - [Linked Issue #70464](https://github.com/apache/airflow/pull/70464): @fat-catTW - [Linked Issue #70465](https://github.com/apache/airflow/issues/70465): @shahar1 - [ ] [Allow templated fields in AppFlow operators (#70440)](https://github.com/apache/airflow/pull/70440): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Fix EcsRunTaskOperator deferred-logs region and template field init (#70464)](https://github.com/apache/airflow/pull/70464): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Fix MongoToS3Operator aggregate-pipeline detection before rendering (#70330)](https://github.com/apache/airflow/pull/70330): @MannXo Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Strip GlueDataQualityOperator ruleset after rendering (#70331)](https://github.com/apache/airflow/pull/70331): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Move template-field validation/transformation out of init for Amazon Bedrock operators (#70306)](https://github.com/apache/airflow/pull/70306): @Avcu Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Move template-field validation out of init for Amazon DataSync operator (#70324)](https://github.com/apache/airflow/pull/70324): @Avcu Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Keep S3DeleteObjectsOperator validation in __init__, narrow to ValueError (#70359)](https://github.com/apache/airflow/pull/70359): @AmoghAtreya Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Rename StepFunctionStartExecutionOperator's input field to match its constructor argument (#70544)](https://github.com/apache/airflow/pull/70544): @bramhanandlingala Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Fix mypy arg-type error in Redshift Data get_primary_keys (#70677)](https://github.com/apache/airflow/pull/70677): @Lee-W - [ ] [Add IMPORT_ERRORS_ALL permission for import errors of files with no registered Dag (#69790)](https://github.com/apache/airflow/pull/69790): @potiuk Linked issues: - [Linked Issue #67461](https://github.com/apache/airflow/issues/67461): @potiuk - [ ] [Move amazon dms operators template-field validation to execute() (#70450)](https://github.com/apache/airflow/pull/70450): @ahilashsasidharan Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Revert DMS provision checks to __init__ with is not None polarity (#70634)](https://github.com/apache/airflow/pull/70634): @ahilashsasidharan Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [Linked Issue #70503](https://github.com/apache/airflow/issues/70503): @shahar1 - [ ] [Document effect of state-store cleanup for operators with durable execution (#70721)](https://github.com/apache/airflow/pull/70721): @amoghrajesh - [ ] [Remove hard-coded deferrable crawler run from example_glue system test (#70206)](https://github.com/apache/airflow/pull/70206): @seanghaeli Linked issues: - [Linked Issue #69930](https://github.com/apache/airflow/pull/69930): @AlejandroMorgante ## Provider [anthropic: 0.2.1rc1](https://pypi.org/project/apache-airflow-providers-anthropic/0.2.1rc1) - [ ] [Move template-field validation out of AnthropicAgentSessionOperator __init__ (#70432)](https://github.com/apache/airflow/pull/70432): @bramhanandlingala Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [apache.hdfs: 4.12.2rc1](https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.12.2rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [apache.hive: 9.6.1rc1](https://pypi.org/project/apache-airflow-providers-apache-hive/9.6.1rc1) - [ ] [Move template-field checks out of __init__ in Hive sensors (#70334)](https://github.com/apache/airflow/pull/70334): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [apache.kafka: 1.15.1rc1](https://pypi.org/project/apache-airflow-providers-apache-kafka/1.15.1rc1) - [ ] [Fix Kafka consumer not being closed on error in ConsumeFromTopicOperator (#69641)](https://github.com/apache/airflow/pull/69641): @TimurRakhmatullin86 Linked issues: - [Linked Issue #64612](https://github.com/apache/airflow/pull/64612): @jason810496 - [ ] [Fix AwaitMessageTrigger crash on tombstone messages when apply_function is unset (#69665)](https://github.com/apache/airflow/pull/69665): @TimurRakhmatullin86 Linked issues: - [Linked Issue #55437](https://github.com/apache/airflow/pull/55437): @vincbeck - [ ] [Fix KafkaBaseHook.test_connection missing oauth_cb for managed Kafka (#69507)](https://github.com/apache/airflow/pull/69507): @TimurRakhmatullin86 - [ ] [Fix AwaitMessageTriggerFunctionSensor not honoring timeout (#69639)](https://github.com/apache/airflow/pull/69639): @TimurRakhmatullin86 Linked issues: - [Linked Issue #62104](https://github.com/apache/airflow/pull/62104): @Pranaykarvi - [Linked Issue #62097](https://github.com/apache/airflow/issues/62097): @pereisergio - [ ] [Validate ProduceToTopicOperator topic after rendering (#70333)](https://github.com/apache/airflow/pull/70333): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [apache.livy: 4.6.0rc1](https://pypi.org/project/apache-airflow-providers-apache-livy/4.6.0rc1) - [ ] [Reconnect to the running Livy batch on retry instead of resubmitting (#68956)](https://github.com/apache/airflow/pull/68956): @1fanwang ## Provider [apache.spark: 6.3.1rc1](https://pypi.org/project/apache-airflow-providers-apache-spark/6.3.1rc1) - [ ] [Anchor spark-submit log trail on actual exception instead of lines (#70513)](https://github.com/apache/airflow/pull/70513): @amoghrajesh - [ ] [Decouple SparkSubmitOperator resumable deployment backends (#68679)](https://github.com/apache/airflow/pull/68679): @onlyarnav Linked issues: - [Linked Issue #68505](https://github.com/apache/airflow/issues/68505): @jason810496 - [ ] [Drop unused post_submit_commands copy from SparkSubmitOperator init (#70323)](https://github.com/apache/airflow/pull/70323): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [arangodb: 2.9.6rc1](https://pypi.org/project/apache-airflow-providers-arangodb/2.9.6rc1) - [ ] [Use ValueError when no ArangoDB collection operation is specified (#70539)](https://github.com/apache/airflow/pull/70539): @mitre88 Linked issues: - [Linked Issue #66279](https://github.com/apache/airflow/pull/66279): @justinpakzad ## Provider [celery: 3.23.1rc1](https://pypi.org/project/apache-airflow-providers-celery/3.23.1rc1) - [ ] [Honor verbose logging for Celery workers (#69828)](https://github.com/apache/airflow/pull/69828): @jx2lee Linked issues: - [Linked Issue #46990](https://github.com/apache/airflow/issues/46990): @dstandish ## Provider [clickhousedb: 1.0.1rc2](https://pypi.org/project/apache-airflow-providers-clickhousedb/1.0.1rc2) - [ ] [Change Clickhouse lifecycle to incubation (#69166)](https://github.com/apache/airflow/pull/69166): @eladkal ## Provider [cncf.kubernetes: 10.21.0rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/10.21.0rc1) - [ ] [Add `--min-completed-minutes` to `cleanup-pods` to prevent KPO race condition (#70595)](https://github.com/apache/airflow/pull/70595): @noamst-monday Linked issues: - [Linked Issue #69269](https://github.com/apache/airflow/pull/69269): @noah-gil - [ ] [Add opt-in concurrent pod creation to KubernetesExecutor (#68480)](https://github.com/apache/airflow/pull/68480): @1fanwang - [ ] [Prevent deferrable `KubernetesPodOperator` log parsing from blocking the triggerer event loop (#69661)](https://github.com/apache/airflow/pull/69661): @aeroyorch - [ ] [Fix KubernetesPodOperator dry_run requiring live Kubernetes API client (#70234)](https://github.com/apache/airflow/pull/70234): @Aaryan123456679 Linked issues: - [Linked Issue #45812](https://github.com/apache/airflow/issues/45812): @baryluk - [ ] [Build KubernetesInstallKueueOperator manifest URL after rendering (#70335)](https://github.com/apache/airflow/pull/70335): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Mark KubernetesPodOperator and AgentOperator as durable capable (#70289)](https://github.com/apache/airflow/pull/70289): @amoghrajesh - [ ] [Validate KubernetesResourceBaseOperator yaml_conf after rendering (#70337)](https://github.com/apache/airflow/pull/70337): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Document Kubernetes RBAC permissions (#68716)](https://github.com/apache/airflow/pull/68716): @dhkim1920 Linked issues: - [Linked Issue #40210](https://github.com/apache/airflow/issues/40210): @pykenny - [ ] [Documenting effect if task state store cleanup for KPO (#70722)](https://github.com/apache/airflow/pull/70722): @amoghrajesh ## Provider [cohere: 1.6.7rc1](https://pypi.org/project/apache-airflow-providers-cohere/1.6.7rc1) - [ ] [Fix CohereEmbeddingOperator input_text normalization before rendering (#70325)](https://github.com/apache/airflow/pull/70325): @MannXo Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [common.ai: 0.7.0rc2](https://pypi.org/project/apache-airflow-providers-common-ai/0.7.0rc2) - [ ] [Add pydantic-ai capability matrix references doc to Common AI (#69887)](https://github.com/apache/airflow/pull/69887): @gopidesupavan - [ ] [Support excluding files from `common.ai` Agent Skills discovery (#69924)](https://github.com/apache/airflow/pull/69924): @kaxil - [ ] [Use task state store for `common.ai` durable execution on Airflow 3.3+ (#68926)](https://github.com/apache/airflow/pull/68926): @kaxil - [ ] [Support .txt files in LLMFileAnalysisOperator (#70431)](https://github.com/apache/airflow/pull/70431): @ColtenOuO - [ ] [Support cloud URI globs in DocumentLoaderOperator (#70299)](https://github.com/apache/airflow/pull/70299): @guan404ming - [x] [Allow Common AI SQL imports without DataFusion (#69990)](https://github.com/apache/airflow/pull/69990): @aaron-y-chen - [x] [Fix HITL review showing altered agent output to reviewers (#70070)](https://github.com/apache/airflow/pull/70070): @guan404ming - [x] [Fix LLMSQLQueryOperator not stripping single-line markdown code fences (#70137)](https://github.com/apache/airflow/pull/70137): @ColtenOuO - [ ] [Harden common.ai SQLToolset allowed_tables against function/COPY bypass (#70134)](https://github.com/apache/airflow/pull/70134): @kaxil - [x] [Preserve output_type through human approval in LLM operators (#70075)](https://github.com/apache/airflow/pull/70075): @guan404ming - [ ] [Fix DocumentLoaderOperator ignoring unknown parser on byte input (#70071)](https://github.com/apache/airflow/pull/70071): @guan404ming - [x] [Reject unsupported require_approval in common.ai operators (#70069)](https://github.com/apache/airflow/pull/70069): @guan404ming - [x] [Fix `@task.llm_branch` import failure on Task SDK-only workers (#70068)](https://github.com/apache/airflow/pull/70068): @guan404ming - [ ] [Fix `common.ai` durable execution skipping Toolset-capability tools (#69881)](https://github.com/apache/airflow/pull/69881): @kaxil - [ ] [Redact secrets from LLMRetryPolicy classification prompts (#70229)](https://github.com/apache/airflow/pull/70229): @Lee-W - [ ] [Validate common AI tool-call arguments to enable pydantic-ai retries (#70096)](https://github.com/apache/airflow/pull/70096): @zozo123 - [ ] [Validate template fields after rendering in common.ai operators (#70338)](https://github.com/apache/airflow/pull/70338): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Add dataclasses-json floor to common.ai llamaindex extra (#69755)](https://github.com/apache/airflow/pull/69755): @FrankYang0529 - [ ] [Add a Retry Policies category to the provider registry (#70499)](https://github.com/apache/airflow/pull/70499): @Lee-W - [ ] [Remove noqa:S101 from production code (#70378)](https://github.com/apache/airflow/pull/70378): @Lee-W - [ ] [Mark KubernetesPodOperator and AgentOperator as durable capable (#70289)](https://github.com/apache/airflow/pull/70289): @amoghrajesh - [ ] [Add self-hosted model guide for the common.ai provider (#69867)](https://github.com/apache/airflow/pull/69867): @Lee-W - [ ] [Update retired model ids and fill doc gaps in common.ai provider docs (#69711)](https://github.com/apache/airflow/pull/69711): @Lee-W - [ ] [Add quick start guide to common.ai provider docs (#69552)](https://github.com/apache/airflow/pull/69552): @Lee-W - [x] [Document the dynamic `system_prompt` pattern for common-ai agents (#69636)](https://github.com/apache/airflow/pull/69636): @jason810496 - [ ] [Add an Examples entry point to the common.ai provider docs (#69650)](https://github.com/apache/airflow/pull/69650): @Lee-W - [ ] [Document the sql extra required for LLMSQLQueryOperator (#70564)](https://github.com/apache/airflow/pull/70564): @jedcunningham ## Provider [common.compat: 1.18.0rc1](https://pypi.org/project/apache-airflow-providers-common-compat/1.18.0rc1) - [ ] [Gate audit log rows not tied to a Dag on a dedicated AccessView (#70759)](https://github.com/apache/airflow/pull/70759): @potiuk - [ ] [Add IMPORT_ERRORS_ALL permission for import errors of files with no registered Dag (#69790)](https://github.com/apache/airflow/pull/69790): @potiuk Linked issues: - [Linked Issue #67461](https://github.com/apache/airflow/issues/67461): @potiuk ## Provider [common.sql: 2.1.0rc1](https://pypi.org/project/apache-airflow-providers-common-sql/2.1.0rc1) - [ ] [Add SQLBulkLoadOperator to Common SQL Provider (#69362)](https://github.com/apache/airflow/pull/69362): @SameerMesiah97 - [ ] [Fix SQLColumnCheckOperator crash on non-numeric column bounds (#70895)](https://github.com/apache/airflow/pull/70895): @shahar1 Linked issues: - [Linked Issue #69736](https://github.com/apache/airflow/pull/69736): @steveahnahn - [ ] [Fix SQL check tolerance for negative expected values (#69736)](https://github.com/apache/airflow/pull/69736): @steveahnahn Linked issues: - [Linked Issue #69675](https://github.com/apache/airflow/pull/69675): @steveahnahn - [ ] [Fix SQL value checks for negative expected values (#69893)](https://github.com/apache/airflow/pull/69893): @aaron-y-chen - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [databricks: 7.18.1rc1](https://pypi.org/project/apache-airflow-providers-databricks/7.18.1rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Review and update constraint dependencies (#70652)](https://github.com/apache/airflow/pull/70652): @potiuk - [ ] [Validate DatabricksSQLStatementsSensor statement fields after rendering (#70340)](https://github.com/apache/airflow/pull/70340): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Validate DatabricksCopyIntoOperator template fields after rendering (#70339)](https://github.com/apache/airflow/pull/70339): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Document effect of state-store cleanup for operators with durable execution (#70721)](https://github.com/apache/airflow/pull/70721): @amoghrajesh - [ ] [Docs: clarify Databricks retry_delay uses exponential backoff (#68622)](https://github.com/apache/airflow/pull/68622): @sduvvuri26 ## Provider [dbt.cloud: 4.9.3rc1](https://pypi.org/project/apache-airflow-providers-dbt-cloud/4.9.3rc1) - [ ] [Fix DbtCloudRunJobOperator having false failures during deferred polling (#70581)](https://github.com/apache/airflow/pull/70581): @amoghrajesh Linked issues: - [Linked Issue #70398](https://github.com/apache/airflow/issues/70398): @beaglebay - [ ] [Derive DbtCloudGetJobRunArtifactOperator default file name after rendering (#70336)](https://github.com/apache/airflow/pull/70336): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [docker: 4.5.9rc1](https://pypi.org/project/apache-airflow-providers-docker/4.5.9rc1) - [ ] [Handle DockerOperator mounts after rendering instead of in __init__ (#70342)](https://github.com/apache/airflow/pull/70342): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [edge3: 4.3.0rc1](https://pypi.org/project/apache-airflow-providers-edge3/4.3.0rc1) - [ ] [Add queue parameter to edge list-workers subcommand (#70436)](https://github.com/apache/airflow/pull/70436): @shubhamraj-git - [ ] [edge3: Exit non-zero when worker admin CLI commands fail (#70112)](https://github.com/apache/airflow/pull/70112): @dkranchii - [ ] [Add team_name tag to remaining multi-team metrics (#69943)](https://github.com/apache/airflow/pull/69943): @Tegh25 Linked issues: - [Linked Issue #68294](https://github.com/apache/airflow/issues/68294): @stephen-bracken ## Provider [elasticsearch: 6.9.0rc1](https://pypi.org/project/apache-airflow-providers-elasticsearch/6.9.0rc1) - [ ] [Add ElasticsearchRemoteLogIO.from_config and register elasticsearch scheme (#70525)](https://github.com/apache/airflow/pull/70525): @yuseok89 Linked issues: - [Linked Issue #67056](https://github.com/apache/airflow/pull/67056): @jason810496 - [Linked Issue #70265](https://github.com/apache/airflow/issues/70265): @jason810496 - [Linked Issue #70271](https://github.com/apache/airflow/issues/70271): @jason810496 - [ ] [Do not show @timestamp in logs in UI (#70790)](https://github.com/apache/airflow/pull/70790): @k-popov - [ ] [Clarify Elasticsearch remote-logging scheme needs Airflow 3.3.0+ (#70920)](https://github.com/apache/airflow/pull/70920): @jason810496 Linked issues: - [Linked Issue #70525](https://github.com/apache/airflow/pull/70525): @yuseok89 ## Provider [exasol: 4.10.5rc1](https://pypi.org/project/apache-airflow-providers-exasol/4.10.5rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [fab: 3.8.0rc1](https://pypi.org/project/apache-airflow-providers-fab/3.8.0rc1) - [ ] [Gate audit log rows not tied to a Dag on a dedicated AccessView (#70759)](https://github.com/apache/airflow/pull/70759): @potiuk - [ ] [Add IMPORT_ERRORS_ALL permission for import errors of files with no registered Dag (#69790)](https://github.com/apache/airflow/pull/69790): @potiuk Linked issues: - [Linked Issue #67461](https://github.com/apache/airflow/issues/67461): @potiuk - [ ] [Add `get_display_name` to `BaseUser` interface (#70583)](https://github.com/apache/airflow/pull/70583): @pierrejeambrun Linked issues: - [Linked Issue #68833](https://github.com/apache/airflow/pull/68833): @VladaZakharova - [ ] [Fix asset state store writes forbidden under FAB auth manager (#70478)](https://github.com/apache/airflow/pull/70478): @justinpakzad ## Provider [git: 0.4.2rc1](https://pypi.org/project/apache-airflow-providers-git/0.4.2rc1) - [ ] [git dag bundle to use the private key in submodule pull (#62938)](https://github.com/apache/airflow/pull/62938): @Pandry ## Provider [google: 22.3.0rc2](https://pypi.org/project/apache-airflow-providers-google/22.3.0rc2) - [x] [Emit per-statement OpenLineage events for BigQuery script jobs (#69234)](https://github.com/apache/airflow/pull/69234): @aaron-y-chen Linked issues: - [Linked Issue #47579](https://github.com/apache/airflow/issues/47579): @luke-hoffman1 - [x] [Add Vertex AI Agent Engine operators (Create, Get, Query, Update, Delete) (#68479)](https://github.com/apache/airflow/pull/68479): @AlejandroMorgante - [x] [Adding durable execution to `BigQueryInsertJobOperator` (#69542)](https://github.com/apache/airflow/pull/69542): @amoghrajesh - [ ] [Register Stackdriver remote task logging handler (#70549)](https://github.com/apache/airflow/pull/70549): @fat-catTW Linked issues: - [Linked Issue #70267](https://github.com/apache/airflow/issues/70267): @jason810496 - [ ] [Add CloudSQLNoOperationInProgressSensor for parallel admin ops (#68151)](https://github.com/apache/airflow/pull/68151): @Vamsi-klu Linked issues: - [Linked Issue #68040](https://github.com/apache/airflow/issues/68040): @radhwene - [Linked Issue #68361](https://github.com/apache/airflow/pull/68361): @radhwene - [ ] [Enable provider-based GCS remote logging resolution (#70504)](https://github.com/apache/airflow/pull/70504): @aaron-y-chen Linked issues: - [Linked Issue #67056](https://github.com/apache/airflow/pull/67056): @jason810496 - [Linked Issue #70265](https://github.com/apache/airflow/issues/70265): @jason810496 - [Linked Issue #70266](https://github.com/apache/airflow/issues/70266): @jason810496 - [x] [Make schema_fields templated in GCSToBigQueryOperator (#69108)](https://github.com/apache/airflow/pull/69108): @nikolauspschuetz Linked issues: - [Linked Issue #31481](https://github.com/apache/airflow/issues/31481): @quantumlicht - [x] [Fix Google Links for Sovereign Cloud (#69805)](https://github.com/apache/airflow/pull/69805): @molcay - [x] [Fix Google Cloud Batch error messages to include job name (#69783)](https://github.com/apache/airflow/pull/69783): @parkhojeong - [ ] [Validate Gemini batch results_folder in the worker that writes results (#70393)](https://github.com/apache/airflow/pull/70393): @shahar1 Linked issues: - [Linked Issue #70362](https://github.com/apache/airflow/pull/70362): @daesung9511 - [ ] [Fail deferred Cloud Composer tasks when the GCP operation errors (#70430)](https://github.com/apache/airflow/pull/70430): @SEPURI-SAI-KRISHNA - [ ] [Apply the team scope in the Google Secret Manager backend (#70869)](https://github.com/apache/airflow/pull/70869): @potiuk - [ ] [Delay BigQueryToMsSqlOperator source table parsing (#70493)](https://github.com/apache/airflow/pull/70493): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Emit GCSToGCSOperator deprecation warnings after rendering (#70449)](https://github.com/apache/airflow/pull/70449): @haseebmalik18 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Emit GCSListObjectsOperator delimiter deprecation warning after rendering (#70533)](https://github.com/apache/airflow/pull/70533): @yuseok89 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Move Compute Engine validation out of constructors (#70454)](https://github.com/apache/airflow/pull/70454): @daesung9511 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Prevent premature validation in Gemini batch job operators (#70362)](https://github.com/apache/airflow/pull/70362): @daesung9511 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Strip only the literal properties/ prefix from GA property link IDs (#70919)](https://github.com/apache/airflow/pull/70919): @Eason09053360 - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Update system test to the latest api version of google-ads (#69865)](https://github.com/apache/airflow/pull/69865): @olegkachur-e - [ ] [Drop redundant BigQueryInsertJobOperator job ID snapshot in __init__ (#70494)](https://github.com/apache/airflow/pull/70494): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Document effect of state-store cleanup for operators with durable execution (#70721)](https://github.com/apache/airflow/pull/70721): @amoghrajesh ## Provider [hashicorp: 4.8.0rc1](https://pypi.org/project/apache-airflow-providers-hashicorp/4.8.0rc1) - [ ] [Support multiple paths fallback in VaultBackend (#70006)](https://github.com/apache/airflow/pull/70006): @BasPH ## Provider [imap: 3.12.1rc1](https://pypi.org/project/apache-airflow-providers-imap/3.12.1rc1) - [ ] [reject mixed-separator path traversal in imap attachment names (#70665)](https://github.com/apache/airflow/pull/70665): @Samin061 - [ ] [check imap attachment symlink on the resolved destination path (#69194)](https://github.com/apache/airflow/pull/69194): @Samin061 ## Provider [keycloak: 0.9.0rc1](https://pypi.org/project/apache-airflow-providers-keycloak/0.9.0rc1) - [ ] [Implement bulk authorization methods in KeycloakAuthManager (#70647)](https://github.com/apache/airflow/pull/70647): @abhishekmauryaKsolves Linked issues: - [Linked Issue #70582](https://github.com/apache/airflow/issues/70582): @stephen-bracken - [ ] [Move keycloak JWT tokens to separate cookies (#70550)](https://github.com/apache/airflow/pull/70550): @stephen-bracken Linked issues: - [Linked Issue #61771](https://github.com/apache/airflow/issues/61771): @exolightor - [ ] [Add KeycloakJWTMiddleware to KeycloakAuthManager (#70800)](https://github.com/apache/airflow/pull/70800): @stephen-bracken Linked issues: - [Linked Issue #70550](https://github.com/apache/airflow/pull/70550): @stephen-bracken - [ ] [Add IMPORT_ERRORS_ALL permission for import errors of files with no registered Dag (#69790)](https://github.com/apache/airflow/pull/69790): @potiuk Linked issues: - [Linked Issue #67461](https://github.com/apache/airflow/issues/67461): @potiuk ## Provider [microsoft.azure: 14.1.0rc1](https://pypi.org/project/apache-airflow-providers-microsoft-azure/14.1.0rc1) - [ ] [Add WasbRemoteLogIO.from_config and register wasb remote logging scheme (#70301)](https://github.com/apache/airflow/pull/70301): @Andrushika Linked issues: - [Linked Issue #67056](https://github.com/apache/airflow/pull/67056): @jason810496 - [Linked Issue #70265](https://github.com/apache/airflow/issues/70265): @jason810496 - [Linked Issue #70268](https://github.com/apache/airflow/issues/70268): @jason810496 - [ ] [Apply the ambiguous-id refusal to get_config in the Key Vault backend (#70899)](https://github.com/apache/airflow/pull/70899): @potiuk Linked issues: - [Linked Issue #70876](https://github.com/apache/airflow/pull/70876): @potiuk - [ ] [Refuse the team agnostic fall-through for a team scoped Key Vault secret name (#70876)](https://github.com/apache/airflow/pull/70876): @potiuk - [ ] [Fix duplicated task logs in the WASB log handler (#70860)](https://github.com/apache/airflow/pull/70860): @bmanan7 Linked issues: - [Linked Issue #67144](https://github.com/apache/airflow/pull/67144): @jvstein - [Linked Issue #70867](https://github.com/apache/airflow/issues/70867): @bmanan7 - [Linked Issue #68304](https://github.com/apache/airflow/pull/68304): @jvstein - [ ] [Validate AzureVirtualMachineStateSensor target_state after rendering (#70329)](https://github.com/apache/airflow/pull/70329): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Fail AzureVirtualMachineStateSensor fast on an invalid target_state (#70372)](https://github.com/apache/airflow/pull/70372): @shahar1 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [Linked Issue #70329](https://github.com/apache/airflow/pull/70329): @1fanwang - [ ] [Use ValueError for unsupported recursive glob in ADLS upload (#70540)](https://github.com/apache/airflow/pull/70540): @mitre88 Linked issues: - [Linked Issue #66279](https://github.com/apache/airflow/pull/66279): @justinpakzad ## Provider [neo4j: 3.12.1rc1](https://pypi.org/project/apache-airflow-providers-neo4j/3.12.1rc1) - [ ] [Show the deprecated Neo4jOperator sql query in Rendered Templates (#70373)](https://github.com/apache/airflow/pull/70373): @shahar1 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [Linked Issue #70348](https://github.com/apache/airflow/pull/70348): @fat-catTW ## Provider [openai: 1.8.2rc1](https://pypi.org/project/apache-airflow-providers-openai/1.8.2rc1) - [ ] [Use monotonic clock for OpenAIBatchTrigger polling timeout (#69534)](https://github.com/apache/airflow/pull/69534): @YAshhh29 Linked issues: - [Linked Issue #69408](https://github.com/apache/airflow/pull/69408): @YAshhh29 - [ ] [Validate trigger events in Openai deferrable tasks (#69506)](https://github.com/apache/airflow/pull/69506): @takayoshi-makabe Linked issues: - [Linked Issue #41554](https://github.com/apache/airflow/pull/41554): @josix - [Linked Issue #69379](https://github.com/apache/airflow/pull/69379): @takayoshi-makabe ## Provider [openlineage: 2.20.0rc2](https://pypi.org/project/apache-airflow-providers-openlineage/2.20.0rc2) - [ ] [OpenLineage: add execute_in_thread to emit task events without forking (#68708)](https://github.com/apache/airflow/pull/68708): @mobuchowski Linked issues: - [Linked Issue #67115](https://github.com/apache/airflow/pull/67115): @AutomationDev85 - [Linked Issue #66572](https://github.com/apache/airflow/pull/66572): @potiuk - [Linked Issue #66573](https://github.com/apache/airflow/pull/66573): @potiuk - [Linked Issue #66574](https://github.com/apache/airflow/pull/66574): @potiuk - [Linked Issue #65714](https://github.com/apache/airflow/pull/65714): @mobuchowski - [ ] [Add team_name tag to OpenLineage metrics (#69109)](https://github.com/apache/airflow/pull/69109): @SameerMesiah97 Linked issues: - [Linked Issue #68996](https://github.com/apache/airflow/issues/68996): @ferruzzi - [ ] [Fix openlineage team name handling, add dag_version_data and TI note (#70772)](https://github.com/apache/airflow/pull/70772): @kacpermuda Linked issues: - [Linked Issue #70760](https://github.com/apache/airflow/pull/70760): @kacpermuda - [Linked Issue #70452](https://github.com/apache/airflow/pull/70452): @SameerMesiah97 - [ ] [OpenLineage: reuse per-process adapter in dag-state-change pool workers (#69283)](https://github.com/apache/airflow/pull/69283): @gang-zh Linked issues: - [Linked Issue #69284](https://github.com/apache/airflow/issues/69284): @gang-zh - [ ] [Fix OpenLineage team_name access and other failing paths (#70626)](https://github.com/apache/airflow/pull/70626): @kacpermuda - [ ] [Bump openlineage libraries to 1.52 in openlineage provider (#70773)](https://github.com/apache/airflow/pull/70773): @kacpermuda - [ ] [Document GlueJobOperator support for OpenLineage Spark injection (#69652)](https://github.com/apache/airflow/pull/69652): @mobuchowski ## Provider [opensearch: 1.11.2rc1](https://pypi.org/project/apache-airflow-providers-opensearch/1.11.2rc1) - [ ] [Do not show @timestamp in logs in UI (#70790)](https://github.com/apache/airflow/pull/70790): @k-popov ## Provider [papermill: 3.13.2rc1](https://pypi.org/project/apache-airflow-providers-papermill/3.13.2rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Fix template-field validation in PapermillOperator (#70435)](https://github.com/apache/airflow/pull/70435): @bramhanandlingala Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [postgres: 7.0.1rc1](https://pypi.org/project/apache-airflow-providers-postgres/7.0.1rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Use built-in exceptions for Postgres hook input validation (#70537)](https://github.com/apache/airflow/pull/70537): @mitre88 Linked issues: - [Linked Issue #66279](https://github.com/apache/airflow/pull/66279): @justinpakzad - [ ] [Document psycopg3 driver switch for PostgresHook connections (#70360)](https://github.com/apache/airflow/pull/70360): @shahar1 Linked issues: - [Linked Issue #69089](https://github.com/apache/airflow/pull/69089): @Dev-iL - [Linked Issue #69526](https://github.com/apache/airflow/pull/69526): @Dev-iL ## Provider [presto: 5.12.1rc1](https://pypi.org/project/apache-airflow-providers-presto/5.12.1rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [salesforce: 5.14.2rc1](https://pypi.org/project/apache-airflow-providers-salesforce/5.14.2rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [sftp: 6.0.1rc1](https://pypi.org/project/apache-airflow-providers-sftp/6.0.1rc1) - [ ] [Fix encrypted private keys in async SFTP hook (#70858)](https://github.com/apache/airflow/pull/70858): @fallintoplace - [ ] [Support Paramiko 5 in SSH and SFTP providers (#69712)](https://github.com/apache/airflow/pull/69712): @shivaam Linked issues: - [Linked Issue #69669](https://github.com/apache/airflow/pull/69669): @shivaam ## Provider [smtp: 3.0.3rc1](https://pypi.org/project/apache-airflow-providers-smtp/3.0.3rc1) - [ ] [escape attachment filename in Content-Disposition header (#69435)](https://github.com/apache/airflow/pull/69435): @Samin061 ## Provider [snowflake: 6.16.0rc1](https://pypi.org/project/apache-airflow-providers-snowflake/6.16.0rc1) - [ ] [Add SnowflakeCortexAgentOperator to Snowflake Provider (#69939)](https://github.com/apache/airflow/pull/69939): @SameerMesiah97 - [ ] [Log check_query_output response via format string in Snowflake SQL API hook (#67848)](https://github.com/apache/airflow/pull/67848): @michaelneely - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Move SnowparkContainerJobOperator template-field validation to execute (#70332)](https://github.com/apache/airflow/pull/70332): @justinpakzad Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Rewrite SnowparkContainerJobOperator exclusivity check and move back … (#70874)](https://github.com/apache/airflow/pull/70874): @ahilashsasidharan Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [Linked Issue #70503](https://github.com/apache/airflow/issues/70503): @shahar1 - [ ] [Document effect of state-store cleanup for operators with durable execution (#70721)](https://github.com/apache/airflow/pull/70721): @amoghrajesh ## Provider [ssh: 6.0.1rc1](https://pypi.org/project/apache-airflow-providers-ssh/6.0.1rc1) - [ ] [Fix SSHRemoteJobOperator cleanup failing with custom remote_base_dir (#69885)](https://github.com/apache/airflow/pull/69885): @harshhh817 Linked issues: - [Linked Issue #69813](https://github.com/apache/airflow/issues/69813): @AchimGaedkeLynker - [ ] [quote remote job paths in posix ssh command builders (#70091)](https://github.com/apache/airflow/pull/70091): @Samin061 - [ ] [Keep SSH remote job running when its PTY session hangs up (#70573)](https://github.com/apache/airflow/pull/70573): @jason810496 - [ ] [Fix template-field validation timing in ssh provider operators (#70315)](https://github.com/apache/airflow/pull/70315): @bramhanandlingala Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Support Paramiko 5 in SSH and SFTP providers (#69712)](https://github.com/apache/airflow/pull/69712): @shivaam Linked issues: - [Linked Issue #69669](https://github.com/apache/airflow/pull/69669): @shivaam ## Provider [standard: 1.17.0rc1](https://pypi.org/project/apache-airflow-providers-standard/1.17.0rc1) - [ ] [WaitSensor - time_to_wait templated (#70480)](https://github.com/apache/airflow/pull/70480): @raphaelauv - [ ] [Read HITLOperator subject/body into the summary lazily (#70345)](https://github.com/apache/airflow/pull/70345): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Make the HITLOperator summary extension point public (#70391)](https://github.com/apache/airflow/pull/70391): @shahar1 Linked issues: - [Linked Issue #70345](https://github.com/apache/airflow/pull/70345): @1fanwang - [ ] [Give each task its own start trigger arguments in standard sensors (#70888)](https://github.com/apache/airflow/pull/70888): @potiuk - [ ] [Deprecating `poll_interval` in `ExternalTaskSensor` for `poke_interval` (#68997)](https://github.com/apache/airflow/pull/68997): @jroachgolf84 Linked issues: - [Linked Issue #68990](https://github.com/apache/airflow/issues/68990): @surendarvarmas - [ ] [Fix BashOperator script detection after templating (#70369)](https://github.com/apache/airflow/pull/70369): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Fix DateTimeSensor crash when target_time renders to a datetime (#70320)](https://github.com/apache/airflow/pull/70320): @1fanwang Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Validate TriggerDagRunOperator logical_date after template rendering (#70490)](https://github.com/apache/airflow/pull/70490): @mitre88 Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [teradata: 3.6.2rc1](https://pypi.org/project/apache-airflow-providers-teradata/3.6.2rc1) - [ ] [Fix BteqOperator declaring template_fields as a bare string (#70862)](https://github.com/apache/airflow/pull/70862): @Eason09053360 - [ ] [Fix Teradata transfer template field initialization (#70392)](https://github.com/apache/airflow/pull/70392): @fat-catTW Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 ## Provider [trino: 6.6.1rc1](https://pypi.org/project/apache-airflow-providers-trino/6.6.1rc1) - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk ## Provider [weaviate: 3.4.1rc1](https://pypi.org/project/apache-airflow-providers-weaviate/3.4.1rc1) - [ ] [Fix WeaviateIngestOperator input_data validation before rendering (#70326)](https://github.com/apache/airflow/pull/70326): @MannXo Linked issues: - [Linked Issue #70296](https://github.com/apache/airflow/issues/70296): @shahar1 - [ ] [Limit pandas to < 3 for DataFrame XComs (#70791)](https://github.com/apache/airflow/pull/70791): @potiuk - [ ] [Fix duplicated and incorrect words in documentation (#70868)](https://github.com/apache/airflow/pull/70868): @Sdnsoumy ## Provider [yandex: 4.5.1rc1](https://pypi.org/project/apache-airflow-providers-yandex/4.5.1rc1) - [ ] [Refuse the team agnostic fall-through for a team scoped Lockbox secret name (#70877)](https://github.com/apache/airflow/pull/70877): @potiuk <!-- NOTE TO RELEASE MANAGER: You can move here the providers that have doc-only changes or for which changes are trivial, and you could assess that they are OK. --> All users involved in the PRs: @aaron-y-chen @shubhamraj-git @potiuk @mobuchowski @aeroyorch @michaelneely @takayoshi-makabe @yuseok89 @bmanan7 @SameerMesiah97 @k-popov @mitre88 @kacpermuda @harshhh817 @jason810496 @olegkachur-e @fat-catTW @guan404ming @raphaelauv @Tegh25 @dhkim1920 @Samin061 @seanghaeli @shivaam @TimurRakhmatullin86 @jx2lee @ramitkataria @sduvvuri26 @Andrushika @molcay @ColtenOuO @dkranchii @onlyarnav @kaxil @eladkal @Avcu @Aaryan123456679 @fallintoplace @Sdnsoumy @steveahnahn @parkhojeong @Eason09053360 @baha-bouali @abhishekmauryaKsolves @Lee-W @gopidesupavan @SEPURI-SAI-KRISHNA @BasPH @zozo123 @bramhanandlingala @1fanwang @jedcunningham @ahilashsasidharan @haseebmalik18 @stephen-bracken @shahar1 @Vamsi-klu @AmoghAtreya @daesung9511 @justinpakzad @Pandry @jroachgolf84 @pierrejeambrun @gang-zh @YAshhh29 @nikolauspschuetz @amoghrajesh @MannXo @FrankYang0529 @AlejandroMorgante @noamst-monday -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
