This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch remove-python-3-7
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard a08f67fb28 Remove Python 3.7 support
add b13fc27e0b Update main with 2.6.0 release details (#30966)
add 817f846e05 Update 2.6.0 release date (#30971)
add ced56ea5a7 Update incorrect config values (#30969)
add 75b613cf34 Add an example for specifying multiple single files (#30982)
add 43916c5034 Optimize deferred execution mode in DbtCloudJobRunSensor
(#30968)
add b4220ef262 Fix a problem where providers list should be empty (#30986)
add 23b5b31d48 Fix `airflow providers get` command output (#30978)
add 607068f4f0 Optimize deferrable execution mode
`AzureDataFactoryPipelineRunStatusSensor` (#30983)
add 9662fd8cc0 bigfix: EMRHook Loop through paginated response to check
for cluster id (#29732)
add d23033cff8 Add ALL_DONE_SETUP_SUCCESS trigger rule (#30270)
add ec7674f111 Remove schema, login, password, port from SQLite operator
doc (#29139)
add 0212b7c14c Fix unable to remove DagRun and TaskInstance with note
(#30987)
add 3ff613f73d Add pre-commit hook to ban usage of unittest.TestCase in
unit tests (#30775)
add b7e5b47e27 Increase timeout for docs-building job (#31002)
add 2f247a2ba2 Add IAM authentication to Amazon Redshift Connection by AWS
Connection (#28187)
add e4d935e490 Add tags param in RedshiftCreateClusterSnapshotOperator
(#31006)
add 6720a90af7 Fix missing models in API documentation. (#31021)
add bef892e9d2 Update aws.rst (#31019)
add ea18edb06f Add missing changelog in 2.6.0 (#31011)
add f4dc3d9703 Fixing link to wrong section (#31029)
add 20b4789ee3 Fix Pool schema OpenAPI spec (#30973)
add eef5bc7f16 Add full automation for min Airflow version for providers
(#30994)
add 366ae51e21 Fix some typos in the cluster policies docs (#31031)
add ffb3b5c515 Update Default airflow version in Helm Chart to 2.6.0
(#30970)
add a8771495b1 Including CrazyLabs as a company that uses Airflow in
INTHEWILD.md (#31036)
add eb7b98d368 Fix problem with displaying graph (#30765)
add 0a30706aa7 Use `AirflowProviderDeprecationWarning` in providers
(#30975)
add ae7e1dbc8a Add pre-commit verify usage of
`AirflowProviderDeprecationWarning` in providers (#30996)
add 6c92efbe8b Small fixes (#31015)
add 2d5166f982 Add extras links to some more EMR Operators and Sensors
(#31032)
add cb71d41c75 Update return types of `get_key` methods on `S3Hook`
(#30923)
add 9637170471 Improve Description of dag_processing.processes Metric in
Docs (#30891)
add 51603efbf7 Allow configuring OpenLineage client from Airflow config.
(#30735)
add ac46902154 Move TaskInstanceKey to a separate file (#31033)
add 91e18bfc3e Add pre-commit to check that aiobotocore is an optional
dependency (#31023)
add 34b6230f3c Fix issue in pre-importing modules in zipfile (#31061)
add 68deb11e4e Add summary of dependencies for ci image build (#30976)
add ab74d1ba98 Add rest endpoint to get option of configuration (#31056)
add 9720705d92 Small typo in setup.py (#31049)
add d6b9ad920d Add pankajkoti to collaborators (#31069)
add 68f0a3a1c8 Extend EMR System Test waiter timeout (#31071)
add 9c5908e050 `StepFunctionStartExecutionOperator`: get logs in case of
failure (#31072)
add e3d9d7dc4c Add template field to S3ToRedshiftOperator (#30781)
add 5b255dcab7 Fix webserver crash when calling get /config (#31057)
add 5383d57e20 Remove feature flag for AIP-52 (#31034)
add 0051e53ad7 Add Phani and Pankaj as collaborators (#31079)
add 800ade7da6 Bump stale bot version to 8 (#31077)
add 2c270db714 support requirepass redis sentinel (#30352)
add 433ed2cf0e [DOC] README - K8S support 2.6.0 (#31085)
add da61bc101e Add Workpath to INTHEWILD.md (#31092)
add 9e43d4aee3 fix EXTRAS_DEPENDENCIES of apache-hive (#31068)
add 793d36f013 Add step to check prerequisites in README (#31088)
add a6be96d928 Temporarily limit botocore upgrades (#31098)
add e126530667 Add support for dynamic tasks with template fields that
contain `pandas.DataFrame` (#30943)
add c99d2d2369 Import aiobotocore only if deferrable is true (#31094)
add 16debb03d6 Fix operator refrence in example_sftp_to_gcs.py (#31096)
add 41c8746442 Format DagBag.dagbag_report() Output (#31095)
add 49cc213919 Revert "Temporarily limit botocore upgrades (#31098)"
(#31103)
add 52eb8a070d Remove Python 3.7 support
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a08f67fb28)
\
N -- N -- N refs/heads/remove-python-3-7 (52eb8a070d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 3 +
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 3 +-
.github/actions/build-ci-images/action.yml | 8 +
.github/workflows/ci.yml | 6 +-
.github/workflows/stale.yml | 2 +-
.pre-commit-config.yaml | 21 ++
CONTRIBUTING.rst | 2 +-
Dockerfile | 2 +-
INTHEWILD.md | 2 +
README.md | 30 +-
RELEASE_NOTES.rst | 290 +++++++++++++++++++
STATIC_CODE_CHECKS.rst | 16 +-
airflow/api_connexion/endpoints/config_endpoint.py | 35 ++-
airflow/api_connexion/openapi/v1.yaml | 60 +++-
airflow/api_internal/endpoints/rpc_api_endpoint.py | 2 +-
airflow/cli/commands/provider_command.py | 5 +-
airflow/compat/functools.py | 7 +-
airflow/compat/functools.pyi | 3 +-
airflow/config_templates/config.yml | 70 ++++-
airflow/config_templates/default_airflow.cfg | 44 ++-
airflow/config_templates/default_celery.py | 16 +-
airflow/configuration.py | 9 +-
airflow/dag_processing/processor.py | 53 +++-
airflow/decorators/base.py | 7 +-
airflow/decorators/setup_teardown.py | 7 -
airflow/example_dags/example_setup_teardown.py | 34 ++-
.../example_setup_teardown_taskflow.py | 74 +++--
airflow/executors/base_executor.py | 3 +-
airflow/executors/celery_executor.py | 3 +-
airflow/executors/celery_kubernetes_executor.py | 3 +-
airflow/executors/dask_executor.py | 2 +-
airflow/executors/debug_executor.py | 3 +-
airflow/executors/kubernetes_executor.py | 2 +-
airflow/executors/local_executor.py | 3 +-
airflow/executors/sequential_executor.py | 2 +-
airflow/jobs/job.py | 2 +-
airflow/kubernetes/kubernetes_helper_functions.py | 2 +-
airflow/models/abstractoperator.py | 22 +-
airflow/models/baseoperator.py | 16 +-
airflow/models/dag.py | 5 +-
airflow/models/dagbag.py | 3 +-
airflow/models/dagrun.py | 7 +-
airflow/models/taskinstance.py | 52 +---
airflow/models/taskinstancekey.py | 54 ++++
airflow/models/xcom.py | 5 +-
airflow/operators/bash.py | 2 +-
airflow/operators/trigger_dagrun.py | 2 +-
airflow/providers/airbyte/__init__.py | 21 ++
airflow/providers/alibaba/__init__.py | 21 ++
.../alibaba/cloud/log/oss_task_handler.py | 2 +-
airflow/providers/alibaba/cloud/sensors/oss_key.py | 2 +-
airflow/providers/amazon/__init__.py | 22 ++
airflow/providers/amazon/aws/hooks/appflow.py | 2 +-
airflow/providers/amazon/aws/hooks/base_aws.py | 11 +-
airflow/providers/amazon/aws/hooks/emr.py | 12 +-
airflow/providers/amazon/aws/hooks/glue_crawler.py | 2 +-
airflow/providers/amazon/aws/hooks/quicksight.py | 2 +-
.../providers/amazon/aws/hooks/redshift_cluster.py | 10 +-
airflow/providers/amazon/aws/hooks/redshift_sql.py | 43 ++-
airflow/providers/amazon/aws/hooks/s3.py | 15 +-
airflow/providers/amazon/aws/links/base_aws.py | 2 +-
airflow/providers/amazon/aws/links/emr.py | 27 ++
.../amazon/aws/log/cloudwatch_task_handler.py | 2 +-
.../providers/amazon/aws/log/s3_task_handler.py | 2 +-
airflow/providers/amazon/aws/operators/appflow.py | 2 +-
airflow/providers/amazon/aws/operators/athena.py | 2 +-
airflow/providers/amazon/aws/operators/batch.py | 6 +-
airflow/providers/amazon/aws/operators/ecs.py | 2 +-
airflow/providers/amazon/aws/operators/eks.py | 4 +-
airflow/providers/amazon/aws/operators/emr.py | 62 +++-
.../providers/amazon/aws/operators/glue_crawler.py | 2 +-
.../amazon/aws/operators/lambda_function.py | 2 +-
.../amazon/aws/operators/redshift_cluster.py | 4 +
.../amazon/aws/operators/redshift_data.py | 2 +-
.../providers/amazon/aws/operators/sagemaker.py | 10 +-
.../amazon/aws/operators/step_function.py | 8 +-
.../amazon/aws/secrets/secrets_manager.py | 7 +-
.../amazon/aws/secrets/systems_manager.py | 2 +-
airflow/providers/amazon/aws/sensors/athena.py | 2 +-
airflow/providers/amazon/aws/sensors/batch.py | 2 +-
.../amazon/aws/sensors/cloud_formation.py | 2 +-
airflow/providers/amazon/aws/sensors/dms.py | 2 +-
airflow/providers/amazon/aws/sensors/dynamodb.py | 2 +-
airflow/providers/amazon/aws/sensors/ec2.py | 2 +-
airflow/providers/amazon/aws/sensors/ecs.py | 2 +-
airflow/providers/amazon/aws/sensors/eks.py | 2 +-
airflow/providers/amazon/aws/sensors/emr.py | 46 ++-
airflow/providers/amazon/aws/sensors/glacier.py | 2 +-
airflow/providers/amazon/aws/sensors/glue.py | 2 +-
.../amazon/aws/sensors/glue_catalog_partition.py | 2 +-
.../providers/amazon/aws/sensors/glue_crawler.py | 2 +-
.../amazon/aws/sensors/lambda_function.py | 2 +-
airflow/providers/amazon/aws/sensors/quicksight.py | 2 +-
airflow/providers/amazon/aws/sensors/rds.py | 2 +-
.../amazon/aws/sensors/redshift_cluster.py | 2 +-
airflow/providers/amazon/aws/sensors/s3.py | 2 +-
airflow/providers/amazon/aws/sensors/sagemaker.py | 2 +-
airflow/providers/amazon/aws/sensors/sqs.py | 5 +-
.../providers/amazon/aws/sensors/step_function.py | 2 +-
airflow/providers/amazon/aws/transfers/base.py | 3 +-
.../amazon/aws/transfers/s3_to_redshift.py | 7 +-
.../providers/amazon/aws/transfers/s3_to_sql.py | 2 +-
.../providers/amazon/aws/transfers/sql_to_s3.py | 12 +-
.../amazon/aws/triggers/redshift_cluster.py | 2 +-
.../amazon/aws/utils/connection_wrapper.py | 18 +-
airflow/providers/amazon/provider.yaml | 2 +
airflow/providers/apache/beam/__init__.py | 21 ++
airflow/providers/apache/cassandra/__init__.py | 22 ++
airflow/providers/apache/drill/__init__.py | 21 ++
airflow/providers/apache/drill/operators/drill.py | 3 +-
airflow/providers/apache/druid/__init__.py | 21 ++
.../apache/druid/operators/druid_check.py | 3 +-
airflow/providers/apache/flink/__init__.py | 21 ++
.../apache/flink/operators/flink_kubernetes.py | 2 +-
airflow/providers/apache/hdfs/__init__.py | 21 ++
airflow/providers/apache/hive/__init__.py | 21 ++
airflow/providers/apache/hive/hooks/hive.py | 6 +-
.../providers/apache/hive/transfers/s3_to_hive.py | 4 +
airflow/providers/apache/impala/__init__.py | 21 ++
airflow/providers/apache/kafka/__init__.py | 21 ++
airflow/providers/apache/kafka/hooks/base.py | 2 +-
airflow/providers/apache/kylin/__init__.py | 22 ++
airflow/providers/apache/livy/__init__.py | 22 ++
airflow/providers/apache/pig/__init__.py | 21 ++
airflow/providers/apache/pinot/__init__.py | 21 ++
airflow/providers/apache/spark/__init__.py | 21 ++
airflow/providers/apache/sqoop/__init__.py | 21 ++
airflow/providers/arangodb/__init__.py | 22 ++
airflow/providers/arangodb/hooks/arangodb.py | 2 +-
airflow/providers/asana/__init__.py | 21 ++
airflow/providers/asana/hooks/asana.py | 3 +-
airflow/providers/atlassian/jira/__init__.py | 22 ++
airflow/providers/celery/__init__.py | 21 ++
airflow/providers/cloudant/__init__.py | 21 ++
airflow/providers/cncf/kubernetes/__init__.py | 21 ++
.../providers/cncf/kubernetes/hooks/kubernetes.py | 6 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 3 +-
airflow/providers/cncf/kubernetes/operators/pod.py | 12 +-
.../cncf/kubernetes/triggers/kubernetes_pod.py | 3 +-
.../providers/cncf/kubernetes/utils/pod_manager.py | 4 +-
airflow/providers/common/sql/__init__.py | 22 ++
airflow/providers/common/sql/hooks/sql.py | 3 +-
airflow/providers/common/sql/operators/sql.py | 2 +-
airflow/providers/databricks/__init__.py | 21 ++
.../providers/databricks/hooks/databricks_base.py | 2 +-
.../providers/databricks/operators/databricks.py | 10 +-
.../databricks/operators/databricks_repos.py | 2 +-
.../providers/databricks/sensors/databricks_sql.py | 2 +-
airflow/providers/datadog/__init__.py | 21 ++
airflow/providers/dbt/cloud/__init__.py | 22 ++
airflow/providers/dbt/cloud/hooks/dbt.py | 3 +-
airflow/providers/dbt/cloud/sensors/dbt.py | 29 +-
airflow/providers/dingding/__init__.py | 21 ++
airflow/providers/discord/__init__.py | 21 ++
airflow/providers/docker/__init__.py | 21 ++
airflow/providers/docker/hooks/docker.py | 2 +-
airflow/providers/docker/operators/docker.py | 10 +-
airflow/providers/elasticsearch/__init__.py | 21 ++
.../providers/elasticsearch/hooks/elasticsearch.py | 5 +-
.../providers/elasticsearch/log/es_task_handler.py | 3 +-
airflow/providers/exasol/__init__.py | 22 ++
airflow/providers/facebook/__init__.py | 22 ++
airflow/providers/facebook/ads/hooks/ads.py | 2 +-
airflow/providers/ftp/__init__.py | 19 ++
airflow/providers/ftp/operators/ftp.py | 2 +-
airflow/providers/github/__init__.py | 22 ++
airflow/providers/google/__init__.py | 34 ++-
airflow/providers/google/ads/hooks/ads.py | 2 +-
.../_internal_client/secret_manager_client.py | 2 +-
airflow/providers/google/cloud/hooks/automl.py | 2 +-
airflow/providers/google/cloud/hooks/bigquery.py | 90 +++---
.../cloud/hooks/cloud_storage_transfer_service.py | 6 +-
.../providers/google/cloud/hooks/compute_ssh.py | 2 +-
airflow/providers/google/cloud/hooks/dataflow.py | 14 +-
.../google/cloud/hooks/kubernetes_engine.py | 8 +-
airflow/providers/google/cloud/hooks/pubsub.py | 5 +-
.../google/cloud/hooks/vertex_ai/auto_ml.py | 6 +-
airflow/providers/google/cloud/hooks/vision.py | 2 +-
airflow/providers/google/cloud/links/base.py | 2 +-
airflow/providers/google/cloud/links/datafusion.py | 2 +-
airflow/providers/google/cloud/links/dataproc.py | 2 +-
.../providers/google/cloud/log/gcs_task_handler.py | 2 +-
.../google/cloud/log/stackdriver_task_handler.py | 2 +-
.../providers/google/cloud/operators/bigquery.py | 24 +-
.../google/cloud/operators/bigquery_dts.py | 2 +-
.../operators/cloud_storage_transfer_service.py | 6 +-
.../providers/google/cloud/operators/dataflow.py | 7 +-
.../providers/google/cloud/operators/dataproc.py | 18 +-
.../google/cloud/operators/dataproc_metastore.py | 2 +-
.../google/cloud/operators/kubernetes_engine.py | 12 +-
.../providers/google/cloud/operators/mlengine.py | 6 +-
.../google/cloud/secrets/secret_manager.py | 4 +-
airflow/providers/google/cloud/sensors/bigquery.py | 8 +-
airflow/providers/google/cloud/sensors/gcs.py | 4 +-
.../google/cloud/transfers/bigquery_to_bigquery.py | 3 +-
.../google/cloud/transfers/gcs_to_local.py | 4 +-
.../providers/google/common/hooks/base_google.py | 4 +-
.../providers/google/config_templates/__init__.py | 16 --
.../providers/google/config_templates/config.yml | 27 --
.../google/config_templates/default_config.cfg | 34 ---
airflow/providers/grpc/__init__.py | 21 ++
airflow/providers/hashicorp/__init__.py | 22 ++
.../hashicorp/_internal_client/vault_client.py | 3 +-
airflow/providers/hashicorp/hooks/vault.py | 5 +-
airflow/providers/hashicorp/secrets/vault.py | 3 +-
airflow/providers/http/__init__.py | 21 ++
airflow/providers/imap/__init__.py | 21 ++
airflow/providers/influxdb/__init__.py | 22 ++
airflow/providers/jdbc/__init__.py | 21 ++
airflow/providers/jdbc/operators/jdbc.py | 3 +-
airflow/providers/jenkins/__init__.py | 21 ++
airflow/providers/microsoft/azure/__init__.py | 21 ++
.../microsoft/azure/hooks/container_instance.py | 7 +-
.../microsoft/azure/log/wasb_task_handler.py | 2 +-
.../microsoft/azure/operators/data_factory.py | 2 +-
.../providers/microsoft/azure/secrets/key_vault.py | 5 +-
.../microsoft/azure/sensors/data_factory.py | 27 +-
airflow/providers/microsoft/azure/sensors/wasb.py | 4 +-
.../microsoft/azure/transfers/local_to_adls.py | 4 +-
.../microsoft/azure/transfers/sftp_to_wasb.py | 2 +-
airflow/providers/microsoft/mssql/__init__.py | 21 ++
.../providers/microsoft/mssql/operators/mssql.py | 3 +-
airflow/providers/microsoft/psrp/__init__.py | 21 ++
airflow/providers/microsoft/psrp/hooks/psrp.py | 4 +-
airflow/providers/microsoft/winrm/__init__.py | 21 ++
airflow/providers/mongo/__init__.py | 21 ++
airflow/providers/mysql/__init__.py | 21 ++
airflow/providers/mysql/operators/mysql.py | 3 +-
airflow/providers/neo4j/__init__.py | 21 ++
airflow/providers/odbc/__init__.py | 22 ++
airflow/providers/openfaas/__init__.py | 21 ++
airflow/providers/openlineage/__init__.py | 32 +--
.../providers/openlineage/extractors/manager.py | 4 +-
airflow/providers/openlineage/plugins/adapter.py | 35 ++-
airflow/providers/openlineage/plugins/macros.py | 3 +-
.../providers/openlineage/plugins/openlineage.py | 6 +-
airflow/providers/openlineage/provider.yaml | 2 +-
airflow/providers/opsgenie/__init__.py | 21 ++
airflow/providers/oracle/__init__.py | 21 ++
airflow/providers/oracle/hooks/oracle.py | 4 +-
airflow/providers/oracle/operators/oracle.py | 3 +-
airflow/providers/pagerduty/__init__.py | 21 ++
airflow/providers/pagerduty/hooks/pagerduty.py | 4 +-
airflow/providers/papermill/__init__.py | 21 ++
airflow/providers/plexus/__init__.py | 22 ++
airflow/providers/postgres/__init__.py | 21 ++
airflow/providers/postgres/hooks/postgres.py | 7 +-
airflow/providers/postgres/operators/postgres.py | 3 +-
airflow/providers/presto/__init__.py | 21 ++
airflow/providers/qubole/__init__.py | 21 ++
airflow/providers/qubole/operators/qubole.py | 2 +-
airflow/providers/redis/__init__.py | 21 ++
airflow/providers/salesforce/__init__.py | 21 ++
airflow/providers/salesforce/hooks/salesforce.py | 2 +-
airflow/providers/samba/__init__.py | 21 ++
airflow/providers/segment/__init__.py | 21 ++
airflow/providers/sendgrid/__init__.py | 22 ++
airflow/providers/sendgrid/utils/emailer.py | 4 +-
airflow/providers/sftp/__init__.py | 22 ++
airflow/providers/sftp/hooks/sftp.py | 6 +-
airflow/providers/sftp/operators/sftp.py | 4 +-
airflow/providers/singularity/__init__.py | 21 ++
airflow/providers/slack/__init__.py | 21 ++
airflow/providers/slack/hooks/slack.py | 11 +-
airflow/providers/slack/hooks/slack_webhook.py | 17 +-
.../slack/notifications/slack_notifier.py | 2 +-
airflow/providers/slack/operators/slack.py | 5 +-
airflow/providers/slack/operators/slack_webhook.py | 8 +-
airflow/providers/smtp/__init__.py | 21 ++
airflow/providers/snowflake/__init__.py | 22 ++
airflow/providers/snowflake/operators/snowflake.py | 3 +-
.../snowflake/transfers/s3_to_snowflake.py | 3 +-
.../snowflake/transfers/snowflake_to_slack.py | 3 +-
airflow/providers/sqlite/__init__.py | 21 ++
airflow/providers/sqlite/operators/sqlite.py | 3 +-
airflow/providers/ssh/__init__.py | 19 ++
airflow/providers/ssh/hooks/ssh.py | 12 +-
airflow/providers/ssh/operators/ssh.py | 4 +-
airflow/providers/tableau/__init__.py | 21 ++
airflow/providers/tableau/hooks/tableau.py | 4 +-
airflow/providers/tabular/__init__.py | 21 ++
airflow/providers/telegram/__init__.py | 21 ++
airflow/providers/trino/__init__.py | 21 ++
airflow/providers/trino/operators/trino.py | 3 +-
airflow/providers/vertica/__init__.py | 21 ++
airflow/providers/vertica/operators/vertica.py | 3 +-
airflow/providers/yandex/__init__.py | 22 ++
airflow/providers/yandex/hooks/yandex.py | 4 +-
airflow/providers/zendesk/__init__.py | 21 ++
airflow/settings.py | 4 -
airflow/ti_deps/dep_context.py | 8 +
airflow/ti_deps/deps/trigger_rule_dep.py | 66 ++++-
airflow/timetables/_cron.py | 2 +-
airflow/typing_compat.py | 8 +-
airflow/utils/context.py | 3 +-
airflow/utils/db.py | 1 +
airflow/utils/file.py | 3 +-
airflow/utils/log/file_task_handler.py | 2 +-
airflow/utils/log/log_reader.py | 2 +-
airflow/utils/log/secrets_masker.py | 3 +-
airflow/utils/trigger_rule.py | 1 +
airflow/www/extensions/init_views.py | 2 +-
airflow/www/fab_security/manager.py | 2 +-
airflow/www/static/js/types/api-generated.ts | 31 +-
airflow/www/views.py | 5 +-
chart/Chart.yaml | 22 +-
chart/newsfragments/30970.significant.rst | 3 +
chart/values.schema.json | 4 +-
chart/values.yaml | 4 +-
dev/README_RELEASE_AIRFLOW.md | 2 +
dev/airflow-github | 10 +-
.../commands/release_management_commands.py | 8 +
.../commands/release_management_commands_config.py | 1 +
.../src/airflow_breeze/params/shell_params.py | 1 +
dev/breeze/src/airflow_breeze/pre_commit_ids.py | 3 +
.../airflow_breeze/utils/docker_command_utils.py | 3 +-
.../src/airflow_breeze/utils/selective_checks.py | 34 ++-
.../PROVIDER_INDEX_TEMPLATE.rst.jinja2 | 19 +-
.../PROVIDER__INIT__PY_TEMPLATE.py.jinja2 | 56 ++++
dev/provider_packages/prepare_provider_packages.py | 84 +++++-
dev/stats/get_important_pr_candidates.py | 7 +-
dev/validate_version_added_fields_in_config.py | 2 +-
docs/apache-airflow-providers-airbyte/index.rst | 10 +-
.../connections/aws.rst | 1 +
.../connections/redshift.rst | 12 +-
docs/apache-airflow-providers-amazon/index.rst | 1 +
docs/apache-airflow-providers-common-sql/index.rst | 14 +-
docs/apache-airflow-providers-ftp/index.rst | 16 +-
.../commits.rst | 4 +-
.../apache-airflow-providers-openlineage/index.rst | 18 +-
docs/apache-airflow-providers-sqlite/index.rst | 18 +-
docs/apache-airflow-providers-sqlite/operators.rst | 8 -
.../cluster-policies.rst | 6 +-
.../logging-monitoring/metrics.rst | 3 +-
.../production-deployment.rst | 4 +-
.../core-concepts/executor/celery.rst | 3 +-
.../installation/supported-versions.rst | 2 +-
docs/apache-airflow/public-airflow-interface.rst | 69 ++++-
docs/conf.py | 19 ++
docs/docker-stack/build.rst | 2 +-
docs/spelling_wordlist.txt | 1 +
generated/provider_dependencies.json | 3 +-
images/breeze/output-commands-hash.txt | 6 +-
images/breeze/output-commands.svg | 90 +++---
images/breeze/output_ci-image.svg | 24 +-
images/breeze/output_ci-image_build.svg | 144 +++++-----
images/breeze/output_ci-image_pull.svg | 62 ++--
images/breeze/output_ci-image_verify.svg | 34 +--
images/breeze/output_k8s.svg | 58 ++--
images/breeze/output_k8s_build-k8s-image.svg | 50 ++--
images/breeze/output_k8s_configure-cluster.svg | 58 ++--
images/breeze/output_k8s_create-cluster.svg | 60 ++--
images/breeze/output_k8s_delete-cluster.svg | 32 +--
images/breeze/output_k8s_deploy-airflow.svg | 68 ++---
images/breeze/output_k8s_k9s.svg | 30 +-
images/breeze/output_k8s_logs.svg | 34 +--
images/breeze/output_k8s_run-complete-tests.svg | 88 +++---
images/breeze/output_k8s_shell.svg | 38 +--
images/breeze/output_k8s_status.svg | 34 +--
images/breeze/output_k8s_tests.svg | 66 ++---
images/breeze/output_k8s_upload-k8s-image.svg | 56 ++--
images/breeze/output_prod-image.svg | 24 +-
images/breeze/output_prod-image_build.svg | 182 ++++++------
images/breeze/output_prod-image_pull.svg | 60 ++--
images/breeze/output_prod-image_verify.svg | 34 +--
images/breeze/output_release-management.svg | 32 +--
...put_release-management_generate-constraints.svg | 60 ++--
...e-management_prepare-provider-documentation.svg | 42 ++-
...tput_release-management_release-prod-images.svg | 46 +--
images/breeze/output_setup.svg | 28 +-
images/breeze/output_setup_config.svg | 40 +--
images/breeze/output_shell.svg | 108 +++----
images/breeze/output_start-airflow.svg | 110 ++++----
images/breeze/output_static-checks.svg | 40 +--
images/breeze/output_testing.svg | 24 +-
.../breeze/output_testing_docker-compose-tests.svg | 32 +--
images/breeze/output_testing_integration-tests.svg | 66 ++---
images/breeze/output_testing_tests.svg | 102 +++----
newsfragments/28172.misc.rst | 1 -
newsfragments/28538.misc.rst | 1 -
newsfragments/28892.improvement.rst | 1 -
newsfragments/29506.significant.rst | 6 -
newsfragments/29933.improvement.rst | 1 -
newsfragments/30076.significant.rst | 3 -
newsfragments/30152.significant.rst | 6 -
newsfragments/30374.significant.rst | 5 -
newsfragments/30375.significant.rst | 9 -
pyproject.toml | 6 +-
scripts/ci/docker-compose/_docker.env | 2 +-
scripts/ci/docker-compose/base.yml | 2 +-
scripts/ci/docker-compose/devcontainer.env | 2 +-
...py => pre_commit_check_aiobotocore_optional.py} | 48 ++--
.../ci/pre_commit/pre_commit_supported_versions.py | 2 +-
...elm_lint.py => pre_commit_unittest_testcase.py} | 39 +--
scripts/in_container/run_generate_constraints.sh | 22 +-
scripts/in_container/verify_providers.py | 1 +
setup.cfg | 6 +-
setup.py | 6 +-
tests/always/test_example_dags.py | 4 -
.../endpoints/test_config_endpoint.py | 100 +++++++
tests/charts/airflow_aux/test_basic_helm_chart.py | 18 +-
tests/charts/airflow_core/test_triggerer.py | 2 +-
tests/charts/security/test_rbac.py | 10 +-
tests/conftest.py | 1 -
tests/core/test_config_templates.py | 1 +
tests/dag_processing/test_processor.py | 17 ++
tests/decorators/test_external_python.py | 4 -
tests/decorators/test_python.py | 53 +++-
tests/decorators/test_python_virtualenv.py | 4 -
tests/decorators/test_setup_teardown.py | 2 -
tests/executors/test_kubernetes_executor.py | 2 +-
tests/jobs/test_backfill_job.py | 2 +-
tests/models/test_dagrun.py | 27 +-
tests/models/test_mappedoperator.py | 35 +++
tests/models/test_taskinstance.py | 312 ++++++++++++++++-----
tests/models/test_xcom.py | 3 +-
tests/providers/amazon/aws/hooks/test_emr.py | 47 ++++
.../amazon/aws/hooks/test_redshift_sql.py | 65 ++++-
tests/providers/amazon/aws/operators/test_batch.py | 4 +-
.../amazon/aws/operators/test_emr_add_steps.py | 15 +-
.../aws/operators/test_emr_create_job_flow.py | 10 +-
.../aws/operators/test_emr_modify_cluster.py | 7 +-
.../aws/operators/test_emr_terminate_job_flow.py | 4 +-
.../amazon/aws/operators/test_redshift_cluster.py | 12 +
.../amazon/aws/operators/test_step_function.py | 7 +-
.../amazon/aws/sensors/test_emr_job_flow.py | 6 +-
.../providers/amazon/aws/sensors/test_emr_step.py | 22 +-
tests/providers/amazon/aws/transfers/test_base.py | 3 +-
.../amazon/aws/transfers/test_dynamodb_to_s3.py | 3 +-
.../amazon/aws/transfers/test_s3_to_redshift.py | 3 +-
.../amazon/aws/utils/test_connection_wrapper.py | 15 +-
.../cncf/kubernetes/decorators/test_kubernetes.py | 3 -
.../providers/dbt/cloud/sensors/test_dbt_cloud.py | 31 +-
tests/providers/docker/decorators/test_docker.py | 4 -
.../elasticsearch/hooks/test_elasticsearch.py | 3 +-
.../providers/google/cloud/hooks/test_bigquery.py | 4 +-
.../google/cloud/hooks/test_bigquery_dts.py | 2 +-
.../providers/google/cloud/hooks/test_dataflow.py | 24 +-
.../google/cloud/operators/test_dataproc.py | 24 +-
.../google/cloud/sensors/test_bigquery.py | 18 +-
tests/providers/google/cloud/sensors/test_gcs.py | 8 +-
.../azure/secrets/test_azure_key_vault.py | 7 +-
.../azure/sensors/test_azure_data_factory.py | 24 +-
.../plugins/openlineage_configs}/__init__.py | 0
.../plugins/openlineage_configs/http.yaml | 14 +-
.../openlineage/plugins/test_openlineage.py | 15 +-
.../plugins/test_openlineage_adapter.py | 68 +++++
tests/providers/oracle/operators/test_oracle.py | 3 +-
tests/providers/sftp/hooks/test_sftp.py | 12 +-
tests/providers/slack/hooks/test_slack.py | 6 +-
tests/providers/slack/hooks/test_slack_webhook.py | 12 +-
tests/providers/slack/operators/test_slack.py | 3 +-
.../slack/operators/test_slack_webhook.py | 8 +-
tests/providers/trino/operators/test_trino.py | 3 +-
tests/serialization/test_dag_serialization.py | 2 -
tests/system/providers/amazon/aws/example_emr.py | 5 +-
.../google/cloud/gcs/example_sftp_to_gcs.py | 4 +-
tests/test_utils/mock_executor.py | 2 +-
tests/ti_deps/deps/test_trigger_rule_dep.py | 216 +++++++++++---
tests/utils/test_trigger_rule.py | 3 +-
tests/www/views/test_views_acl.py | 4 +-
461 files changed, 5859 insertions(+), 2183 deletions(-)
create mode 100644 airflow/models/taskinstancekey.py
delete mode 100644 airflow/providers/google/config_templates/__init__.py
delete mode 100644 airflow/providers/google/config_templates/config.yml
delete mode 100644 airflow/providers/google/config_templates/default_config.cfg
create mode 100644 chart/newsfragments/30970.significant.rst
create mode 100644 dev/provider_packages/PROVIDER__INIT__PY_TEMPLATE.py.jinja2
delete mode 100644 newsfragments/28172.misc.rst
delete mode 100644 newsfragments/28538.misc.rst
delete mode 100644 newsfragments/28892.improvement.rst
delete mode 100644 newsfragments/29506.significant.rst
delete mode 100644 newsfragments/29933.improvement.rst
delete mode 100644 newsfragments/30076.significant.rst
delete mode 100644 newsfragments/30152.significant.rst
delete mode 100644 newsfragments/30374.significant.rst
delete mode 100644 newsfragments/30375.significant.rst
copy scripts/ci/pre_commit/{pre_commit_docstring_param_type.py =>
pre_commit_check_aiobotocore_optional.py} (54%)
copy scripts/ci/pre_commit/{pre_commit_helm_lint.py =>
pre_commit_unittest_testcase.py} (51%)
copy {airflow/api_connexion =>
tests/providers/openlineage/plugins/openlineage_configs}/__init__.py (100%)
copy yamllint-config.yml =>
tests/providers/openlineage/plugins/openlineage_configs/http.yaml (85%)
