This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard a845abbf18 Add Python 3.12 support
add a15a3274af Uninstall twine before installing it in CI (#37415)
add 7461ac7277 Avoid side-effects for providers-manager related tests
(#37414)
add 61f0adf0c7 fix: Check if operator is disabled in
DefaultExtractor.extract_on_complete (#37392)
add b341b5927e docs: Add doc page with providers deprecations (#37075)
add 70603f7193 Fix bug with clicking url-unsafe tags (#37395)
add 4551c592b2 Until we release 2.9.0, we keep airflow >= 2.9.0.dev0 for
FAB provider (#37421)
add cf8ca16ead Make datasets list/graph width adjustable (#37425)
add 0640e6d595 KPO Maintain backward compatibility for execute_complete
and trigger run method (#37363)
add 56c27f8f5a Create CLI commands for AWS auth manager to create AWS
Identity Center related resources (#37407)
add f91c93ccfe Add retry configuration in `EmrContainerOperator` (#37426)
add 4905e9911e Fix typo (copy&paste victim) introduced in twine fix
(#37428)
add 2a0f3d2980 Use more recent release label in `example_emr_eks` system
test (#37429)
add df132b2dd6 Add GKEStartKueueInsideClusterOperator (#37072)
add 0be6430938 Revert "KPO Maintain backward compatibility for
execute_complete and trigger run method (#37363)" (#37446)
add b6ca84701e Fix SQLThresholdCheckOperator error on falsey vals (#37150)
add 107b3e2621 Add developer token as authentication method to
GoogleAdsHook (#37417)
add 86f4775367 Fix a bug in fundamentals doc (#37440)
add 56a5d0fba3 Update providers metadata 2024-02-15 (#37453)
add 32ba99b6c2 Create GKEStartJobOperator and KubernetesJobOperator
(#36847)
add c41794d056 Add Teradata Provider (#36953)
add a457a75c05 Added Supported Database Types (#37376)
add e346253760 Fix remaining D401 checks (#37434)
add b840c14b10 Avoid side-effects in `conf_vars` testing helper (#37438)
add c84efe77a5 KPO Maintain backward compatibility for execute_complete
and trigger run method (#37454)
add ef0ab856e4 Support type checking for third-party pytest's fixtures
(#37457)
add 3c1d05140e Partially enable D105 rule (#37462)
add 42f8d048d2 Replace usage of `datetime.utcnow` and
`datetime.utcfromtimestamp` in providers (#37138)
add 9f4f8b3553 Add environment var example to mssql.rst (#37418)
add 5ad1e7801f Update overview.rst (#37472)
add 123b656151 Fix GCSSynchronizeBucketsOperator timeout error (#37237)
add c75a105935 add type annotations to Amazon provider "execute_coplete"
methods (#36330)
add a3e939f22f Replace usage of `datetime.utcnow` and
`datetime.utcfromtimestamp` in dev (#37473)
add bcf26733af Add PSRP connection type (#34766)
add 56642a8549 Add Python 3.12 support
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a845abbf18)
\
N -- N -- N refs/heads/python3.12 (56642a8549)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../airflow_providers_bug_report.yml | 1 +
.github/boring-cyborg.yml | 6 +
.github/workflows/ci.yml | 8 +-
INSTALL | 4 +-
.../amazon/aws/auth_manager/cli/avp_commands.py | 4 +-
.../amazon/aws/auth_manager/cli/definition.py | 14 +
.../amazon/aws/auth_manager/cli/idc_commands.py | 148 +++++++
airflow/providers/amazon/aws/hooks/base_aws.py | 4 +-
airflow/providers/amazon/aws/hooks/emr.py | 6 +
.../providers/amazon/aws/hooks/redshift_cluster.py | 2 +-
.../amazon/aws/log/cloudwatch_task_handler.py | 4 +-
airflow/providers/amazon/aws/operators/athena.py | 5 +-
airflow/providers/amazon/aws/operators/batch.py | 11 +-
airflow/providers/amazon/aws/operators/ecs.py | 8 +-
airflow/providers/amazon/aws/operators/eks.py | 43 +-
airflow/providers/amazon/aws/operators/emr.py | 60 +--
airflow/providers/amazon/aws/operators/glue.py | 7 +-
.../providers/amazon/aws/operators/glue_crawler.py | 7 +-
.../amazon/aws/operators/glue_databrew.py | 7 +-
.../amazon/aws/operators/lambda_function.py | 3 +
airflow/providers/amazon/aws/operators/rds.py | 33 +-
.../amazon/aws/operators/redshift_cluster.py | 30 +-
.../amazon/aws/operators/redshift_data.py | 6 +-
.../providers/amazon/aws/operators/sagemaker.py | 44 +-
.../amazon/aws/operators/step_function.py | 5 +-
airflow/providers/amazon/aws/sensors/ec2.py | 6 +-
airflow/providers/amazon/aws/sensors/emr.py | 19 +-
.../amazon/aws/sensors/glue_catalog_partition.py | 5 +-
.../amazon/aws/sensors/redshift_cluster.py | 6 +-
airflow/providers/amazon/aws/sensors/s3.py | 3 +
airflow/providers/amazon/aws/sensors/sqs.py | 5 +-
airflow/providers/amazon/aws/utils/__init__.py | 10 +
.../providers/amazon/aws/utils/task_log_fetcher.py | 4 +-
.../providers/cncf/kubernetes/hooks/kubernetes.py | 54 ++-
.../cncf/kubernetes/kubernetes_helper_functions.py | 58 +++
airflow/providers/cncf/kubernetes/operators/job.py | 286 +++++++++++++
airflow/providers/cncf/kubernetes/operators/pod.py | 150 +++----
airflow/providers/cncf/kubernetes/provider.yaml | 1 +
airflow/providers/cncf/kubernetes/triggers/pod.py | 70 +++-
airflow/providers/common/io/xcom/backend.py | 9 +-
airflow/providers/common/sql/operators/sql.py | 9 +-
airflow/providers/databricks/hooks/databricks.py | 6 +-
.../providers/databricks/operators/databricks.py | 2 +-
airflow/providers/fab/provider.yaml | 3 +-
airflow/providers/google/ads/hooks/ads.py | 93 ++++-
airflow/providers/google/cloud/hooks/gcs.py | 20 +-
.../google/cloud/hooks/kubernetes_engine.py | 219 +++++++++-
.../google/cloud/links/kubernetes_engine.py | 29 ++
.../google/cloud/operators/kubernetes_engine.py | 311 +++++++++++++-
.../providers/google/cloud/transfers/s3_to_gcs.py | 4 +-
.../providers/google/common/hooks/base_google.py | 2 +-
airflow/providers/google/provider.yaml | 1 +
.../hashicorp/_internal_client/vault_client.py | 6 +-
airflow/providers/hashicorp/hooks/vault.py | 12 +-
airflow/providers/imap/hooks/imap.py | 18 +-
airflow/providers/microsoft/psrp/hooks/psrp.py | 10 +
airflow/providers/microsoft/psrp/provider.yaml | 10 +-
airflow/providers/mongo/hooks/mongo.py | 26 +-
airflow/providers/mysql/hooks/mysql.py | 8 +-
airflow/providers/mysql/transfers/s3_to_mysql.py | 2 +-
airflow/providers/neo4j/hooks/neo4j.py | 6 +-
airflow/providers/openfaas/hooks/openfaas.py | 4 +-
airflow/providers/openlineage/extractors/base.py | 18 +-
airflow/providers/opensearch/hooks/opensearch.py | 2 +-
.../providers/opensearch/operators/opensearch.py | 14 +-
airflow/providers/oracle/hooks/oracle.py | 2 +-
airflow/providers/pagerduty/hooks/pagerduty.py | 6 +-
.../providers/pagerduty/hooks/pagerduty_events.py | 2 +-
airflow/providers/papermill/hooks/kernel.py | 4 +-
airflow/providers/postgres/hooks/postgres.py | 14 +-
airflow/providers/presto/hooks/presto.py | 6 +-
airflow/providers/qdrant/hooks/qdrant.py | 4 +-
airflow/providers/salesforce/hooks/salesforce.py | 6 +-
airflow/providers/salesforce/operators/bulk.py | 2 +-
.../salesforce/operators/salesforce_apex_rest.py | 2 +-
airflow/providers/samba/hooks/samba.py | 2 +-
airflow/providers/samba/transfers/gcs_to_samba.py | 2 +-
airflow/providers/segment/hooks/segment.py | 2 +-
airflow/providers/telegram/hooks/telegram.py | 8 +-
airflow/providers/telegram/operators/telegram.py | 2 +-
airflow/providers/teradata/CHANGELOG.rst | 31 ++
.../providers/teradata/__init__.py | 28 +-
.../auth => providers/teradata/hooks}/__init__.py | 0
airflow/providers/teradata/hooks/teradata.py | 202 +++++++++
.../teradata/operators}/__init__.py | 0
airflow/providers/teradata/operators/teradata.py | 64 +++
airflow/providers/teradata/provider.yaml | 61 +++
.../teradata/transfers}/__init__.py | 0
.../teradata/transfers/teradata_to_teradata.py | 101 +++++
airflow/providers/trino/hooks/trino.py | 12 +-
airflow/providers/weaviate/hooks/weaviate.py | 23 +-
airflow/utils/db.py | 11 +
airflow/www/static/js/datasets/List.tsx | 2 +-
.../www/static/js/datasets/{index.tsx => Main.tsx} | 97 +++--
airflow/www/static/js/datasets/index.tsx | 52 +--
airflow/www/templates/airflow/dags.html | 2 +-
.../12_airflow_dependencies_and_extras.rst | 4 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 12 +
dev/breeze/doc/images/output_build-docs.svg | 2 +-
dev/breeze/doc/images/output_build-docs.txt | 2 +-
...tput_release-management_add-back-references.svg | 2 +-
...tput_release-management_add-back-references.txt | 2 +-
...management_generate-issue-content-providers.svg | 2 +-
...management_generate-issue-content-providers.txt | 2 +-
...e-management_prepare-provider-documentation.svg | 2 +-
...e-management_prepare-provider-documentation.txt | 2 +-
...elease-management_prepare-provider-packages.svg | 2 +-
...elease-management_prepare-provider-packages.txt | 2 +-
.../output_release-management_publish-docs.svg | 2 +-
.../output_release-management_publish-docs.txt | 2 +-
...output_sbom_generate-providers-requirements.svg | 2 +-
...output_sbom_generate-providers-requirements.txt | 2 +-
dev/breeze/src/airflow_breeze/utils/github.py | 4 +-
dev/breeze/src/airflow_breeze/utils/parallel.py | 4 +-
dev/breeze/tests/test_selective_checks.py | 2 +-
docs/README.rst | 13 +
.../operators.rst | 42 ++
docs/apache-airflow-providers-common-sql/index.rst | 1 +
.../supported-database-types.rst | 46 +++
.../operators/cloud/kubernetes_engine.rst | 40 ++
.../connections/mssql.rst | 23 ++
.../changelog.rst | 19 +
docs/apache-airflow-providers-teradata/commits.rst | 26 ++
.../connections/teradata.rst | 82 ++++
.../index.rst | 63 +--
.../installing-providers-from-sources.rst | 0
.../operators/index.rst | 25 ++
.../operators/teradata.rst | 115 ++++++
.../operators/teradata_to_teradata.rst | 48 +++
.../security.rst | 0
.../core-extensions/deprecations.rst | 31 ++
docs/apache-airflow/core-concepts/overview.rst | 2 +-
docs/apache-airflow/extra-packages-ref.rst | 2 +
docs/apache-airflow/tutorial/fundamentals.rst | 2 +-
docs/exts/docs_build/errors.py | 5 +-
docs/exts/docs_build/spelling_checks.py | 13 +-
docs/exts/operators_and_hooks_ref.py | 115 ++++++
docs/exts/templates/deprecations.rst.jinja2 | 37 ++
docs/integration-logos/teradata/Teradata.png | Bin 0 -> 2220 bytes
docs/spelling_wordlist.txt | 12 +
generated/provider_dependencies.json | 16 +-
generated/provider_metadata.json | 138 +++++++
.../images => images/breeze}/output_build-docs.svg | 53 +--
images/breeze/output_build-docs.txt | 1 +
...tput_release-management_add-back-references.txt | 1 +
...management_generate-issue-content-providers.txt | 1 +
...e-management_prepare-provider-documentation.txt | 1 +
...elease-management_prepare-provider-packages.txt | 1 +
.../output_release-management_publish-docs.svg | 59 +--
.../output_release-management_publish-docs.txt | 1 +
kubernetes_tests/test_base.py | 4 +-
pyproject.toml | 133 ++++--
.../in_container/update_quarantined_test_status.py | 4 +-
tests/always/test_providers_manager.py | 11 +-
.../endpoints/test_provider_endpoint.py | 2 +-
tests/cli/commands/test_info_command.py | 2 +-
tests/conftest.py | 35 ++
.../amazon/aws/auth_manager/cli/test_definition.py | 2 +-
.../aws/auth_manager/cli/test_idc_commands.py | 134 ++++++
tests/providers/amazon/aws/hooks/test_sagemaker.py | 4 +-
.../amazon/aws/log/test_cloudwatch_task_handler.py | 4 +-
.../amazon/aws/operators/test_emr_containers.py | 2 +-
.../celery/executors/test_celery_executor.py | 4 +-
.../executors/test_kubernetes_executor.py | 8 +-
.../cncf/kubernetes/operators/test_job.py | 452 +++++++++++++++++++++
.../cncf/kubernetes/operators/test_pod.py | 34 +-
.../providers/cncf/kubernetes/triggers/test_pod.py | 102 +++--
tests/providers/common/sql/operators/test_sql.py | 25 +-
tests/providers/google/ads/hooks/test_ads.py | 49 ++-
tests/providers/google/cloud/hooks/test_gcs.py | 32 +-
.../google/cloud/hooks/test_kubernetes_engine.py | 235 +++++++++++
.../cloud/operators/test_kubernetes_engine.py | 313 +++++++++++++-
tests/providers/google/cloud/sensors/test_gcs.py | 42 +-
tests/providers/google/cloud/triggers/test_gcs.py | 4 +-
.../cloud/triggers/test_kubernetes_engine.py | 51 +--
tests/providers/microsoft/psrp/hooks/test_psrp.py | 6 +
.../providers/openlineage/extractors/test_base.py | 14 +
.../providers/openlineage/extractors/test_bash.py | 13 +
.../openlineage/extractors/test_python.py | 2 +
.../providers/teradata}/__init__.py | 0
.../providers/teradata/hooks}/__init__.py | 0
tests/providers/teradata/hooks/test_teradata.py | 264 ++++++++++++
.../providers/teradata/operators}/__init__.py | 0
.../providers/teradata/operators/test_teradata.py | 99 +++++
.../providers/teradata/transfers}/__init__.py | 0
.../transfers/test_teradata_to_teradata.py | 117 ++++++
.../system/providers/amazon/aws/example_emr_eks.py | 3 +-
.../cncf/kubernetes/example_kubernetes_job.py | 57 +++
.../example_kubernetes_engine_job.py | 87 ++++
.../example_kubernetes_engine_kueue.py | 84 ++++
.../example_cloud_storage_transfer_service_aws.py | 4 +-
.../example_cloud_storage_transfer_service_gcp.py | 4 +-
.../system/providers/teradata}/__init__.py | 0
.../system/providers/teradata/create_ssl_table.sql | 22 +
tests/system/providers/teradata/create_table.sql | 22 +
.../providers/teradata/example_ssl_teradata.py | 127 ++++++
.../system/providers/teradata/example_teradata.py | 184 +++++++++
.../example_teradata_to_teradata_transfer.py | 174 ++++++++
tests/test_utils/config.py | 8 +-
199 files changed, 5986 insertions(+), 822 deletions(-)
create mode 100644
airflow/providers/amazon/aws/auth_manager/cli/idc_commands.py
create mode 100644 airflow/providers/cncf/kubernetes/operators/job.py
create mode 100644 airflow/providers/teradata/CHANGELOG.rst
copy tests/providers/amazon/aws/auth_manager/cli/test_definition.py =>
airflow/providers/teradata/__init__.py (50%)
copy airflow/{api/auth => providers/teradata/hooks}/__init__.py (100%)
create mode 100644 airflow/providers/teradata/hooks/teradata.py
copy airflow/{api/auth => providers/teradata/operators}/__init__.py (100%)
create mode 100644 airflow/providers/teradata/operators/teradata.py
create mode 100644 airflow/providers/teradata/provider.yaml
copy airflow/{api_connexion => providers/teradata/transfers}/__init__.py (100%)
create mode 100644 airflow/providers/teradata/transfers/teradata_to_teradata.py
copy airflow/www/static/js/datasets/{index.tsx => Main.tsx} (57%)
create mode 100644
docs/apache-airflow-providers-common-sql/supported-database-types.rst
create mode 100644 docs/apache-airflow-providers-teradata/changelog.rst
create mode 100644 docs/apache-airflow-providers-teradata/commits.rst
create mode 100644
docs/apache-airflow-providers-teradata/connections/teradata.rst
copy docs/{apache-airflow-providers-common-sql =>
apache-airflow-providers-teradata}/index.rst (52%)
copy docs/{apache-airflow-providers-airbyte =>
apache-airflow-providers-teradata}/installing-providers-from-sources.rst (100%)
create mode 100644 docs/apache-airflow-providers-teradata/operators/index.rst
create mode 100644
docs/apache-airflow-providers-teradata/operators/teradata.rst
create mode 100644
docs/apache-airflow-providers-teradata/operators/teradata_to_teradata.rst
copy docs/{apache-airflow-providers-openai =>
apache-airflow-providers-teradata}/security.rst (100%)
create mode 100644
docs/apache-airflow-providers/core-extensions/deprecations.rst
create mode 100644 docs/exts/templates/deprecations.rst.jinja2
create mode 100644 docs/integration-logos/teradata/Teradata.png
copy {dev/breeze/doc/images => images/breeze}/output_build-docs.svg (78%)
create mode 100644 images/breeze/output_build-docs.txt
create mode 100644
images/breeze/output_release-management_add-back-references.txt
create mode 100644
images/breeze/output_release-management_generate-issue-content-providers.txt
create mode 100644
images/breeze/output_release-management_prepare-provider-documentation.txt
create mode 100644
images/breeze/output_release-management_prepare-provider-packages.txt
copy {dev/breeze/doc/images =>
images/breeze}/output_release-management_publish-docs.svg (78%)
create mode 100644 images/breeze/output_release-management_publish-docs.txt
create mode 100644
tests/providers/amazon/aws/auth_manager/cli/test_idc_commands.py
create mode 100644 tests/providers/cncf/kubernetes/operators/test_job.py
copy {airflow/api_connexion => tests/providers/teradata}/__init__.py (100%)
copy {airflow/api/auth => tests/providers/teradata/hooks}/__init__.py (100%)
create mode 100644 tests/providers/teradata/hooks/test_teradata.py
copy {airflow/api/auth => tests/providers/teradata/operators}/__init__.py
(100%)
create mode 100644 tests/providers/teradata/operators/test_teradata.py
copy {airflow/api/auth => tests/providers/teradata/transfers}/__init__.py
(100%)
create mode 100644
tests/providers/teradata/transfers/test_teradata_to_teradata.py
create mode 100644
tests/system/providers/cncf/kubernetes/example_kubernetes_job.py
create mode 100644
tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_job.py
create mode 100644
tests/system/providers/google/cloud/kubernetes_engine/example_kubernetes_engine_kueue.py
copy {airflow/api_connexion => tests/system/providers/teradata}/__init__.py
(100%)
create mode 100644 tests/system/providers/teradata/create_ssl_table.sql
create mode 100644 tests/system/providers/teradata/create_table.sql
create mode 100644 tests/system/providers/teradata/example_ssl_teradata.py
create mode 100644 tests/system/providers/teradata/example_teradata.py
create mode 100644
tests/system/providers/teradata/example_teradata_to_teradata_transfer.py
