This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch eager-strategy-when-pre-release
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 468bdf220f0 Eager upgrade strategy when building pre-release images
add 3e1ab481838 Add 3.X/2.X clarification for celerykubernetesexecutor in
Helm Chart docs (#49916)
add 3b3dbe9b644 add root parent information to OpenLineage events (#49237)
add 5d4831c5911 Assets now fit graph (#50212)
add 464da352036 Fix max_messages warning of Kafka ConsumeFromTopicOperator
(#48646)
add e124eb2e697 Bump openlineage provider (#50230)
add 4728fffc5f3 Update description of provider.yaml dependencies (#50231)
add c020bbb9051 Cleaning the visual for classifying commits (#50224)
add 82c65f8f457 Adding comprehensive test coverage for
get_most_impactful_change (#50225)
add 31c7c9626ba Move webserver expose config to api section (#50209)
add 3198aad1bfd Run parallel tests for ARM platform (#50198)
add ea61ff7b6f8 docs(ruff): fix outdated content and add airflow rule
list, ruff configuration links (#50232)
add 64c91b78cf3 Added `last_asset_event_id` and
`last_asset_event_timestamp` to the `AssetResponse` (#50060)
add ed5fceda579 Do not use introspection in migration (#49873)
add 468bfe339ed Update run-behind-proxy doc for CSP (#50236)
add 88148ff2baa Restore operator extra links for mapped tasks (#50238)
add 6204dba1dd9 Update type to follow newest tpying spec (#50229)
add c7941031da0 Add PLATFORM variables missing in CI after ARM adding
(#50237)
add c7c3bc7d361 Fix ErrorAlert white space (#50243)
add f437d9e01b6 Fix backfill form (#50249)
add 470b7daedbf Normalize --platform parameter (#50239)
add a08cff7e97b Add more tests for both regular and slim image (#50251)
add 2a2d386e86c Docs: Fix example of backfill command (#50222)
add e9d8713c3a7 Doc: Fix typo in `operators-and-hooks-ref.rst` (#50250)
add fde86841570 Add TI deletion UI (#50235)
add 215ff88030e Pass mapIndex to clear the relevant task instances similar
to dry run. (#50256)
add bb0dc5a19e7 Ignore typing error that might occure for internal import
in ray (#50253)
add dfaf602bfaa UI: Fix operator overflow in graph (#50252)
add dcb098416ca Remove experimental ARM support from container images
(#50261)
add 3b7f392afc2 Doc: Add REST API v2 (``api/v2``) entry in Release Notes
(#50264)
add 9164b6af62a Fix build_docs typo (#50262)
add d1ef9b948bf Moved cleanup to api (#50142)
add 909645608f4 Always Show Trendcount in Dag Overview (#50183)
add 7eef587f50f Trigger remote shutdown of edge worker (#50278)
add 94ba5132244 Fix next asset schedule and dag card UX (#50271)
add 89346411086 Add basic json check to variable value (#50277)
add 8c0dcc87604 Fix publish docs runs-on config (#50280)
add 0a9e60d4a31 Eager upgrade strategy when building pre-release images
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (468bdf220f0)
\
N -- N -- N refs/heads/eager-strategy-when-pre-release
(0a9e60d4a31)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/additional-ci-image-checks.yml | 43 +--
.github/workflows/additional-prod-image-tests.yml | 22 +-
.github/workflows/airflow-distributions-tests.yml | 12 +-
.github/workflows/basic-tests.yml | 16 +-
.github/workflows/{ci.yml => ci-amd.yml} | 125 ++++++--
.github/workflows/{ci.yml => ci-arm.yml} | 336 +++------------------
.github/workflows/ci-image-build.yml | 14 +-
.github/workflows/ci-image-checks.yml | 30 +-
.github/workflows/finalize-tests.yml | 85 +-----
.github/workflows/generate-constraints.yml | 12 +-
.github/workflows/helm-tests.yml | 14 +-
.github/workflows/integration-system-tests.yml | 18 +-
.github/workflows/k8s-tests.yml | 10 +-
.github/workflows/prod-image-build.yml | 9 +-
.github/workflows/prod-image-extra-checks.yml | 16 +-
.github/workflows/publish-docs-to-s3.yml | 6 +-
.github/workflows/push-image-cache.yml | 20 +-
.github/workflows/run-unit-tests.yml | 13 +-
.github/workflows/special-tests.yml | 85 ++----
.github/workflows/test-providers.yml | 14 +-
Dockerfile.ci | 9 +-
RELEASE_NOTES.rst | 13 +
airflow-core/docs/best-practices.rst | 10 +-
airflow-core/docs/howto/run-behind-proxy.rst | 5 +
airflow-core/docs/img/airflow_erd.sha256 | 2 +-
.../docs/installation/upgrading_to_airflow3.rst | 4 +
airflow-core/docs/operators-and-hooks-ref.rst | 6 +-
airflow-core/docs/start.rst | 4 +-
.../api_fastapi/core_api/datamodels/assets.py | 10 +-
.../api_fastapi/core_api/datamodels/dags.py | 9 +
.../core_api/openapi/v1-rest-api-generated.yaml | 21 ++
.../api_fastapi/core_api/routes/public/assets.py | 84 +++++-
.../api_fastapi/core_api/routes/public/config.py | 4 +-
.../src/airflow/cli/commands/config_command.py | 4 +
.../src/airflow/config_templates/config.yml | 18 +-
airflow-core/src/airflow/configuration.py | 3 +-
.../airflow/dag_processing/bundles/provider.yaml | 5 +-
.../0028_3_0_0_drop_ab_user_id_foreign_key.py | 51 +---
airflow-core/src/airflow/models/mappedoperator.py | 57 +++-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 42 +++
.../airflow/ui/openapi-gen/requests/types.gen.ts | 9 +
.../ui/src/components/Assets/AssetEvents.tsx | 6 +-
.../Clear/TaskInstance/ClearTaskInstanceDialog.tsx | 2 +-
.../src/components/DagActions/RunBackfillForm.tsx | 5 +-
.../src/airflow/ui/src/components/ErrorAlert.tsx | 5 +-
.../airflow/ui/src/components/Graph/TaskNode.tsx | 91 +++---
.../src/airflow/ui/src/components/Stat.tsx | 6 +-
.../airflow/ui/src/components/TrendCountButton.tsx | 9 +-
.../airflow/ui/src/components/TrendCountChart.tsx | 30 +-
.../src/components/TriggerDag/TriggerDAGForm.tsx | 5 +-
.../src/airflow/ui/src/pages/Asset/Asset.tsx | 106 +------
.../src/pages/Asset/{Asset.tsx => AssetLayout.tsx} | 28 +-
.../airflow/ui/src/pages/Dag/Overview/Overview.tsx | 7 +-
.../ui/src/pages/DagsList/AssetSchedule.tsx | 7 +-
.../src/airflow/ui/src/pages/DagsList/DagCard.tsx | 4 +-
.../src/airflow/ui/src/pages/DagsList/Schedule.tsx | 2 +-
.../ui/src/pages/Task/Overview/Overview.tsx | 4 +-
.../TaskInstances/DeleteTaskInstanceButton.tsx} | 41 +--
.../ui/src/pages/TaskInstances/TaskInstances.tsx | 2 +
.../Variables/ManageVariable/VariableForm.tsx | 42 ++-
.../ui/src/queries/useClearTaskInstances.ts | 5 +-
.../{useClearRun.ts => useDeleteTaskInstance.ts} | 45 +--
.../auth/managers/simple/test_middleware.py | 9 +-
.../core_api/routes/public/test_assets.py | 41 +++
.../core_api/routes/public/test_config.py | 6 +-
.../tests/unit/cli/commands/test_asset_command.py | 1 +
.../unit/serialization/test_dag_serialization.py | 9 +
.../src/airflowctl/api/datamodels/generated.py | 14 +
chart/README.md | 3 +-
chart/docs/airflow-configuration.rst | 2 +-
chart/values.yaml | 6 +-
clients/python/README.md | 4 +-
dev/README_RELEASE_PYTHON_CLIENT.md | 4 +-
dev/breeze/doc/images/output_ci-image_build.svg | 40 +--
dev/breeze/doc/images/output_ci-image_build.txt | 2 +-
dev/breeze/doc/images/output_ci-image_load.svg | 62 ++--
dev/breeze/doc/images/output_ci-image_load.txt | 2 +-
dev/breeze/doc/images/output_ci-image_save.svg | 2 +-
dev/breeze/doc/images/output_ci-image_save.txt | 2 +-
dev/breeze/doc/images/output_prod-image_build.svg | 40 +--
dev/breeze/doc/images/output_prod-image_build.txt | 2 +-
dev/breeze/doc/images/output_prod-image_load.svg | 52 ++--
dev/breeze/doc/images/output_prod-image_load.txt | 2 +-
dev/breeze/doc/images/output_prod-image_save.svg | 2 +-
dev/breeze/doc/images/output_prod-image_save.txt | 2 +-
...tput_release-management_release-prod-images.svg | 6 +-
...tput_release-management_release-prod-images.txt | 2 +-
dev/breeze/doc/images/output_shell.svg | 2 +-
dev/breeze/doc/images/output_shell.txt | 2 +-
dev/breeze/doc/images/output_start-airflow.svg | 240 ++++++++-------
dev/breeze/doc/images/output_start-airflow.txt | 2 +-
.../doc/images/output_testing_core-tests.svg | 90 +++---
.../doc/images/output_testing_core-tests.txt | 2 +-
.../doc/images/output_testing_providers-tests.svg | 108 ++++---
.../doc/images/output_testing_providers-tests.txt | 2 +-
.../src/airflow_breeze/commands/common_options.py | 9 +
.../airflow_breeze/commands/testing_commands.py | 12 -
.../commands/testing_commands_config.py | 1 -
dev/breeze/src/airflow_breeze/global_constants.py | 17 +-
.../src/airflow_breeze/params/shell_params.py | 2 -
.../prepare_providers/provider_documentation.py | 2 +-
dev/breeze/tests/test_provider_documentation.py | 74 +++++
devel-common/src/docs/build_docs.py | 2 +-
docker-stack-docs/changelog.rst | 6 +
docker-stack-docs/index.rst | 18 +-
docker-tests/tests/docker_tests/test_prod_image.py | 34 ++-
docs/spelling_wordlist.txt | 1 +
providers/airbyte/provider.yaml | 5 +-
providers/alibaba/provider.yaml | 5 +-
providers/amazon/provider.yaml | 5 +-
providers/amazon/pyproject.toml | 2 +-
providers/apache/beam/provider.yaml | 5 +-
providers/apache/cassandra/provider.yaml | 5 +-
providers/apache/drill/provider.yaml | 5 +-
providers/apache/druid/provider.yaml | 5 +-
providers/apache/flink/provider.yaml | 5 +-
providers/apache/hdfs/provider.yaml | 5 +-
providers/apache/hive/provider.yaml | 5 +-
providers/apache/iceberg/provider.yaml | 5 +-
providers/apache/impala/provider.yaml | 5 +-
providers/apache/kafka/provider.yaml | 5 +-
.../providers/apache/kafka/operators/consume.py | 12 +-
.../unit/apache/kafka/operators/test_consume.py | 41 ++-
providers/apache/kylin/provider.yaml | 5 +-
providers/apache/livy/provider.yaml | 5 +-
.../tests/unit/apache/livy/operators/test_livy.py | 4 +
providers/apache/pig/provider.yaml | 5 +-
providers/apache/pinot/provider.yaml | 5 +-
providers/apache/spark/provider.yaml | 5 +-
.../apache/spark/operators/test_spark_submit.py | 4 +
providers/apprise/provider.yaml | 5 +-
providers/arangodb/provider.yaml | 5 +-
providers/asana/provider.yaml | 5 +-
providers/atlassian/jira/provider.yaml | 5 +-
providers/celery/provider.yaml | 5 +-
providers/cloudant/provider.yaml | 5 +-
providers/cncf/kubernetes/provider.yaml | 5 +-
providers/cohere/provider.yaml | 5 +-
providers/common/compat/provider.yaml | 5 +-
providers/common/io/provider.yaml | 5 +-
providers/common/messaging/provider.yaml | 5 +-
providers/common/sql/provider.yaml | 5 +-
.../src/airflow/providers/common/sql/hooks/sql.py | 60 +++-
.../src/airflow/providers/common/sql/hooks/sql.pyi | 79 +----
providers/databricks/provider.yaml | 5 +-
providers/datadog/provider.yaml | 5 +-
providers/dbt/cloud/provider.yaml | 5 +-
providers/dbt/cloud/pyproject.toml | 2 +-
.../providers/dbt/cloud/utils/openlineage.py | 11 +-
.../tests/unit/dbt/cloud/utils/test_openlineage.py | 37 ++-
providers/dingding/provider.yaml | 5 +-
providers/discord/provider.yaml | 5 +-
providers/docker/provider.yaml | 5 +-
providers/edge3/provider.yaml | 5 +-
.../airflow/providers/edge3/cli/edge_command.py | 21 ++
.../airflow/providers/edge3/models/edge_worker.py | 22 +-
.../providers/edge3/worker_api/routes/worker.py | 10 +-
providers/elasticsearch/provider.yaml | 5 +-
providers/exasol/provider.yaml | 5 +-
providers/fab/provider.yaml | 5 +-
providers/facebook/provider.yaml | 5 +-
providers/git/provider.yaml | 5 +-
providers/github/provider.yaml | 5 +-
providers/google/provider.yaml | 5 +-
.../providers/google/cloud/hooks/vertex_ai/ray.py | 2 +-
.../unit/google/cloud/openlineage/test_utils.py | 10 +-
.../unit/google/cloud/operators/test_dataproc.py | 10 +
providers/grpc/provider.yaml | 5 +-
providers/hashicorp/provider.yaml | 5 +-
providers/http/provider.yaml | 5 +-
providers/imap/provider.yaml | 5 +-
providers/influxdb/provider.yaml | 5 +-
providers/jdbc/provider.yaml | 5 +-
providers/jenkins/provider.yaml | 5 +-
providers/microsoft/azure/provider.yaml | 5 +-
providers/microsoft/mssql/provider.yaml | 5 +-
providers/microsoft/psrp/provider.yaml | 5 +-
providers/microsoft/winrm/provider.yaml | 5 +-
providers/mongo/provider.yaml | 5 +-
providers/mysql/provider.yaml | 5 +-
providers/neo4j/provider.yaml | 5 +-
providers/odbc/provider.yaml | 5 +-
providers/openai/provider.yaml | 5 +-
providers/openfaas/provider.yaml | 5 +-
providers/openlineage/provider.yaml | 6 +-
providers/openlineage/pyproject.toml | 6 +-
.../src/airflow/providers/openlineage/__init__.py | 2 +-
.../providers/openlineage/plugins/adapter.py | 36 ---
.../providers/openlineage/plugins/listener.py | 17 +-
.../providers/openlineage/plugins/macros.py | 57 +++-
.../airflow/providers/openlineage/utils/spark.py | 5 +
.../airflow/providers/openlineage/utils/utils.py | 22 ++
.../tests/unit/openlineage/dags}/__init__.py | 0
.../dags/test_openlineage_execution.py | 0
.../tests/unit/openlineage/plugins/test_adapter.py | 118 ++++++--
.../unit/openlineage/plugins/test_execution.py | 31 +-
.../unit/openlineage/plugins/test_listener.py | 62 ++--
.../tests/unit/openlineage/utils/test_spark.py | 8 +-
providers/opensearch/provider.yaml | 5 +-
providers/opsgenie/provider.yaml | 5 +-
providers/oracle/provider.yaml | 5 +-
providers/pagerduty/provider.yaml | 5 +-
providers/papermill/provider.yaml | 5 +-
providers/pgvector/provider.yaml | 5 +-
providers/pinecone/provider.yaml | 5 +-
providers/postgres/provider.yaml | 5 +-
providers/presto/provider.yaml | 5 +-
providers/qdrant/provider.yaml | 5 +-
providers/redis/provider.yaml | 5 +-
providers/salesforce/provider.yaml | 5 +-
providers/samba/provider.yaml | 5 +-
providers/segment/provider.yaml | 5 +-
providers/sendgrid/provider.yaml | 5 +-
providers/sftp/provider.yaml | 5 +-
providers/singularity/provider.yaml | 5 +-
providers/slack/provider.yaml | 5 +-
providers/smtp/provider.yaml | 5 +-
providers/snowflake/provider.yaml | 5 +-
providers/snowflake/pyproject.toml | 2 +-
.../providers/snowflake/utils/openlineage.py | 53 +++-
.../tests/unit/snowflake/hooks/test_snowflake.py | 2 +-
.../tests/unit/snowflake/utils/test_openlineage.py | 29 +-
providers/sqlite/provider.yaml | 5 +-
providers/ssh/provider.yaml | 5 +-
providers/standard/provider.yaml | 5 +-
providers/tableau/provider.yaml | 5 +-
providers/telegram/provider.yaml | 5 +-
providers/teradata/provider.yaml | 5 +-
providers/trino/provider.yaml | 5 +-
providers/vertica/provider.yaml | 5 +-
providers/weaviate/provider.yaml | 5 +-
providers/yandex/provider.yaml | 5 +-
providers/ydb/provider.yaml | 5 +-
providers/zendesk/provider.yaml | 5 +-
pyproject.toml | 4 +-
reproducible_build.yaml | 4 +-
.../ci/pre_commit/update_airflow_pyproject_toml.py | 2 +-
scripts/ci/testing/run_unit_tests.sh | 10 -
scripts/docker/entrypoint_ci.sh | 9 +-
scripts/in_container/remove_arm_packages.py | 50 ---
240 files changed, 2251 insertions(+), 1741 deletions(-)
copy .github/workflows/{ci.yml => ci-amd.yml} (90%)
rename .github/workflows/{ci.yml => ci-arm.yml} (63%)
copy airflow-core/src/airflow/ui/src/pages/Asset/{Asset.tsx =>
AssetLayout.tsx} (86%)
copy
airflow-core/src/airflow/ui/src/{components/DagActions/DeleteDagButton.tsx =>
pages/TaskInstances/DeleteTaskInstanceButton.tsx} (59%)
copy airflow-core/src/airflow/ui/src/queries/{useClearRun.ts =>
useDeleteTaskInstance.ts} (72%)
copy {airflow-core/src/airflow/api =>
providers/openlineage/tests/unit/openlineage/dags}/__init__.py (100%)
rename {airflow-core/tests/unit =>
providers/openlineage/tests/unit/openlineage}/dags/test_openlineage_execution.py
(100%)
delete mode 100644 scripts/in_container/remove_arm_packages.py
