This is an automated email from the ASF dual-hosted git repository.
Lee-W pushed a change to branch ci-upgrade-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 68757a14fb5 [main] CI: Upgrade important CI environment
add 7a4c0599ff6 Speed up the java_sdk e2e Gradle builds with concurrency
and caching (#69239)
add da4643cce33 Mention min Java version in Java SDK README (#69691)
add 5ac8c33b218 Validate Dag and task IDs in the ts-sdk task registry
(#69400)
add 9964065eb04 Bump the fab-ui-package-updates group across 1 directory
with 2 updates (#69664)
add 211d93db1b4 Generate a fresh EmrContainerOperator request token on
each task attempt (#69625)
add 66b23a672b0 Document the dynamic `system_prompt` pattern for common-ai
agents (#69636)
add 30e6372af49 Guard code_mode example DAG on SQLToolset import (#69677)
add 9bf39a85e9d Keep asyncpg installed by default in the Postgres provider
(#69690)
add 39ab6006ed2 Add team name tags to Edge worker metrics (#69149)
add 1ce3f17906c Add the option to select bundle version parameter on dag
run trigger endpoint (#61550)
add c3a95456dad Bump eslint-plugin-unicorn (#69718)
add 5e6e5482b8c Bump the auth-ui-package-updates group across 1 directory
with 4 updates (#69717)
add d24297f6582 Change log level from info to debug for Edge job fetch
(#68736)
add 304708cda47 Consume external role ARN in Neptune Analytics system test
(#69682)
add 8175e0cce11 Add team_name tag to OpenLineage metrics (#69109)
add 37783b80006 Consolidate OpenLineage e2e tests into airflow-e2e-tests
(#69671)
add 09bba935c0f Skip Java SDK jobs for doc-only changes (#69674)
add f900d28dcbf Fill Taiwanese Mandarin translation gap (#69708)
add 9ea5555529b [main] CI: Upgrade important CI environment
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (68757a14fb5)
\
N -- N -- N refs/heads/ci-upgrade-main (9ea5555529b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.dockerignore | 1 -
.github/workflows/additional-prod-image-tests.yml | 33 +-
.github/workflows/airflow-e2e-tests.yml | 32 ++
.github/workflows/ci-amd.yml | 7 +-
.github/workflows/ci-arm.yml | 7 +-
...-tests.yml => openlineage-e2e-compat-tests.yml} | 86 +---
.rat-excludes | 1 -
.../language-sdks/java.rst | 2 +-
.../auth/managers/simple/ui/package.json | 10 +-
.../auth/managers/simple/ui/pnpm-lock.yaml | 481 ++++++++++++---------
.../api_fastapi/core_api/datamodels/dag_run.py | 1 +
.../core_api/openapi/v2-rest-api-generated.yaml | 10 +
.../api_fastapi/core_api/routes/public/assets.py | 36 +-
.../api_fastapi/core_api/routes/public/dag_run.py | 58 ++-
airflow-core/src/airflow/exceptions.py | 4 +
airflow-core/src/airflow/models/dag_version.py | 9 +-
.../src/airflow/serialization/definitions/dag.py | 57 ++-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 22 +
.../airflow/ui/openapi-gen/requests/types.gen.ts | 2 +
.../airflow/ui/public/i18n/locales/zh-TW/dags.json | 2 +
.../core_api/routes/public/test_assets.py | 88 ++++
.../core_api/routes/public/test_dag_run.py | 217 +++++++++-
airflow-core/tests/unit/models/test_dag.py | 118 +++++
.../src/airflowctl/api/datamodels/generated.py | 2 +
.../docker/openlineage-compat.Dockerfile | 0
airflow-e2e-tests/docker/openlineage.yml | 83 ++++
.../tests/airflow_e2e_tests/conftest.py | 180 ++++----
.../tests/airflow_e2e_tests/constants.py | 4 +
.../airflow_e2e_tests/e2e_test_utils/clients.py | 3 +-
.../airflow_e2e_tests/openlineage_tests}/README.md | 52 ++-
.../openlineage_tests}/__init__.py | 0
.../dags_extra/e2e_versioned_bundle.py | 0
.../dags_extra/openlineage_warmup_dag.py | 0
.../openlineage_tests}/harness.py | 93 ++--
.../openlineage_tests}/prepare_dags.py | 53 +--
.../openlineage_tests}/task_logs.py | 0
.../openlineage_tests}/test_openlineage_e2e.py | 27 +-
dev/breeze/doc/05_test_commands.rst | 31 +-
dev/breeze/doc/ci/04_selective_checks.md | 12 +-
.../output_setup_check-all-params-in-groups.svg | 2 +-
.../output_setup_check-all-params-in-groups.txt | 2 +-
.../output_setup_regenerate-command-images.svg | 8 +-
.../output_setup_regenerate-command-images.txt | 2 +-
dev/breeze/doc/images/output_testing.svg | 18 +-
dev/breeze/doc/images/output_testing.txt | 2 +-
.../images/output_testing_airflow-e2e-tests.svg | 37 +-
.../images/output_testing_airflow-e2e-tests.txt | 2 +-
.../images/output_testing_providers-e2e-tests.svg | 182 --------
.../images/output_testing_providers-e2e-tests.txt | 1 -
.../airflow_breeze/commands/testing_commands.py | 261 ++++-------
.../commands/testing_commands_config.py | 21 +-
dev/breeze/src/airflow_breeze/utils/run_tests.py | 6 -
.../src/airflow_breeze/utils/selective_checks.py | 29 +-
dev/breeze/tests/test_selective_checks.py | 43 +-
devel-common/src/tests_common/test_utils/dag.py | 10 +-
java-sdk/README.md | 6 +
providers-e2e-tests/README.md | 111 -----
providers-e2e-tests/openlineage/.gitignore | 7 -
.../openlineage/.pre-commit-config.yaml | 33 --
.../openlineage/docker-compose-local.yaml | 56 ---
.../openlineage/docker-compose.yaml | 181 --------
providers-e2e-tests/openlineage/pyproject.toml | 85 ----
providers-e2e-tests/openlineage/tests/conftest.py | 194 ---------
providers-e2e-tests/openlineage/tests/constants.py | 42 --
.../airflow/providers/amazon/aws/operators/emr.py | 11 +-
.../system/amazon/aws/example_neptune_analytics.py | 70 +--
.../amazon/aws/operators/test_emr_containers.py | 42 ++
providers/common/ai/docs/operators/agent.rst | 20 +
providers/common/ai/docs/operators/llm.rst | 5 +
.../common/ai/example_dags/example_agent.py | 67 ++-
providers/edge3/docs/deployment.rst | 4 +-
.../src/airflow/providers/edge3/cli/worker.py | 2 +-
.../providers/edge3/executors/edge_executor.py | 5 +-
.../airflow/providers/edge3/models/edge_worker.py | 22 +-
.../providers/edge3/worker_api/routes/jobs.py | 8 +-
.../providers/edge3/worker_api/routes/worker.py | 9 +-
.../unit/edge3/executors/test_edge_executor.py | 42 +-
.../unit/edge3/worker_api/routes/test_jobs.py | 63 ++-
.../unit/edge3/worker_api/routes/test_worker.py | 64 ++-
.../fab/src/airflow/providers/fab/www/package.json | 4 +-
.../src/airflow/providers/fab/www/pnpm-lock.yaml | 192 ++++----
.../providers/openlineage/plugins/adapter.py | 35 +-
.../providers/openlineage/plugins/listener.py | 84 +++-
.../airflow/providers/openlineage/utils/utils.py | 19 +-
.../providers/openlineage/version_compat.py | 3 +-
.../tests/unit/openlineage/plugins/test_adapter.py | 284 +++++++++++-
.../unit/openlineage/plugins/test_listener.py | 319 +++++++++++++-
.../tests/unit/openlineage/utils/test_utils.py | 56 +++
providers/postgres/README.rst | 1 +
providers/postgres/docs/changelog.rst | 19 +-
providers/postgres/docs/index.rst | 1 +
providers/postgres/pyproject.toml | 7 +
pyproject.toml | 7 -
...un_mypy_full_dist_local_venv_or_breeze_in_ci.py | 4 -
ts-sdk/src/sdk/registry.ts | 23 +-
ts-sdk/tests/sdk/registry.test.ts | 41 +-
uv.lock | 31 +-
97 files changed, 2742 insertions(+), 1987 deletions(-)
rename .github/workflows/{providers-e2e-tests.yml =>
openlineage-e2e-compat-tests.yml} (52%)
rename providers-e2e-tests/openlineage/Dockerfile =>
airflow-e2e-tests/docker/openlineage-compat.Dockerfile (100%)
create mode 100644 airflow-e2e-tests/docker/openlineage.yml
rename {providers-e2e-tests/openlineage =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/README.md (57%)
copy {airflow-core/src/airflow/_shared =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/__init__.py (100%)
rename {providers-e2e-tests/openlineage =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/dags_extra/e2e_versioned_bundle.py
(100%)
rename {providers-e2e-tests/openlineage =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/dags_extra/openlineage_warmup_dag.py
(100%)
rename {providers-e2e-tests/openlineage/tests =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/harness.py (71%)
rename {providers-e2e-tests/openlineage =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/prepare_dags.py
(75%)
rename {providers-e2e-tests/openlineage/tests =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/task_logs.py (100%)
rename {providers-e2e-tests/openlineage/tests =>
airflow-e2e-tests/tests/airflow_e2e_tests/openlineage_tests}/test_openlineage_e2e.py
(78%)
delete mode 100644 dev/breeze/doc/images/output_testing_providers-e2e-tests.svg
delete mode 100644 dev/breeze/doc/images/output_testing_providers-e2e-tests.txt
delete mode 100644 providers-e2e-tests/README.md
delete mode 100644 providers-e2e-tests/openlineage/.gitignore
delete mode 100644 providers-e2e-tests/openlineage/.pre-commit-config.yaml
delete mode 100644 providers-e2e-tests/openlineage/docker-compose-local.yaml
delete mode 100644 providers-e2e-tests/openlineage/docker-compose.yaml
delete mode 100644 providers-e2e-tests/openlineage/pyproject.toml
delete mode 100644 providers-e2e-tests/openlineage/tests/conftest.py
delete mode 100644 providers-e2e-tests/openlineage/tests/constants.py
